empireOfLove@lemmy.one to Privacy Guides@lemmy.oneEnglish · 1 year agoOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comexternal-linkmessage-square54fedilinkarrow-up1389arrow-down10cross-posted to: technology@lemmy.ml
arrow-up1389arrow-down1external-linkOpenAI finally admitted they're crawling the web to profit off of GPT. Block it from your sites using robots.txt.platform.openai.comempireOfLove@lemmy.one to Privacy Guides@lemmy.oneEnglish · 1 year agomessage-square54fedilinkcross-posted to: technology@lemmy.ml
minus-squareSpectacle8011AlinkfedilinkEnglisharrow-up3·1 year agoI’m surprised they’re not just using Common Crawl.
I’m surprised they’re not just using Common Crawl.