OpenAI reveals new web crawler named "GPTBot"

stapp · Aug 8, 2023

OpenAI has recently announced its new web crawler, GPTBot. This bot will collect publicly available data for the purpose of training AI models, which the business claims will be done transparently and responsibly.
Click to expand...

https://www.ghacks.net/2023/08/08/openai-reveals-new-web-crawler-named-gptbot/

ronjor · Aug 9, 2023

Websites can now block OpenAI's web crawling bot

By Alfonso Maruccia 09 Aug 2023
OpenAI states that allowing GPTBot to access a site can contribute to enhancing the accuracy of AI models, thus aiding ChatGPT in improving its overall capabilities and "safety." However, individuals and companies who are not interested in contributing to ChatGPT's improvement for free have the option to disallow the crawler. This can be achieved by adjusting the "robots.txt" rules to prevent GPTBot from accessing their website or domain.
Click to expand...

Log in or Sign up

OpenAI reveals new web crawler named "GPTBot"

stapp Global Moderator

ronjor Global Moderator

Log in or Sign up

OpenAI reveals new web crawler named "GPTBot"

stapp Global Moderator

ronjor Global Moderator

Useful Searches