Google has implemented functionality to prevent neural network robots from crawling sites

Google has made it possible to prevent site crawling by robots used to train the company's neural networks.

You can hide site content from robots Bard и VertexAI, and such a ban will not affect the indexing of the site by the search engine itself. To do this, you need to add a corresponding entry to robots.txt.

As the base of AI models expands, Google plans to automatically expand the ability to prevent these AIs from indexing a site.

Source: linux.org.ru