Skip to main content

Blocked AI Bots

A list of bots which are blocked from indexing the content of the page in AI models. 'google' is included where the URL is disallowed in robots.txt for the google-extended user-agent token. 'bing_nocache' is included where a nocache directive allows only URLs, titles and snippets to be used in training Microsoft’s AI models. 'bing_noarchive' is included when a noarchive directive prevents any content being used in training Microsoft’s AI models.

Code: aiBotBlocked