Skip to content
crawlwise.

AI crawler · training · Apple

What is Applebot-Extended?

Apple's robots token for training Apple Intelligence, separate from Applebot for Search and Siri web results.

How this helps you show up

Apple split training from search on purpose. You can pursue Apple Search visibility while deciding separately whether training use is okay — many publishers allow Applebot and only then think about Applebot-Extended.

If it cannot reach your page

Apple Intelligence training paths covered by this token will not use your content. Apple Search crawling uses different rules.

The facts

robots.txt token
Applebot-Extended
Owner
Apple
Product it serves
Apple Intelligence
Category
training — building model training data
Training opt-out
Documented — only affects training-style use, not every AI product
User agent as sent
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/605.1.15 (KHTML, like Gecko) Version/17.4 Safari/605.1.15 (Applebot/0.1; +http://www.apple.com/go/applebot)

robots.txt is a request, not a lock. Our checker fetches your page as Applebot-Extended and reports what actually came back — status code, challenge page, or real HTML.

Check your site in a minute

The AI crawler checker tests Applebot-Extended plus the other answer-engine bots on one URL. No account. Want robots.txt logic only? Use the robots.txt tester.

Other AI crawlers