ThymesnowWe do your marketing for youThymelabDo it yourself, all in one place
Thymesnow
Check library · AI answers (AEO and GEO)

AI crawlers are blocked

highai_crawler_blockedfix written automatically

Why it matters

Blocking GPTBot, ClaudeBot, PerplexityBot and friends removes the site from AI answers.

What to do about it

Decide deliberately: allow the crawlers you want citations from.

The engine generates this fix itself using the update_robots_ai strategy. It arrives in your queue as a complete artefact, because an incomplete fix never reaches the queue, and once you approve it the change is pushed and the page re-fetched to confirm it is live.

How it is weighted

These are the values the scoring actually uses, not a description of them. Priority is derived from all three rather than chosen, which is why a high-impact, low-effort finding surfaces above a severe one that would take a quarter to fix.

Severity
high
Impact
70% of the weight this category can carry
Effort
20%, where 100% is a project rather than a change
Confidence
80% that a hit is a real problem rather than a pattern we misread
Area
AI answers (AEO and GEO)

Other checks in AI answers (AEO and GEO)

criticalThe page's content only exists after JavaScript runscontent_needs_javascriptneeds a decisionhighTitle or description is injected by script rather than servedmeta_needs_javascriptneeds a decisionhighAn SEO tool is injecting fixes client sideseo_injection_scriptneeds a decisionhighBody content is not present in the served HTMLcontent_not_extractableneeds a decisionmediumPage does not answer its question directlyno_direct_answerfix writtenmediumNo citable facts or datano_citable_factsneeds a decisionmediumNo identifiable authorno_author_attributionneeds a decisionmediumThe brand entity is not definedentity_unclearfix written

Check your own site for this

The whole catalogue over a real crawl, in about four minutes, in your browser. No account and no card.

See what we would fix this weekBack to the library