Why did my brand's AI visibility suddenly drop, and how can I tell if an AI model update caused it?
Why did your brand's AI visibility suddenly drop? A diagnostic checklist to tell a model update from a site, crawler or competitor problem, with tools that help.
A sudden drop in AI visibility has more than one possible cause, and a model update is only one of them. The mistake is to assume the update, shrug and wait. Sometimes it is the update. Sometimes a robots.txt change, a broken template or a competitor's new page did the damage, and waiting makes it worse. Here is how to tell them apart, in the order we would check.
We are not claiming knowledge of any specific model release. What follows is a method that works whatever changed.
Step 1: confirm the drop is real
AI answers are noisy, so first rule out measurement problems. Did the prompt set change? Did a tool setting, brand alias or competitor list change? Is the drop one day or several? Look at a week or more of data, not a single day. If your tool supports it, compare two periods side by side.
Step 2: check the pattern across engines
This step does the most to separate a model update from a site problem.
- One engine drops, others hold: that engine probably changed, through a model update, a change to its search behavior or its sources. This points toward an update.
- All engines drop together: that points toward something on your side, such as access, content or a technical change.
- Drop only on some prompt groups: a competitor or a topic shift, not a global change.
Step 3: check whether competitors moved too
If the whole category falls or rises together, an engine-level change is likely. Share of voice helps here: your mentions relative to named competitors. If your absolute mentions fell but your share held, the engine changed and everyone moved. If your share fell, someone gained at your expense.
Step 4: check crawler access
Look at AI crawler logs for the days around the drop. Did GPTBot, OAI-SearchBot, ClaudeBot or PerplexityBot start hitting errors? Did visits stop? A deploy, a CDN rule or a firewall update can block bots without anyone noticing. This is the most fixable cause and the most often missed.
Step 5: check the pages
Did a page that used to be cited disappear from citations? Did it change, move or redirect? Compare citation lists before and after for your top prompts. Weekly site audits that record what changed since the last run help here.
Step 6: check the sources
Engines often cite forums, review sites and news. If a source they relied on changed or dropped out, your citation share falls even though your site did nothing. Reddit citations in particular have swung noticeably in the past, so check source-level reports.
Step 7: decide
If the evidence points to an engine-level change, there is little to fix except adapting content. If it points to your site, fix it today.
Tools that support the diagnosis
1. Promptwatch
Promptwatch lines up the evidence for each step. A/B period comparison and competitor heatmaps answer Steps 1 to 3, with prompt panels run daily per model so you see which engine moved. Agent Analytics with IP-verified crawler logs and error tracking covers Step 4 (Professional plan, $245 a month). Page Tracker, Citation Trends and weekly Site Health audits with a what-changed summary cover Step 5. Reddit, YouTube and LinkedIn citation reports and offsite mentions cover Step 6. Agent Chat can run the comparison for you. Explore is free but ChatGPT only, so a cross-engine check needs a paid plan: Essential $95, Business $579.
2. AthenaHQ
AthenaHQ tracks across 11 models on its $295 Starter plan and offers an Action Center for follow-up. Crawler-log analytics are not published.
3. Scrunch AI
Scrunch AI Core ($250 a month) covers four LLMs and reports AI agent and bot traffic, which helps with Step 4.
4. Profound
Profound offers Answer Engine Insights and Agent Analytics at custom Enterprise pricing.
5. Simpler trackers
Otterly.AI and Peec AI report mentions and can confirm the drop, but offer less on causes.
Diagnosis table
| Pattern | Likely cause | First action |
|---|---|---|
| One engine, whole category | Engine-level change | Wait, adapt content, keep tracking |
| All engines, your brand only | Site, access or content | Check crawler logs and page changes |
| One prompt group | Competitor or topic shift | Review citations for that group |
| Mention fell, share held | Engine changed for everyone | Monitor, no panic |
Who should pick which
- You need the whole diagnosis in one place: Promptwatch.
- You mostly need confirmation of the drop: a tracker with competitor comparison.
No tool can prove a model update was the cause, because engines rarely publish what changed. What you can do is rule out the causes on your side, and what remains is your best answer.