Strategy

Not Every AI Reads the Live Web, and That Silently Breaks Your GEO Strategy

A recent test of 16 AI assistants found that some ground their answers in a live web search and some do not, changing the actual content of the answer rather than only its sourcing. This piece covers what that means for GEO strategy and how to check where each platform your buyers use actually stands.
Kathryn Kleist
VP of Content Strategy, Arcalea
Jul 15, 2026 · Updated Jul 15, 2026 · 8 min read

Quick Answer: Not every AI assistant searches the live web before answering. Some ground every response in real-time retrieval, while others rely largely on static training data and only occasionally incorporate live sources. Testing by Andre Alpar found this distinction changes the actual content of an answer rather than only whether it cites a source, since assistants that searched live provided correctly localized information that assistants relying on training data got wrong. For GEO strategy, this means content freshness and optimization only reach the platforms that are actually retrieving live content in the first place.

Ask an AI assistant a question in English from Germany, and depending on which one you asked, you might get an American emergency number handed to a German user, not because the assistant is broken, but because it answered from memory instead of checking the live web, and its training data defaults to the United States.

That is the finding at the center of a recent test by Andre Alpar, who ran the same 50 questions through 16 AI assistants in both German and English. The assistants that searched the live web found the correct German information even when asked in English. The ones answering purely from training data defaulted to American answers, regardless of who was actually asking.

The Test That Exposed the Gap

Alpar's test asked the same 50 questions in German and English across 16 consumer AI assistants, then checked which ones returned correct, localized answers. One question involved a country-specific emergency number. Asked in German, all 16 assistants gave the correct German numbers. Asked in English, most defaulted to American numbers, even though the underlying question had not changed.

The split lined up cleanly with whether an assistant searched the live web before responding. The assistants that pulled in real sources during the German-language test kept doing so in English and found German results regardless of the language used to ask. The assistants that answered from memory carried their training data's default assumptions into the English-language responses, and that default was American. Grounding, in other words, did more than add a citation. It changed what the assistant actually said.

Why This Matters for GEO, Beyond Consumer Trivia

The emergency number example is a clean illustration, but the underlying mechanic applies directly to B2B buyer research. If an AI assistant answers a category question from static training data rather than a live search, then updating your content, refreshing your data, or publishing a new benchmark does nothing for that platform this quarter, since the assistant is not looking so much as recalling whatever it learned during training, which may be many months old.

That reframes a basic assumption behind most GEO advice. Freshness, schema updates, and new content only reach the AI platforms that retrieve from the live web in the first place. For any platform that still answers primarily from training data, a brand's most recent work is invisible until the next training cycle, whenever that happens.

The Platform Layer Most GEO Advice Skips

Alpar's testing also surfaced something that complicates AI visibility tracking more broadly. Several consumer AI assistants are not a single, stable model behind the scenes. In his test, Perplexity's default setting routed questions to Claude rather than its own proprietary model, and other assistants would not confirm which underlying model was answering at all.

That matters for anyone measuring AI Share of Voice by platform name. A dashboard reporting visibility inside a named assistant may actually reflect visibility into whichever model that assistant happened to route the query to that day, which is a moving target rather than a fixed system to optimize against.

What to Actually Check

Do not assume live retrieval applies uniformly across the platforms your buyers use. Test directly, with your own category queries, on each platform you care about, and check whether the answer references anything published recently. An answer that only reflects older, well-established information is a signal that the platform may be responding from training data rather than a live search for that query type.

Run the same test in every language your buyers actually use. Alpar's finding held for a functional, factual question with a clear right answer, and the language-dependent default appeared consistently across the assistants tested. A B2B brand serving multiple markets should confirm that an assistant's answers hold up in the languages its actual buyers use, not only in English.

Test Before You Optimize

GEO advice tends to assume a single, consistent AI to write for, but the platforms your buyers actually use do not behave that way. Some are grounded in live search and will reward exactly the freshness and citation work most GEO guidance recommends. Others are answering from memory and will not notice any of it until their next training update.

Knowing which is which, for the specific platforms and languages your buyers use, is the starting point. If you want help mapping where your brand actually shows up across AI platforms and which ones are grounded versus static, the AEO Index tracks that by platform.

Frequently Asked Questions

Answers to the questions we hear most often about AEO and GEO.

No. Some AI assistants ground every response in a live web search, while others answer primarily from static training data and only sometimes add live retrieval. Testing across 16 consumer assistants found this distinction changed the actual content of answers, not only their sourcing or citations.

If a platform answers based on training data rather than a live search, then new content, updated data, or a newly published benchmark will not reach that platform until its next training cycle. Freshness-based GEO tactics only produce results on platforms that are actually retrieving from the live web for the queries in question.



Test the platform directly with a query tied to recently changed information and see whether the answer reflects it. If the response contains only older, well-established facts, the platform is likely responding from training data rather than from a live search for that query type.

It requires caution. Some consumer AI assistants route a query to a different underlying model depending on settings or conditions, so a report of visibility within a named platform may actually reflect visibility within whichever model handled that particular query, rather than a fixed system.

 

Ready to Put a Framework Behind Your Strategy?

Arcalea's Measure, Accelerate, and Amplify model starts with strategic clarity before any tactic is executed.