How often do AI answers change for the same question?

Inciteful compared 18,562 pairs of AI answers to the same question. The wording matched in 21, and 56% of the cited sites were cited again.

AI answers change almost every time. Inciteful compared 18,562 pairs of answers to the same question on the same engine, a median of two days apart. The wording matched in 21 of them. On average 56% of the sites one answer cited were cited again in the next, and a business named once was missing next time in 12% of cases.

The wording almost never repeats

Across ChatGPT, Google AI Overviews, Google AI Mode, Gemini and Perplexity, 21 of 18,562 consecutive pairs were word for word the same, about one in 900. ChatGPT did not repeat itself once in 4,169 pairs. A typical answer runs to about 300 words, so a repeat was never likely. What matters to a business sits underneath the wording: which sites the answer leans on, and which businesses it names.

About half of the cited sites carry over to the next answer

Where both answers cited at least one site (17,237 pairs), 56% of the sites cited in the first answer were cited again in the second, on average. 9.9% of pairs cited exactly the same set of sites, and 10.5% had no site in common.

EngineSites cited again next timeExactly the same sitesNo site in common
Perplexity74.9%9.0%0.4%
Google AI Mode56.8%26.4%21.8%
ChatGPT54.9%9.2%8.9%
Gemini46.9%2.8%10.7%
Google AI Overviews42.1%3.2%14.5%
All five56.2%9.9%10.5%

Pairs compared: Perplexity 4,169, Google AI Mode 2,930, ChatGPT 4,008, Gemini 2,488, Google AI Overviews 3,642.

Perplexity is the steadiest: about three in four of the sites it cites return in its next answer. Google AI Overviews is the least steady, keeping about two in five. Google AI Mode cites few sites per answer, a median of two against eight for Perplexity, so it is the most likely to repeat the same set and also the most likely to change all of it.

A business named once is missing from the next answer one time in eight

Each answer was checked for whether it named the business the question is tracked for. In 5,575 pairs the first answer named it, and the next answer left it out in 11.8% of those. Going the other way, a business absent from the first answer was named in the next in 5.4% of 12,987 pairs.

EngineNamed, then missing next timeAbsent, then named next time
Google AI Overviews17.8% of 1,0426.8% of 2,658
Google AI Mode15.7% of 8685.9% of 2,439
ChatGPT11.4% of 1,6188.2% of 2,551
Gemini10.4% of 9194.9% of 2,298
Perplexity5.2% of 1,1281.8% of 3,041
All five11.8% of 5,5755.4% of 12,987

Questions that include the business's own name hold steadier. Leave those out and the figure rises: on questions that do not mention the business, one named answer in five (19.5% of 3,223) was followed by an answer that left it out.

The sources drift further the longer you wait

This takes the first answer recorded for each question on each engine and compares it with a later answer to the same question.

Time between the two answersPairs comparedSites from the first answer still cited
2 to 3 days1,39156.5%
1 week1,28651.4%
2 weeks1,01944.5%
4 weeks35940.6%
6 weeks31335.6%

Most of the change happens straight away, then the sources keep drifting. After six weeks, 36% of the original sites were still being cited.

Over six weeks, one question draws on about 21 different sites

For 1,173 combinations of question and engine with at least eight recorded answers, a typical answer cited five or six sites. Across all of its answers, the same question drew on a median of 21 different sites. In 62% of those combinations, no single site was cited every time.

On the same question, the five engines rarely agree

The comparisons above set an engine against its own earlier answer. This one sets the five against each other. In 2,864 cases, a question that does not mention the business was put to all five engines at the same time. All five named the business in 6.0% of them, none did in 61.8%, and in 32.2% some named it and some did not.

Engines that named the businessCasesShare of cases
None of the five1,76961.8%
One to four of them92232.2%
All five1736.0%

ChatGPT named the business most often, in 872 of those cases against 416 to 511 for each of the others. A business named by one of the other four was also named by ChatGPT about four times in five. A business named by ChatGPT was named by any one of the others less than half the time.

The engines draw on different sites as well. For each pair of engines, this takes the cases where both cited at least one site and counts the sites both cited as a share of all the sites either one cited. Across the ten pairs it averaged 8.3%.

Pair of enginesCases comparedNo site in commonSites cited by both
ChatGPT and Google AI Mode2,52868.9%7.1%
Google AI Mode and Perplexity2,58567.7%5.0%
ChatGPT and Google AI Overviews2,78160.4%6.9%
Google AI Mode and Gemini2,11257.9%8.1%
ChatGPT and Gemini2,19250.9%9.2%
Google AI Overviews and Perplexity2,84150.5%6.6%
ChatGPT and Perplexity2,80345.9%8.6%
Google AI Overviews and Gemini2,23343.9%10.1%
Google AI Overviews and Google AI Mode2,56542.9%12.8%
Gemini and Perplexity2,24238.1%8.8%

ChatGPT and Google AI Overviews had no site in common in 60.4% of 2,781 cases. With the questions that name the business counted too, it was 53.5% of 3,259. A result on one engine says little about another, so each engine needs its own count.

Almost a third of the answers that cite a business's site do not name it

An answer can use a business's website as a source and still not mention the business. On questions that do not include the business's name, 3,622 answers cited the business's own site, and 32.0% of them (1,159) did not name it.

EngineAnswers that cited the business's siteOf those, did not name the business
Perplexity97952.8%
Gemini56434.2%
Google AI Overviews58925.6%
Google AI Mode28221.6%
ChatGPT1,20819.6%
All five3,62232.0%

Perplexity left the name out of more than half of the answers in which it cited the site. ChatGPT named the business in four out of five. It runs the other way as well: of the 3,591 answers that named the business, 31.4% did not cite its website.

Being cited and being named are two separate counts, and a report needs both.

What this means for reporting AI visibility

  • One answer is a sample, not a result. A screenshot shows what one answer said, once.
  • Report a rate over many answers. "Named in 14 of 20 answers this month" stays true when the wording changes. "ChatGPT recommends us" may not.
  • Keep every answer with its sources. When a client is named in one answer and missing from the next, the stored answers show which sites were cited instead.
  • Judge a change over several answers. A named business goes missing from the next answer one time in eight, so a single drop is not evidence that anything broke.

Inciteful stores every answer to a tracked question with its sources, and reports AI visibility and share of voice as counts over those answers. Sources shows which domains and pages the engines cite for a client's questions, and Proof shows a tracked question before and after a page shipped. There is more on the reporting side in how to prove AI search visibility to a client.

What was counted

The sample is 20,817 answers recorded between 30 September and 13 November 2026: 388 buyer questions about 19 businesses, most of them in the United Kingdom, asked of ChatGPT, Google AI Overviews, Google AI Mode, Gemini and Perplexity. Gemini and Google AI Mode join the sample from mid October. Each answer was paired with the next answer to the same question on the same engine, between half a day and four and a half days later. Sites are counted by domain, from the links each answer cited. A business counts as named when the answer names it.

To set the engines against each other, a question counts when all five answered it in the same check: 3,347 cases, 2,864 of them on questions that do not mention the business. A site counts as the business's own when its domain, or a subdomain of it, is among the links an answer cited.

These are the questions tracked on one Inciteful account, not a random sample of everything people ask, so other markets and other kinds of question may behave differently. The figures are totals and no business is identified.

Do AI assistants give the same answer twice?

Almost never word for word. In Inciteful's sample of 18,562 pairs of answers to the same question on the same engine, 21 were identical, about one in 900. The sites cited and the businesses named change less than the wording does, but they change too.

How often does ChatGPT change the sources it cites?

In 4,008 pairs of ChatGPT answers to the same question, a median of two days apart, 55% of the sites cited in the first answer were cited again in the second. 9% of pairs cited exactly the same sites and 9% had no site in common.

Which AI engine gives the most consistent answers?

Of the five measured, Perplexity. 75% of the sites it cited were cited again in its next answer, and a business it named was missing next time in 5% of cases. Google AI Overviews changed most: 42% of sites carried over, and a named business was missing next time in 18% of cases.

If my business is named in an AI answer, will it be named next time?

Usually, but not always. Across five engines, a business named in one answer was missing from the next answer to the same question in 12% of cases. On questions that do not include the business's own name, it was 19.5%.

How should an agency report AI visibility when answers change this much?

As a rate over many answers, with the answers kept. "Named in 14 of 20 answers" stays true when the wording changes, and a single screenshot does not. Keep each answer with its sources, so a drop can be traced to the sites cited instead.

Do ChatGPT and Google AI Overviews cite the same sources?

Rarely. Where both cited at least one site for the same question at the same time, they had no site in common in 60% of 2,781 cases, on questions that do not mention the business. Across all ten pairs of the five engines, the sites two engines both cited averaged 8% of the sites either one cited.

Does being cited in an AI answer mean the business is named?

No. On questions that do not include the business's name, 3,622 answers cited the business's own website, and 32% of them did not name the business. Perplexity left the name out most often, in 53% of such answers, and ChatGPT least, in 20%.

All answers

Your clients’ buyers are asking AI right now. See what it tells them.

A free AI visibility dashboard for any client’s site, on five engines. No card.