AI Search Filters Out Old SEO Spam – And How Evidence Can Be Manipulated – Article and Video 66

By September 29, 2026October 1st, 2026AEO / GEO, Blog, Videos

AI Search Blocks 99.78% of Traditional SEO Spam — But Businesses Face a New Manipulation Threat

Author: Kevin C. Roy  ·  Published:

A peer-reviewed 2026 study testing ten LLM-enhanced search engines against 1,000 real-world black-hat SEO websites found that the systems mitigated more than 99.78% of traditional SEO attacks, primarily during retrieval. However, researchers also demonstrated that manipulation designed specifically around AI retrieval could increase attack effectiveness. For businesses, reputation monitoring must now include the sources AI systems retrieve and trust.

What Changed?

Traditional black-hat SEO has historically attempted to manipulate search rankings through tactics such as:

  • keyword stuffing
  • artificial link networks
  • deceptive content
  • spam pages
  • search-engine-specific optimization tricks

Generative search systems operate differently.

Before an AI system such as ChatGPT or Gemini produces an answer, it may first perform a retrieval process designed to identify relevant documents.

Researchers wanted to understand whether traditional SEO manipulation would survive that process.

Their 2026 ACM Web Conference paper, “Unveiling the Resilience of LLM-Enhanced Search Engines against Black-Hat SEO Manipulation,” tested ten representative LLM-enhanced search engines against a benchmark of 1,000 real-world black-hat SEO websites.

The result was surprisingly encouraging.

The systems mitigated more than 99.78% of traditional SEO attacks across the benchmark.

Retrieval was identified as the primary defensive layer.

What Is Retrieval?

Retrieval is the process an AI search system uses to determine which documents are relevant enough to consider when answering a question.

In simplified form:


Search rankings feed into retrieval and evidence selection before an AI answer.
Ranking well does not answer which evidence an AI system will use.

User Question → Search / Query Interpretation → Document Retrieval → Evidence Selection → Generated Answer

The AI does not evaluate every webpage on the internet.

It narrows the available information down to a smaller candidate set.

If manipulative content fails to enter that set, the model may never see it.

THIS IS WHAT THIS MEANS

Traditional black-hat SEO tactics do not automatically translate into AI visibility.

A page engineered to manipulate conventional search algorithms can still fail because an AI retrieval system determines that the page is not useful evidence for answering the question.

That creates an important distinction between:

Traditional Search AI Search
Compete for ranking position Compete to enter retrieval
Optimize page relevance Optimize evidence relevance
Search algorithm evaluates pages Retrieval narrows candidate evidence
User chooses a result AI may choose supporting sources
Ranking manipulation is primary concern Evidence manipulation becomes another concern

The Bad News: Attackers Are Adapting

The researchers did not stop after testing conventional black-hat SEO.

They developed seven attack strategies designed specifically around the architecture of LLM-enhanced search engines.

The paper highlights vulnerabilities associated with areas including:

  • rewritten queries
  • document segmentation
  • retrieval behavior

Several AI-specific manipulation approaches increased effectiveness substantially, and the researchers report that rewritten-query stuffing and segmented-text approaches roughly doubled manipulation rates relative to baseline conditions.

That does not mean businesses should adopt these techniques.

These were adversarial security experiments designed to identify weaknesses in AI search systems.

The important finding is broader:

Manipulation is adapting to the architecture of generative search.

Why This Matters to Legitimate Businesses

The obvious concern is spam.

The larger concern is evidence integrity.

Imagine that an AI system receives a question such as:

Is Company X trustworthy?

The system retrieves several documents.

Suppose those documents include:

  • an authentic news article
  • the company’s website
  • a legitimate customer review
  • a fabricated comparison site
  • an AI-generated review article
  • several websites repeating the same unsupported accusation

The AI now has to determine which evidence deserves inclusion.

That creates opportunities for manipulation that look very different from classic keyword stuffing.

The New Risk: Synthetic Corroboration

One particularly important concept for companies to understand is false corroboration.

Consider five websites making the same statement about a business.

At first glance, that appears to represent five independent confirmations.

But those five sources could actually originate from one unsupported claim.


Five apparent sources trace back to one original claim before reaching an AI answer.
Multiple citations do not always mean independent confirmation.

For example:

Original false statement
↓
Copied by Website B
↓
Rewritten by Website C
↓
Summarized by Website D
↓
Generated into an article by Website E

An AI retrieval system may encounter several apparently distinct pages.

But the information does not necessarily have several independent origins.

This is why counting citations alone is not enough.

Businesses increasingly need to understand source provenance.

Source provenance means identifying where information originated and how it spread.

What Businesses Should Monitor

Traditional SEO monitoring typically focuses on:

  • keyword rankings
  • competitors
  • backlinks
  • organic traffic
  • technical issues

AI visibility monitoring should add another dimension.

Monitor the Sources Shaping AI Answers

Businesses should periodically examine questions involving:

  • brand reputation
  • company comparisons
  • product quality
  • executive reputation
  • pricing
  • reviews
  • safety
  • financial claims
  • competitive differences

Then identify the sources being used by:

  • ChatGPT
  • Gemini
  • Google AI Overviews / AI Mode
  • Perplexity
  • other commercially relevant answer engines

The Find → Verify → Trace Framework

GreenBanana recommends a simple three-stage process.

1. FIND

Identify sources repeatedly appearing in AI answers involving the company.

Look for patterns rather than isolated citations.

Questions include:

  • Which domains keep appearing?
  • Which sources appear across multiple AI platforms?
  • Are new domains suddenly receiving unusual visibility?
  • Is a negative claim repeatedly being sourced from the same cluster?

2. VERIFY

Determine whether the source itself is credible.

Check:

  • site ownership
  • author identity
  • publication history
  • editorial transparency
  • citations
  • original evidence
  • potential conflicts of interest
  • relationship to competitors

The objective is not to label unfamiliar websites as malicious.

It is to determine whether the source deserves the authority the AI appears to assign it.

3. TRACE

Trace important claims back toward their original source.

Ask:

  • Where did this fact originate?
  • Are multiple websites citing one another?
  • Are they independently confirming the claim?
  • Is there a primary source?
  • Is the same wording appearing across multiple pages?
  • Did the information originate from an authoritative entity?

This separates genuine corroboration from artificial amplification.

What Is Winning vs. Losing?

Losing

The new research suggests businesses should not expect durable AI visibility from:

  • mass keyword stuffing
  • traditional spam pages
  • crude link manipulation
  • low-value content built purely for search engines
  • obsolete black-hat SEO tactics

AI retrieval appears capable of filtering most conventional manipulation before it reaches the generation stage.

Winning

For legitimate businesses, the more sustainable strategy remains:

  • publish authoritative first-party information
  • make important facts easy to retrieve
  • support claims with evidence
  • establish credible authorship
  • maintain consistent entity information
  • earn genuine third-party coverage
  • create original research when possible
  • monitor how outside sources describe the brand

That does not guarantee citation.

But it creates an evidence environment that is much harder to displace with low-quality information.

Adversarial AI SERP Monitoring

For larger or reputation-sensitive companies, GreenBanana recommends adding a monitoring layer specifically focused on potentially manipulated AI evidence.

We call this:

Adversarial AI SERP Monitoring

The goal is not merely to ask:

“Are we appearing in AI?”

The system should also ask:

“What information is influencing the AI’s understanding of us?”

Potential warning signs include:

  • previously unknown sites suddenly becoming frequent citations
  • identical accusations appearing across multiple domains
  • suspicious comparison websites
  • apparently synthetic product reviews
  • fake expert content
  • impersonator sites
  • coordinated negative narratives
  • AI citations that trace back to questionable original evidence

None of those patterns individually proves manipulation.

They are signals that warrant investigation.

Important Limitation

This research was conducted against a defined set of ten LLM-enhanced search products and an experimental benchmark of 1,000 black-hat SEO websites.

Commercial AI systems evolve rapidly.

The exact effectiveness of individual manipulation techniques can change as vendors modify retrieval systems and defenses.


Shows how AI search filters candidate sources before generating an answer.
Retrieval was the main defense against traditional SEO manipulation in the study.

Therefore, the most useful conclusion is not that AI search is permanently “99.78% spam proof.”

The more defensible conclusion is:

At the time of testing, retrieval systems were extremely effective at filtering traditional black-hat SEO, while AI-specific manipulation exposed a newer attack surface.

Key Takeaway

AI search has not eliminated manipulation.

It has changed where manipulation occurs.

The old battle was:

Manipulate the ranking.

The emerging battle is:

Manipulate the evidence.

For legitimate businesses, that means reputation management can no longer stop at Google’s first page.

Companies increasingly need to understand:

What sources does AI retrieve?

Which sources does it trust?

Where did those sources get their information?

Because in an AI-first search environment, controlling your website is only part of controlling your reputation.

Frequently Asked Questions

Can traditional black-hat SEO manipulate ChatGPT or Gemini?

The 2026 research suggests conventional black-hat SEO was largely ineffective across the systems tested, with more than 99.78% of traditional attacks mitigated during the benchmark.

Retrieval is the stage in which an AI search system identifies potentially relevant documents before generating an answer.

Can AI search engines still be manipulated?

Yes. Researchers demonstrated that attacks designed specifically around AI retrieval architecture performed better than traditional SEO attacks under experimental conditions.

What is source provenance?

Source provenance is the process of tracing information back to its original source and understanding how that information was copied, cited or distributed.

Brands should monitor not only whether they appear in AI answers, but also which external sources are influencing claims about their company, products, executives and reputation.

Watch the Breakdown

Ready to talk AEO?

Contact us to discuss AEO.

Contact us