Inside 12 Months of AI Search Experiments
What HubSpot learned from a year of testing AI search tactics instead of following AEO hype.
author:

Aja Frost
Director of Growth Marketing @ Mercury, former Sr. Director Growth @ HubSpot

A question to take with you
Which AI search assumption could you test this month instead of treating it as a best practice?
When HubSpot’s blog traffic fell, Aja Frost created a small experimental pod to test how AI search actually works. The team shipped weekly experiments, measured the results, and used failures to separate evidence from AEO hype.
Key takeaways
The team’s first llms.txt experiment produced no measurable impact, reinforcing the need to test popular advice independently.
HubSpot published 141 highly specific industry and use-case pages, then improved them through extensive human QA.
Citations arrived after crawls. Eventually, 92% of those pages were cited and visibility increased by 49%.
Dedicated pricing articles improved AI pricing accuracy for five of six products; correcting third-party sources closed another gap.
Different content can serve humans, bots, or both. The intended audience should shape the format.
Final Thoughts
Winning AI search is an experimentation discipline, not a checklist. Start with a clear hypothesis, watch how models crawl and cite information, and scale only what survives real measurement.
A short editorial introduction from pipeline.here. The full piece lives with its original author.
Inside 12 Months of AI Search Experiments
What HubSpot learned from a year of testing AI search tactics instead of following AEO hype.
author:

Aja Frost
Director of Growth Marketing @ Mercury, former Sr. Director Growth @ HubSpot

A question to take with you
Which AI search assumption could you test this month instead of treating it as a best practice?
When HubSpot’s blog traffic fell, Aja Frost created a small experimental pod to test how AI search actually works. The team shipped weekly experiments, measured the results, and used failures to separate evidence from AEO hype.
Key takeaways
The team’s first llms.txt experiment produced no measurable impact, reinforcing the need to test popular advice independently.
HubSpot published 141 highly specific industry and use-case pages, then improved them through extensive human QA.
Citations arrived after crawls. Eventually, 92% of those pages were cited and visibility increased by 49%.
Dedicated pricing articles improved AI pricing accuracy for five of six products; correcting third-party sources closed another gap.
Different content can serve humans, bots, or both. The intended audience should shape the format.
Final Thoughts
Winning AI search is an experimentation discipline, not a checklist. Start with a clear hypothesis, watch how models crawl and cite information, and scale only what survives real measurement.
A short editorial introduction from pipeline.here. The full piece lives with its original author.
Inside 12 Months of AI Search Experiments
What HubSpot learned from a year of testing AI search tactics instead of following AEO hype.
author:

Aja Frost
Director of Growth Marketing @ Mercury, former Sr. Director Growth @ HubSpot

A question to take with you
Which AI search assumption could you test this month instead of treating it as a best practice?
When HubSpot’s blog traffic fell, Aja Frost created a small experimental pod to test how AI search actually works. The team shipped weekly experiments, measured the results, and used failures to separate evidence from AEO hype.
Key takeaways
The team’s first llms.txt experiment produced no measurable impact, reinforcing the need to test popular advice independently.
HubSpot published 141 highly specific industry and use-case pages, then improved them through extensive human QA.
Citations arrived after crawls. Eventually, 92% of those pages were cited and visibility increased by 49%.
Dedicated pricing articles improved AI pricing accuracy for five of six products; correcting third-party sources closed another gap.
Different content can serve humans, bots, or both. The intended audience should shape the format.
Final Thoughts
Winning AI search is an experimentation discipline, not a checklist. Start with a clear hypothesis, watch how models crawl and cite information, and scale only what survives real measurement.
A short editorial introduction from pipeline.here. The full piece lives with its original author.
Ideas worth your time
Ideas worth your time
Ideas worth your time


Outreach
2 min read
·
Nov 7, 2026
The Cold Email Benchmark Report
What 231,818 cold emails reveal about reply rates, seniority, message quality, and realistic benchmarks.

Will Allred
Cofounder @ Lavender AI
Read more


Outreach
2 min read
·
Nov 7, 2026
The Cold Email Benchmark Report
What 231,818 cold emails reveal about reply rates, seniority, message quality, and realistic benchmarks.

Will Allred
Cofounder @ Lavender AI
Read more


Prospecting
2 min read
·
Nov 2, 2026
Social Signals Outreach on Autopilot: 12 Minutes from Email to Meeting
How social signals, tight ICP filters, and fast outreach helped book a meeting in 12 minutes.

Yuriy Zaremba
Co-Founder & CEO at
AiSDR
Read more


Prospecting
2 min read
·
Nov 2, 2026
Social Signals Outreach on Autopilot: 12 Minutes from Email to Meeting
How social signals, tight ICP filters, and fast outreach helped book a meeting in 12 minutes.

Yuriy Zaremba
Co-Founder & CEO at
AiSDR
Read more


AI & Automation
2 min read
·
Nov 3, 2026
“Proof of Humanity” Is the Biggest Marketing Opportunity Right Now
Why visible human involvement can become a real advantage as AI-generated interactions become the norm.

Tom Orbach
Director of Growth Marketing @ Wiz | Forbes 30 Under 30
Read more


AI & Automation
2 min read
·
Nov 3, 2026
“Proof of Humanity” Is the Biggest Marketing Opportunity Right Now
Why visible human involvement can become a real advantage as AI-generated interactions become the norm.

Tom Orbach
Director of Growth Marketing @ Wiz | Forbes 30 Under 30
Read more




