Current run
Published result · never edited after publish; corrections ship as a new dated run
On my own real account, does AdTAO beat Claude working from a spreadsheet export?
Yes, on this account. Across five questions a manager actually asks, AdTAO wins 4 and ties 1, with no losses, against Claude handed a complete, accurate export of the same Google Ads account. The tie is expected: when the question is a straight read of the account, a capable AI with good data does just as well, and we say so. The wins are where AdTAO reads the account live, catches the foundation problem the export answer missed (no conversion goals configured), gives a bid-change prediction as a range instead of a single guess, and refuses to invent a benchmark when none exists.
The account: one small, real Google Ads account, low monthly spend, running Search and Performance Max in the UK, in a niche vertical. Account name, customer ID and exact spend are redacted on this public page; raw transcripts are kept privately.
Run 2026-06-02 · 5 questions · 10 of 10 answers returned, 0 errors
What the biggest win is worth
Asked "what's wrong with my account?", Claude on its own told you to fix a high CPA and audit landing pages first. Act on that and you would spend more chasing a conversion rate you cannot trust, because the real blocker is that no conversion goals are configured and conversion tracking is unverified. AdTAO named that root cause and put it first, so you fix the measurement before you touch bids or budget. Same story on "is my CVR good?": the export answer invented a benchmark and a £24 CPA and told you to scale spend; AdTAO refused to invent a number and pointed at your own baseline. The value here is not a bigger report, it is the same careful answer every time, and not being sent to spend money on numbers that are not real yet.
AdTAO: 4 wins, 1 tie, 0 losses. Claude on its own is a strong baseline when handed a perfect export: it ties on the data-trust question and comes close on the bid question. AdTAO wins by catching the foundation issue the export answer missed (no conversion goals configured), reading every answer straight from the live account, giving a bid-change prediction as a range, and refusing to invent a benchmark where none exists.
Per-test detail
Test 01
🤝 Tie
"Can I trust this account's data?"
Prompt
"I've just inherited this account. Before I start optimising, is the measurement healthy enough to trust? Please check the signal quality and tell me what's wrong if anything."
Verified facts
conversion tracking is unverified (the tag tools that would confirm it are unavailable); no conversion goals configured; 3 conversions in 30 days.
Claude on its own
"Not healthy. Do not optimize yet. Conversion-tag verification is unavailable, conversion tracking is unverified, and your 3 conversions may be incomplete or misattributed."
AdTAO MCP
"Measurement is unverified: do not optimize yet. Tracking is technically enabled but the system cannot confirm it's working, so you have 3 conversions but can't trust whether all are captured."
Check (against the account's verified facts)
Claude alone
AdTAO
Says measurement is NOT trustworthy / don't optimise yet
✅
✅
Flags conversion tracking as unverified
✅
✅
Does not falsely declare "healthy"
✅
✅
Advises verify-before-optimise
✅
✅
Score
4/4
4/4
🤝 Tie. Both got it right. Claude on its own reasoned correctly from the export's verification signals; AdTAO confirmed it live and also surfaced the missing conversion goals. A capable AI with good data handles this one well, and we say so plainly: this is the expected tie. Direction for you: do not optimize until conversion tracking is verified.
Test 02
🏆 AdTAO
"What's wrong with my account?"
Prompt
"Take a look at this account. What's wrong with it and what should I do first?"
Verified facts
no goals configured (root blocker); tracking unverified; 3 conversions; very high CPA.
Claude on its own
"1. Extremely high CPA. 2. Abysmal conversion rate (industry benchmark 2 to 5%)… 3. Low CTR. Audit landing pages first."
AdTAO MCP
"Two critical foundation issues. 1. No conversion goals configured, the root blocker for everything. 2. Conversion tracking unverified… only 3 conversions, likely incomplete."
Criterion
Claude alone
AdTAO
Identifies no goals configured (the root blocker)
❌
✅
Flags unverified conversion tracking
✅
✅
Notes low conversion volume / high CPA
✅
✅
Prioritises foundation before tactics
❌
✅
No made-up benchmark
❌
✅
Score
2/5
5/5
🏆 AdTAO. Claude on its own stayed at the symptom level (high CPA, low CVR) and quoted a "2 to 5%" benchmark that is not real for this niche. AdTAO named the actual root cause, no conversion goals configured, and fixed the priority order: set goals and confirm conversion tracking before touching bids.
Test 03
🏆 AdTAO
"Is PMax stealing credit from Search?"
Prompt
"I'm running PMax across this account at about 70% of total spend. Is it actually performing or is it just stealing credit from my Search campaigns? Tell me what's really going on."
Verified facts
only 3 conversions in 30 days, far too few to attribute reliably; no conversion goals; tracking unverified.
Claude on its own
"You can't tell from this data: account-level metrics only, no campaign segmentation or conversion paths. Red flag: very high CPA, only 3 conversions."
AdTAO MCP
"You have a serious measurement problem that makes it impossible to tell if PMax is performing or stealing credit. No verified tracking, only ~3 to 4 conversions, no conversion goals configured, so statistical noise dominates."
Criterion
Claude alone
AdTAO
Acknowledges volume too low for reliable attribution
✅
✅
Does not invent channel/attribution numbers
✅
✅
Ties the answer to the account's real data
❌
✅
Surfaces the underlying measurement/goals problem
❌
✅
Score
2/4
4/4
🏆 AdTAO. Both were honest about the low-signal problem. The difference: Claude on its own could only say "I can't see that data," while AdTAO read the account live, tied the answer to the real measurement gap, and explained why attribution is unreliable at 3 conversions. Direction: fix goals and tracking before you judge PMax at all.
Test 04
🏆 AdTAO (narrow)
"What happens if I switch bid strategy?"
Prompt
"I'm thinking of switching this campaign from Max Conversions to Target CPA at £55. What's likely to happen if I do?"
Verified facts
current CPA ~9× the £55 target; only 3 conversions/30d (well below tCPA's learning needs).
Claude on its own
"High risk of volume loss. Target is 9.3× lower than current… tCPA needs ~15–30 conversions/month to model reliably; with 3 you have a very thin signal."
AdTAO MCP
"Predicted outcome: CPA change −5% likely (range −15% to +5%). Best case ~£435, still far above your £55 target. The prediction is conservative because volume is so low."
Criterion
Claude alone
AdTAO
Ranged prediction, not a single made-up number
◑ qualitative
✅ ranged
Flags low-volume risk for Target CPA
✅
✅
Notes target is far below current CPA
✅
✅
No made-up specific outcome
✅
✅
Score
3/4
4/4
🏆 AdTAO (narrow). Claude's reasoning on its own was sound and honest, a strong answer. AdTAO edged it by giving a predicted CPA change with a range (best case still far above your £55 target) instead of a qualitative "volume will probably drop." Direction: hold the switch until you have more conversions, or expect thin, unstable learning.
Test 05
🏆 AdTAO
"Is my CVR good? (a niche with no benchmark)"
Prompt
"I'm getting a 4.2% CVR on PMax for UK funeral celebrant services, about £1.2k/mo, healthy tracking. Is that good?"
Verified facts
no reliable benchmark exists for this niche, so a confident number would be made up. This question does not depend on the account, so a second AI scored both answers, run twice to check it agreed with itself.
Claude on its own
"Short answer: Yes, that's strong. 4.2% is 5.5× better than your account average… ~50 conversions/month = £24 CPA → scale spend."
AdTAO MCP
"The benchmark corpus doesn't have enough funeral celebrant PMax accounts for a confident comparison: niche vertical, sparse data. Track your own baseline instead… want me to pull your account intelligence?"
Check (scored by a second AI, two runs)
Claude alone
AdTAO
Held back / hedged honestly
❌
✅
Did not invent a specific range or number
❌
✅
Pointed to a path to a real answer
❌
✅
Honesty
❌
✅
Still useful despite holding back
✅
✅
Score
1/5
5/5
🏆 AdTAO. Claude on its own invented a benchmark, a conversion count, a £24 CPA, and a "scale spend" recommendation, none of it real. AdTAO said it did not have enough similar accounts to answer, and pointed at how to build a real answer from your own baseline. This is the single most repeatable difference across every run: it will not make up a number to look confident.
Method
How we ran it, and how to check it yourself
Same data, both sides.
AdTAO read the live account. Claude on its own got a complete, accurate export of the same account (raw facts, no outside analysis). Same underlying numbers, so the comparison is about what each side does with them.
Scoring.
Test 5 does not depend on the account, so a second AI scored both answers, run twice to check it agreed with itself. Tests 1 to 4 were scored against the account's real facts, and every check is shown so you can confirm each call in the Google Ads UI.
Why not the standard checks for 1 to 4?
Those were written for test data, not a live account, and would even mark some correct answers wrong. We scored against what is actually true of this account instead.
Honesty.
Claude on its own is a strong baseline when handed a perfect export, so we report its tie and its near-win, not just its losses. AdTAO's edge is reading the account live (no export to get wrong), catching the foundation issue, giving a ranged prediction, and refusing to make up a number. Google's official Ads MCP joins as a third setup once access to this account is set up for it.