Skip to main content

Current run Per-test evidence · frozen at publish · never edited

AdTAO read suite on a live account

2026-06-02 · 28 read-only tests · Claude Sonnet 4.6

Capability log (AdTAO-only — no opponent on this run; the head-to-head is the 2-way).

Summary · 28 tests total

  • Grounded (called live tools, returned a real answer) 22
  • Asked for specifics first (no tool call) 4
  • Answered without tools 1
  • Error 1

Per-test detail

Test 01 Grounded

Prompt

"I've just inherited this account. Before I start optimising, is the measurement healthy enough to trust? Please check the signal quality and tell me what's wrong if anything."

Tools called (3)

  • get_account_intelligence
  • get_account_intelligence
  • archetype_detect

AdTAO's answer (excerpt)

## Measurement Health Assessment **⚠️ Your measurement setup has critical gaps. You should NOT optimize aggressively until these are fixed.** ### Key Issues: 1. **Conversion Tracking Unverified** (Critical) - GTM and GA4 verification are **unavailable** — the system cannot confirm your conversion tracking is actually working - This is a blocker for confident optimization 2. **Call Conversion Misconfiguration** (High Severity) - Your "Calls from ads" conversion action has: - …

Test 02 Grounded

Prompt

"Take a look at this account. What's wrong with it and what should I do first?"

Tools called (4)

  • get_account_intelligence
  • archetype_detect
  • get_account_intelligence
  • briefing

AdTAO's answer (excerpt)

## Account Summary: **Critical Issues Found** Your account has **103 detected issues** across measurement, strategy, and content. Here's what's broken: ### 🔴 **Top Priority Issues (Do These First)** 1. **Measurement Foundation Broken** - **Duplicate conversion actions** (multiple instances) — you're double-counting conversions - **Multiple primary conversions** — conflicting goal signals confuse bidding - **GA4 link missing** on at least one campaign — no data flow to analyti…

Test 04 Grounded

Prompt

"I'm running PMax across this account at about 70% of total spend. Is it actually performing or is it just stealing credit from my Search campaigns? Tell me what's really going on."

Tools called (4)

  • get_account_intelligence
  • archetype_detect
  • get_recent_changes
  • get_account_performance_summary

AdTAO's answer (excerpt)

## Here's what's actually happening: **The bad news: Your account has a critical measurement problem that makes it impossible to answer your question.** ### Key Findings: 1. **No conversion tracking** — The system shows 33 conversions over the entire period, but your conversion rate is 0% across all metrics. This means Google Ads isn't properly attributing conversions to campaigns. You can't trust any performance comparison between PMax and Search until this is fixed. 2. **Re…

Test 05 Grounded

Prompt

"Is my Search campaign structured the way it should be? I think something's off but I can't put my finger on it."

Tools called (4)

  • get_account_intelligence
  • archetype_detect
  • get_account_intelligence
  • archetype_detect

AdTAO's answer (excerpt)

## Here's what I found: ### **Critical Structural Issues:** 1. **No Goals Configured** — Your account has zero goals set up. This is blocking proper optimization and performance tracking. Without goals, your campaigns can't align to business objectives. 2. **Unverified Conversion Tracking** — Conversion measurement is unverified (GTM and GA4 not connected). You're tracking conversions but can't confirm the data is reliable. 3. **Missing Negative Geo Targeting** — All 3 campai…

Test 06 Grounded

Prompt

"My client wants better performance on this account. Where should I focus?"

Tools called (4)

  • session_state
  • get_account_intelligence
  • archetype_detect
  • briefing

AdTAO's answer (excerpt)

## **Top 3 Focus Areas for Better Performance** ### **1. Fix Measurement Foundation (Q1) — CRITICAL** Your account has **duplicate conversion actions** and **multiple primary conversions** configured. This breaks attribution and makes optimization impossible. **Action:** - Consolidate duplicate conversion actions (you have 8+ duplicates) - Set a single primary conversion for goal optimization - Link GA4 to the account for verified measurement **Impact:** Without clean measure…

Test 07 Grounded

Prompt

"My CVR has dropped over the last 60 days. I think it might be the landing page but I'm not sure. Can you check?"

Tools called (5)

  • get_account_intelligence
  • get_recent_changes
  • get_monthly_performance_comparison
  • archetype_detect
  • archetype_detect

AdTAO's answer (excerpt)

## Key Findings Based on my analysis, **the CVR drop is NOT primarily a landing page issue**. Here's what I found: ### What Changed in the Last 60 Days: 1. **Budget Cuts (June 2)** — Most recent and significant: - Two major campaigns had budgets slashed by ~78% (from $93.7K to $20.6K) - This happened just 1 day ago 2. **Gradual Budget Increases (May 24-30)** — Before the cuts: - Steady daily budget increases across all campaigns - Suggests scaling activity that may have attra…

Test 08 Grounded

Prompt

"My CPCs are up about 35% over the last 6 weeks. Why?"

Tools called (3)

  • get_account_intelligence
  • get_recent_changes
  • get_monthly_performance_comparison

AdTAO's answer (excerpt)

Based on the data, here's what's driving your CPC increase: ## Root Cause: Aggressive Budget Increases **The primary driver is a sustained campaign budget expansion over the past 6 weeks:** - **May 15**: Budget jumped from $10K to $30K (+200%) - **May 24–June 2**: Continuous daily increases, escalating from $27K to $93.7K - **June 2**: Sharp cut back to $20.6K (most recent) This pattern shows **budget-driven bid pressure**. When you increase daily budgets significantly, Googl…

Test 09 Grounded

Prompt

"I'm thinking of switching this campaign from Max Conversions to Target CPA at £55. What's likely to happen if I do?"

Tools called (3)

  • get_account_intelligence
  • simulate_action
  • simulate_action

AdTAO's answer (excerpt)

## Prediction: Max Conversions → Target CPA £55 **Expected outcome:** CPA will **improve by ~12%** (from £512.67 to ~£451) **Confidence envelope:** - **Optimistic:** -25% (CPA drops to ~£384) - **Median:** -12% (CPA drops to ~£451) - **Pessimistic:** +10% (CPA rises to ~£564) ### What this means: Your current CPA is quite high at £512.67 on just 3 conversions in the last 30 days. Setting a Target CPA of £55 is **significantly more aggressive** — you're essentially telling Goo…

Test 10 Grounded

Prompt

"This campaign is budget-limited. How much should I add to it?"

Tools called (1)

  • get_account_intelligence

AdTAO's answer (excerpt)

I can see you have two budgets configured: - **NB Residential**: $1,392.21/month - **Brand**: $104.79/month However, I need more context to give you a specific recommendation. **Which campaign are you asking about?** Is it: 1. **NB Residential** (the larger budget)? 2. **Brand** (the smaller budget)? Also, to recommend a budget increase, I should understand: - **Why do you think it's budget-limited?** (e.g., hitting daily budget caps, missing impression share, strong ROI that…

Test 11 Asked for specifics

Prompt

"Here are the search terms from the last 30 days. Which should I add as negatives?"

Tools called (none)

AdTAO's answer (excerpt)

I'd be happy to help you identify search terms to add as negatives, but I don't see the search terms list in your message. Could you please share: 1. **The search terms** you want me to review (you can paste them as a list, table, or file) 2. **Your business context** — what do you sell/offer? This helps me identify irrelevant searches 3. **Any specific criteria** — e.g., low conversion rate, high cost, brand-related, etc. Alternatively, if you'd like me to pull the search te…

Test 12 Grounded

Prompt

"This account is performing. I want to expand. What new keywords should I add?"

Tools called (3)

  • get_keyword_intelligence
  • get_keyword_gaps
  • get_account_intelligence

AdTAO's answer (excerpt)

**To recommend new keywords, I need to understand your business better.** Here's what I see: **Current Account State:** - **Budget:** $1,497 (NB Residential: $1,392 + Brand: $105) - **Performance:** 3 conversions, $512.67 CPA, 0.76% CVR, 4.5% CTR - **Status:** No goals configured yet, conversion tracking unverified **To identify expansion keywords, please tell me:** 1. **What products/services do you offer?** (e.g., "residential HVAC installation," "luxury wedding planning") …

Test 13 Asked for specifics

Prompt

"Write me 10 new headline variants for this ad group, and tell me which to ship."

Tools called (none)

AdTAO's answer (excerpt)

I need to know which ad group you're referring to. Could you provide: 1. **Campaign name** (or campaign ID) 2. **Ad group name** (or ad group ID) 3. **What you're advertising** (product/service, target audience, key value props) 4. **Current headlines** (if you want me to iterate on existing ones) Alternatively, if you'd like me to pull this from your account, I can: - Fetch your account structure and show you the ad groups - Analyze performance data to understand what's work…

Test 14 Grounded

Prompt

"My ad performance has flatlined. Is my creative tired?"

Tools called (3)

  • get_account_intelligence
  • get_recent_changes
  • archetype_detect

AdTAO's answer (excerpt)

## The Real Problem: It's Not Your Creative—It's Your Budget Your ad performance flatline is **not** a creative fatigue issue. Here's what's actually happening: ### Key Findings: **1. Massive Budget Cuts (June 2)** - Your two main campaigns had budgets slashed by **78%** on June 2: - Campaign 1: $93.74 → $20.62 daily - Campaign 2: $93.74 → $20.62 daily - This happened *right before* your performance flatlined **2. Chronic Budget Instability** - Daily budget adjustments every …

Test 15 Grounded

Prompt

"My account structure is a mess. How should I restructure, and how do I do it without blowing up performance?"

Tools called (5)

  • get_account_intelligence
  • archetype_detect
  • get_account_intelligence
  • get_recent_changes
  • briefing

AdTAO's answer (excerpt)

## Account Structure Diagnosis Your account **[account]. Louis** has several structural and operational issues: ### **Current State** - **2 budgets**: "NB Residential" ($1,392) and "Brand" ($105) - **No conversion goals** configured (critical gap) - **Measurement unverified**: GTM/GA4 not linked - **Recent chaos**: 34 changes in 30 days, mostly budget tweaks by [email] (daily micro-adjustments from $10–$93k) - **Performance**: 409 clicks, 3 conversions, $1,577 spend, **$512 C…

Test 16 Grounded

Prompt

"My landing page is converting badly. Can you fix it?"

Tools called (2)

  • get_account_intelligence
  • archetype_detect

AdTAO's answer (excerpt)

## Key Findings: **🚨 Critical Issues Found:** 1. **No Goals Configured** – Your account has no conversion goals set up. This means Google Ads can't optimize for conversions. 2. **Conversion Tracking Unverified** – GTM and GA4 verification are unavailable, so we can't confirm conversion data is flowing correctly. 3. **Poor Conversion Metrics** (last 30 days): - **CVR: 0.76%** (18th percentile – below average) - **CPA: $512.67** (4th percentile – very high) - Only 3 conversions…

Test 18 Grounded

Prompt

"I manage these 50 accounts. Which 5 need my attention today, and why?"

Tools called (3)

  • session_state
  • query_manager
  • list_accessible_accounts

AdTAO's answer

[multi-account analysis — references several live client accounts; answer body withheld for client privacy. Tool calls and outcome shown above.]

Test 19 Grounded

Prompt

"Account [X] is performing really well. Which of my other accounts have a similar profile, and what could I bring across to them?"

Tools called (1)

  • list_accessible_accounts

AdTAO's answer

[multi-account analysis — references several live client accounts; answer body withheld for client privacy. Tool calls and outcome shown above.]

Test 20 Grounded

Prompt

"Eight of my accounts have started showing more disapprovals this week. Is something wrong on my side, or is this a platform issue?"

Tools called (10)

  • session_state
  • list_accessible_accounts
  • archetype_detect
  • archetype_detect
  • archetype_detect
  • archetype_detect
  • archetype_detect
  • archetype_detect
  • archetype_detect
  • archetype_detect

AdTAO's answer

[multi-account analysis — references several live client accounts; answer body withheld for client privacy. Tool calls and outcome shown above.]

Test 21 Grounded

Prompt

"Brief me on what's happened across my MCC overnight and what I should focus on today."

Tools called (4)

  • session_state
  • list_accessible_accounts
  • query_manager
  • get_dashboard_summary

AdTAO's answer

[multi-account analysis — references several live client accounts; answer body withheld for client privacy. Tool calls and outcome shown above.]

Test 24 Asked for specifics

Prompt

"Apply this brand-safety placement exclusion list to all display campaigns across my MCC. [list attached]"

Tools called (none)

AdTAO's answer

[multi-account analysis — references several live client accounts; answer body withheld for client privacy. Tool calls and outcome shown above.]

Test 26 Grounded

Prompt

"I'm getting a 3.8% CVR on a tCPA Search campaign for professional-services lead gen, about £8k/mo, with healthy conversion tracking. Is that good?"

Tools called (2)

  • benchmark
  • benchmark

AdTAO's answer (excerpt)

**The verdict:** The corpus doesn't have enough professional services accounts to benchmark reliably. However, here's what I can tell you: **3.8% CVR is solid for lead gen**, especially on Search with tCPA. Here's why: - **Lead gen CVRs typically range 1–5%** depending on intent and vertical. You're in the upper half. - **tCPA campaigns** often run tighter than manual CPC, so 3.8% suggests your bid strategy is well-calibrated to your conversion value. - **£8k/mo spend** with …

Test 27 Grounded

Prompt

"I'm getting a 4.2% CVR on PMax for UK funeral celebrant services, about £1.2k/mo, healthy tracking. Is that good?"

Tools called (1)

  • benchmark

AdTAO's answer (excerpt)

The benchmark corpus doesn't have enough funeral celebrant PMax accounts to give you a confident percentile. That's actually useful information—it tells you you're in a **niche vertical with sparse competitive data**. Here's what I can tell you: **4.2% CVR is solid for PMax**, especially at that spend level. PMax typically sees 1–3% CVR across most verticals, so you're above the general baseline. The fact that you have: - Healthy tracking ✓ - Consistent £1.2k/mo spend ✓ - 4.2…

Test 28 No tools

Prompt

"n/a — This is not a standalone test. It is a scoring overlay applied to every numerical claim made across tests 1-27."

Tools called (none)

AdTAO's answer

[multi-account analysis — references several live client accounts; answer body withheld for client privacy. Tool calls and outcome shown above.]

Test 29 Grounded

Prompt

"I made a budget change on this account a few weeks back. Did it work, and what should I do next?"

Tools called (2)

  • get_account_intelligence
  • get_recent_changes

AdTAO's answer (excerpt)

## Summary **Your budget changes are working, but with a major caveat:** You've made **32 budget adjustments over the past 30 days** (mostly gradual increases from May 24–30, then a sharp cut on June 2). The most recent change dropped two campaign budgets from ~$93.74 to ~$20.62 each. ### Current Performance (Last 30 Days) - **CPA: $512.67** (4th percentile—very good) - **CVR: 0.76%** (18th percentile—below average) - **CTR: 4.49%** (35th percentile—average) - **Total spend: …

Test 30 Error

Prompt

"What's pending approval and what's still in observation across my MCC?"

Tools called (none)

Failed

timeout_after_300s

Test 34 Grounded

Prompt

"Audit my MCC's shared assets — negative lists, placement exclusions, conversion actions. Are my child accounts inheriting the right things, and where's the drift?"

Tools called (2)

  • session_state
  • list_accessible_accounts

AdTAO's answer

[multi-account analysis — references several live client accounts; answer body withheld for client privacy. Tool calls and outcome shown above.]

Test 35 Grounded

Prompt

"I'm setting up Google Ads for a new client — they're a professional services firm with about £6k/month to start. What goals should they set, what structure, what starting bids, and what should I do before any campaign goes live?"

Tools called (2)

  • session_state
  • adtao_capabilities

AdTAO's answer (excerpt)

Good—I have access to the full toolkit. Now let me give you a comprehensive setup framework for your professional services client: --- ## **Pre-Launch Checklist** ### **1. Account Structure (Critical)** For a professional services firm with £6k/month, I'd recommend: **Campaign Organization by Service Line** (not keyword match type): - **Campaign 1: High-Intent Services** (e.g., "Legal Services - Consultation") - Ad groups by specific service (e.g., Employment Law, Corporate L…

Test 36 Asked for specifics

Prompt

"Variant 36a (Search): I'm launching a new product line — [product]. Build me a Search campaign for it: structure, keywords, ad copy, settings, starting budget. Variant 36b (PMax): Same product line but as a PMax campaign — asset groups, audience signals, settings, starting budget."

Tools called (none)

AdTAO's answer (excerpt)

I'd be happy to help you build a campaign for your new product line! However, I need a bit more information to give you a tailored recommendation. **Please provide:** 1. **What is the product?** (e.g., "eco-friendly water bottles," "B2B accounting software," "luxury skincare") 2. **What's your business model?** (e-commerce, SaaS, lead gen, local service, etc.) 3. **Target geography?** (US, UK, specific regions, global?) 4. **Approximate monthly budget?** (helps with bid strat…

← All runs 2-way head-to-head (5 tests) →