Skip to main content

Prediction performance by change type

Prediction performance

SN21 models predict what each Google Ads change will do before the outcome is known. When it settles, every prediction is scored — this shows how reliable they are, one row per kind of change.

How to read this page

What we measure
The change's effect on cost, conversions and the goal metric — CPA (cost per lead) for lead-generation accounts, ROAS (return on ad spend) for ecommerce.
At what level
The campaign the change belongs to — not the whole account. An ad, keyword or ad-group change is measured on its campaign's results against a 60-day baseline.
Over what window
The next 7, 14, or 28 days after the change — switch the window on the table below.
The rating Reliable lean on it Roughly right direction right, numbers less so Not reliable don't lean on it yet Too early not enough has settled yet
A rating is prediction accuracy — how close the models were — not a probability the change will succeed, and not advice to make it.

Changes settled & scored

22,880

served changes settled since 20 August 2026

Kinds of change

14

one line each, below

Models compared

207

every model predicts every change

Best model today

UID 18

leaderboard #1

Where the number comes from

75 days, 2026-08-20 to 2026-11-02
  1. 1. Captured398,783raw changes per day, before any rule
  2. 2. Measurable episodes71,990since 20 August 2026, after the published rules and 72-hour clustering
  3. 3. Served to models27,984of 34,461 eligible; 6,949 held out for validation, 231 on our own accounts
  4. 4. Settled & scored23,337this page — served changes old enough to have settled
  5. 5. Predictions scored6,046,149every model predicts every change

Each stage is deliberate. The page counts the fourth: a change reaches it about 15 days after it happened, once its first outcome window has closed and settled.

14 groups covering 93 change types. Open a row to see the types inside it.

Budget change — when a daily budget was raised or lowered 5,434 Reliable UID 42 6 types

Across 5,434 such changes (567,319 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

down 1,234 Reliable UID 240
down large 1,277 Reliable UID 42
flat 349 Roughly right UID 42
unknown 12 Reliable UID 126
up 1,048 Roughly right UID 240
up large 1,514 Reliable UID 42
Bid strategy switch — when the bid strategy was switched from one type to another 153 Reliable — 8 types

Across 153 such changes (15,975 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

maximize conversion value → maximize conversions 2 Too early —
maximize conversions → maximize conversion value 5 Too early UID 48
maximize conversions → target spend 14 Reliable —
target spend → maximize conversion value 1 Too early —
target spend → maximize conversions 6 Roughly right UID 5
switched to Maximize Conversion Value 39 Roughly right —
switched to Maximize Conversions 49 Reliable UID 204
unknown → target spend 37 Reliable —
Bid target change — when a bid-strategy target value changed (e.g. Target CPA $60 → $50) 824 Reliable UID 234 13 types

Across 824 such changes (94,656 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

ad-group bid change 14 Reliable UID 198
maximize conversion value · down 77 Roughly right UID 240
maximize conversion value · down large 4 Too early —
maximize conversion value · flat 114 Reliable UID 221
switched to Maximize Conversion Value 2 Too early —
maximize conversion value · up 146 Reliable UID 242
maximize conversion value · up large 22 Reliable UID 141
maximize conversions · down 115 Reliable UID 234
maximize conversions · down large 38 Roughly right —
maximize conversions · flat 24 Roughly right UID 74
switched to Maximize Conversions 13 Roughly right UID 196
maximize conversions · up 196 Reliable —
maximize conversions · up large 59 Roughly right UID 107
Negative keyword changes — when negative keywords were added 3,786 Reliable UID 31 16 types

Across 3,786 such changes (404,922 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

negative keyword add 327 Reliable —
broad · 1 80 Reliable UID 42
broad · 11+ 19 Roughly right UID 204
broad · 2-10 79 Reliable UID 194
exact · 1 594 Reliable UID 240
exact · 11+ 422 Reliable UID 94
exact · 2-10 935 Reliable UID 94
mixed · 11+ 205 Reliable UID 234
mixed · 2-10 303 Reliable UID 31
phrase · 1 231 Reliable —
phrase · 11+ 118 Reliable UID 55
phrase · 2-10 325 Reliable —
unknown · 1 8 Reliable UID 53
unknown · 11+ 9 Reliable UID 165
unknown · 2-10 9 Reliable UID 171
negative keyword remove 122 Reliable —
Keyword changes — when this changed 1,089 Reliable UID 224 2 types

Across 1,089 such changes (114,949 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

keyword add 636 Reliable UID 126
keyword remove 453 Reliable —
Other criterion changes (kind not recorded) — when this changed 2,375 Reliable — 6 types

Across 2,375 such changes (245,976 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

bid on a keyword / audience / placement 563 Reliable UID 42
targeting criteria change 931 Reliable —
criterion enable 100 Reliable UID 170
criterion pause 737 Reliable UID 240
criterion remove 37 Reliable UID 173
criterion url change 7 Reliable —
Location, audience and demographic targeting — when this changed 185 Reliable — 3 types

Across 185 such changes (19,179 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

audience change 110 Reliable UID 176
demographic change 33 Reliable —
geo change 42 Reliable UID 165
Device, schedule and placement targeting — when this changed 312 Reliable UID 242 2 types

Across 312 such changes (32,611 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Roughly right Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

device targeting change 2 Too early —
schedule change 310 Reliable UID 242
Campaign pause / enable — when this changed 1,178 Reliable UID 234 1 type

Across 1,178 such changes (133,225 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Roughly right Range — how often the real result fell inside the predicted range
  • Roughly right Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Ad group pause / enable — when this changed 172 Reliable UID 42 2 types

Across 172 such changes (18,391 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

adgroup enable 25 Roughly right UID 14
adgroup pause 147 Reliable UID 42
Other ad group changes — when this changed 226 Reliable — 3 types

Across 226 such changes (23,130 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

adgroup bid change 122 Reliable UID 42
adgroup change 102 Reliable —
adgroup remove 2 Too early —
Ad changes — when this changed 314 Reliable — 5 types

Across 314 such changes (32,957 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

ad create 67 Reliable UID 31
ad edit 135 Reliable UID 234
ad enable 9 Reliable —
ad pause 95 Reliable UID 55
ad remove 8 Reliable UID 189
Asset changes — when this changed 1,039 Reliable — 1 type

Across 1,039 such changes (103,994 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Combined changes — when several kinds of change happened together 5,793 Reliable UID 42 25 types

Across 5,793 such changes (606,433 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

adgroup bid change 40 Roughly right —
adgroup change 10 Roughly right UID 241
adgroup enable 19 Reliable —
adgroup pause 408 Reliable UID 18
ad-group bid change 1 Too early —
ad create 692 Reliable UID 222
ad edit 71 Reliable UID 234
ad enable 25 Roughly right UID 13
ad pause 14 Reliable UID 115
asset change 57 Reliable UID 242
audience change 22 Reliable UID 222
bid strategy change 45 Reliable UID 26
budget change 1,603 Reliable UID 234
campaign pause 191 Reliable —
bid on a keyword / audience / placement 47 Reliable —
targeting criteria change 150 Reliable UID 143
criterion enable 48 Reliable UID 55
criterion pause 17 Reliable UID 162
criterion remove 11 Reliable UID 221
demographic change 1 Too early —
keyword add 1,291 Reliable —
keyword remove 154 Reliable UID 30
negative keyword add 630 Reliable —
negative keyword remove 1 Too early —
target value change 245 Reliable UID 18

14 groups covering 93 change types. Open a row to see the types inside it.

Budget change — when a daily budget was raised or lowered 5,007 Roughly right UID 18 6 types

Across 5,007 such changes (526,484 model predictions), a prediction here is roughly right. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

down 1,134 Roughly right UID 194
down large 1,200 Reliable UID 26
flat 315 Roughly right —
unknown 11 Reliable UID 18
up 944 Roughly right UID 18
up large 1,403 Roughly right UID 18
Bid strategy switch — when the bid strategy was switched from one type to another 138 Reliable UID 107 8 types

Across 138 such changes (14,593 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

maximize conversion value → maximize conversions 1 Too early —
maximize conversions → maximize conversion value 4 Too early —
maximize conversions → target spend 15 Reliable UID 75
target spend → maximize conversion value 1 Too early —
target spend → maximize conversions 6 Roughly right UID 5
switched to Maximize Conversion Value 35 Roughly right UID 107
switched to Maximize Conversions 40 Reliable UID 55
unknown → target spend 36 Reliable UID 145
Bid target change — when a bid-strategy target value changed (e.g. Target CPA $60 → $50) 551 Roughly right UID 235 13 types

Across 551 such changes (57,730 model predictions), a prediction here is roughly right. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

ad-group bid change 14 Roughly right UID 138
maximize conversion value · down 60 Roughly right —
maximize conversion value · down large 4 Too early —
maximize conversion value · flat 14 Roughly right UID 13
switched to Maximize Conversion Value 2 Too early —
maximize conversion value · up 66 Roughly right UID 226
maximize conversion value · up large 22 Roughly right UID 58
maximize conversions · down 99 Roughly right UID 51
maximize conversions · down large 37 Roughly right UID 38
maximize conversions · flat 19 Reliable —
switched to Maximize Conversions 13 Roughly right UID 196
maximize conversions · up 155 Reliable —
maximize conversions · up large 46 Roughly right UID 176
Negative keyword changes — when negative keywords were added 3,246 Reliable UID 170 16 types

Across 3,246 such changes (344,656 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

negative keyword add 330 Roughly right UID 245
broad · 1 70 Roughly right UID 224
broad · 11+ 19 Roughly right UID 55
broad · 2-10 75 Roughly right UID 74
exact · 1 511 Roughly right UID 237
exact · 11+ 370 Reliable UID 216
exact · 2-10 817 Reliable UID 169
mixed · 11+ 180 Roughly right UID 29
mixed · 2-10 243 Reliable UID 253
phrase · 1 174 Reliable UID 74
phrase · 11+ 85 Reliable UID 253
phrase · 2-10 259 Reliable UID 237
unknown · 1 8 Reliable UID 66
unknown · 11+ 9 Reliable UID 165
unknown · 2-10 8 Reliable UID 56
negative keyword remove 88 Roughly right —
Keyword changes — when this changed 988 Reliable — 2 types

Across 988 such changes (104,920 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

keyword add 574 Reliable —
keyword remove 414 Reliable —
Other criterion changes (kind not recorded) — when this changed 2,172 Reliable UID 237 6 types

Across 2,172 such changes (231,272 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

bid on a keyword / audience / placement 520 Reliable UID 154
targeting criteria change 840 Reliable UID 141
criterion enable 94 Roughly right —
criterion pause 685 Reliable UID 237
criterion remove 28 Reliable UID 221
criterion url change 5 Too early —
Location, audience and demographic targeting — when this changed 180 Reliable — 3 types

Across 180 such changes (19,040 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

audience change 105 Reliable UID 221
demographic change 32 Reliable UID 165
geo change 43 Reliable —
Device, schedule and placement targeting — when this changed 278 Reliable UID 242 2 types

Across 278 such changes (30,007 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Roughly right Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

device targeting change 2 Too early —
schedule change 276 Reliable UID 242
Campaign pause / enable — when this changed 1,015 Reliable UID 51 1 type

Across 1,015 such changes (107,564 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Ad group pause / enable — when this changed 142 Roughly right — 2 types

Across 142 such changes (15,107 model predictions), a prediction here is roughly right. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

adgroup enable 24 Roughly right UID 204
adgroup pause 118 Roughly right UID 51
Other ad group changes — when this changed 195 Reliable — 3 types

Across 195 such changes (20,537 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

adgroup bid change 103 Roughly right UID 253
adgroup change 90 Reliable —
adgroup remove 2 Too early —
Ad changes — when this changed 282 Reliable UID 55 5 types

Across 282 such changes (30,169 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

ad create 58 Roughly right UID 130
ad edit 119 Reliable UID 90
ad enable 9 Roughly right UID 90
ad pause 87 Reliable UID 55
ad remove 9 Roughly right UID 117
Asset changes — when this changed 820 Reliable UID 237 1 type

Across 820 such changes (86,119 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Combined changes — when several kinds of change happened together 5,266 Reliable UID 224 25 types

Across 5,266 such changes (555,071 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 (UID 18) on this change type: Reliable.

Broken down by kind:

adgroup bid change 32 Reliable UID 55
adgroup change 9 Reliable UID 199
adgroup enable 17 Roughly right —
adgroup pause 395 Reliable —
ad-group bid change 1 Too early —
ad create 634 Roughly right UID 95
ad edit 60 Roughly right UID 194
ad enable 24 Roughly right UID 165
ad pause 10 Roughly right UID 90
asset change 49 Reliable UID 253
audience change 18 Reliable UID 222
bid strategy change 39 Reliable —
budget change 1,446 Reliable UID 70
campaign pause 200 Reliable —
bid on a keyword / audience / placement 45 Reliable UID 194
targeting criteria change 133 Reliable UID 216
criterion enable 46 Reliable UID 224
criterion pause 17 Roughly right UID 58
criterion remove 9 Reliable UID 107
demographic change 1 Too early —
keyword add 1,188 Reliable —
keyword remove 156 Reliable —
negative keyword add 531 Reliable —
negative keyword remove 1 Too early —
target value change 205 Roughly right UID 74

14 groups covering 90 change types. Open a row to see the types inside it.

Budget change — when a daily budget was raised or lowered 4,000 Roughly right UID 126 6 types

Across 4,000 such changes (414,733 model predictions), a prediction here is roughly right. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

down 898 Roughly right UID 126
down large 1,007 Roughly right UID 126
flat 224 Roughly right —
unknown 5 Reliable —
up 740 Roughly right UID 91
up large 1,126 Roughly right UID 126
Bid strategy switch — when the bid strategy was switched from one type to another 93 Reliable UID 72 7 types

Across 93 such changes (9,567 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

maximize conversion value → maximize conversions 1 Too early —
maximize conversions → maximize conversion value 3 Too early —
maximize conversions → target spend 10 Reliable UID 92
target spend → maximize conversions 6 Roughly right —
switched to Maximize Conversion Value 22 Roughly right UID 107
switched to Maximize Conversions 28 Reliable UID 55
unknown → target spend 23 Reliable UID 204
Bid target change — when a bid-strategy target value changed (e.g. Target CPA $60 → $50) 421 Roughly right — 13 types

Across 421 such changes (43,505 model predictions), a prediction here is roughly right. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

ad-group bid change 14 Roughly right UID 254
maximize conversion value · down 46 Roughly right —
maximize conversion value · down large 4 Too early —
maximize conversion value · flat 10 Roughly right UID 196
switched to Maximize Conversion Value 2 Too early —
maximize conversion value · up 46 Roughly right UID 91
maximize conversion value · up large 14 Roughly right UID 204
maximize conversions · down 73 Roughly right UID 113
maximize conversions · down large 27 Roughly right UID 222
maximize conversions · flat 14 Roughly right UID 203
switched to Maximize Conversions 13 Roughly right UID 196
maximize conversions · up 128 Reliable —
maximize conversions · up large 30 Roughly right —
Negative keyword changes — when negative keywords were added 2,235 Roughly right UID 107 16 types

Across 2,235 such changes (230,871 model predictions), a prediction here is roughly right. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

negative keyword add 332 Roughly right UID 218
broad · 1 33 Roughly right —
broad · 11+ 10 Roughly right —
broad · 2-10 36 Roughly right —
exact · 1 353 Roughly right —
exact · 11+ 222 Roughly right UID 107
exact · 2-10 557 Roughly right UID 141
mixed · 11+ 116 Roughly right —
mixed · 2-10 150 Roughly right UID 222
phrase · 1 109 Roughly right UID 87
phrase · 11+ 68 Roughly right UID 87
phrase · 2-10 167 Roughly right UID 107
unknown · 1 7 Reliable —
unknown · 11+ 4 Too early —
unknown · 2-10 6 Roughly right UID 244
negative keyword remove 65 Roughly right —
Keyword changes — when this changed 600 Roughly right — 2 types

Across 600 such changes (62,007 model predictions), a prediction here is roughly right. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

keyword add 407 Roughly right —
keyword remove 193 Reliable —
Other criterion changes (kind not recorded) — when this changed 1,297 Reliable UID 126 6 types

Across 1,297 such changes (134,153 model predictions), a prediction here is reliable. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

bid on a keyword / audience / placement 332 Reliable UID 113
targeting criteria change 538 Reliable UID 107
criterion enable 67 Reliable UID 107
criterion pause 334 Roughly right UID 107
criterion remove 21 Reliable UID 162
criterion url change 5 Too early UID 186
Location, audience and demographic targeting — when this changed 113 Roughly right UID 222 3 types

Across 113 such changes (11,698 model predictions), a prediction here is roughly right. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

audience change 57 Roughly right UID 107
demographic change 24 Reliable UID 115
geo change 32 Roughly right UID 95
Device, schedule and placement targeting — when this changed 110 Reliable — 1 type

Across 110 such changes (11,315 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Roughly right Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Campaign pause / enable — when this changed 876 Roughly right — 1 type

Across 876 such changes (91,797 model predictions), a prediction here is roughly right. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Ad group pause / enable — when this changed 85 Roughly right UID 52 2 types

Across 85 such changes (8,741 model predictions), a prediction here is roughly right. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

adgroup enable 15 Roughly right —
adgroup pause 70 Reliable —
Other ad group changes — when this changed 130 Reliable — 3 types

Across 130 such changes (13,346 model predictions), a prediction here is reliable. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

adgroup bid change 65 Roughly right UID 52
adgroup change 64 Reliable —
adgroup remove 1 Too early —
Ad changes — when this changed 172 Reliable UID 55 5 types

Across 172 such changes (17,723 model predictions), a prediction here is reliable. What that's made of:

  • Reliable Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

ad create 36 Roughly right UID 218
ad edit 56 Roughly right UID 90
ad enable 5 Roughly right UID 124
ad pause 66 Reliable UID 55
ad remove 9 Roughly right —
Asset changes — when this changed 437 Roughly right — 1 type

Across 437 such changes (44,852 model predictions), a prediction here is roughly right. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Combined changes — when several kinds of change happened together 3,833 Roughly right UID 113 24 types

Across 3,833 such changes (394,855 model predictions), a prediction here is roughly right. What that's made of:

  • Roughly right Direction — called the change up or down correctly on the goal metric
  • Reliable Size — how close the predicted size of the effect was
  • Not reliable Range — how often the real result fell inside the predicted range
  • Not reliable Goal — how close on the goal number itself (CPA or ROAS)

Today's leaderboard #1 has no scored prediction on this change type yet.

Broken down by kind:

adgroup bid change 18 Roughly right UID 13
adgroup change 4 Too early —
adgroup enable 12 Roughly right —
adgroup pause 295 Roughly right UID 107
ad-group bid change 1 Too early —
ad create 460 Roughly right UID 246
ad edit 38 Roughly right UID 58
ad enable 19 Not reliable UID 245
ad pause 9 Roughly right UID 72
asset change 34 Roughly right UID 113
audience change 16 Roughly right UID 14
bid strategy change 32 Reliable —
budget change 1,047 Roughly right UID 126
campaign pause 180 Roughly right UID 52
bid on a keyword / audience / placement 27 Roughly right UID 53
targeting criteria change 91 Reliable UID 107
criterion enable 32 Reliable UID 55
criterion pause 15 Roughly right UID 205
criterion remove 3 Too early —
keyword add 873 Reliable —
keyword remove 112 Reliable —
negative keyword add 368 Roughly right —
negative keyword remove 1 Too early —
target value change 146 Roughly right UID 52

A row reads Too early until at least 500 of its changes have settled. Open any row for the score breakdown and the best model.

Counted: changes to things that already exist, once their outcome has settled.

Not counted: brand-new campaigns & ads (no "before" to score), and recent changes still settling.

The winning model over time

The same winning model, week by week — is the best model on the subnet getting better? Every point is the mean of per-entry scores already published in the daily receipts, so anyone can recompute it.

Winning model accuracy by week, per prediction horizon One line per horizon. Vertical axis is mean score from 0 to 1; the full range is always shown. The same numbers appear in the table below. 0.00 0.25 0.50 0.75 1.00 W34 ’26W36W38W40W42W44W45 7-day · 2026-W34 · mean 0.606 · n=1086 7-day · 2026-W35 · mean 0.605 · n=390 7-day · 2026-W36 · mean 0.591 · n=861 7-day · 2026-W37 · mean 0.600 · n=2502 7-day · 2026-W38 · mean 0.601 · n=2505 7-day · 2026-W39 · mean 0.602 · n=2467 7-day · 2026-W40 · mean 0.605 · n=2181 7-day · 2026-W41 · mean 0.635 · n=2820 7-day · 2026-W42 · mean 0.617 · n=3063 7-day · 2026-W43 · mean 0.618 · n=2825 7-day · 2026-W44 · mean 0.633 · n=3080 7-day · 2026-W45 · mean 0.623 · n=477 · week still open 7-day 14-day · 2026-W35 · mean 0.592 · n=1174 14-day · 2026-W36 · mean 0.594 · n=863 14-day · 2026-W37 · mean 0.567 · n=884 14-day · 2026-W38 · mean 0.577 · n=2541 14-day · 2026-W39 · mean 0.581 · n=2536 14-day · 2026-W40 · mean 0.582 · n=2511 14-day · 2026-W41 · mean 0.590 · n=2236 14-day · 2026-W42 · mean 0.602 · n=2849 14-day · 2026-W43 · mean 0.593 · n=3130 14-day · 2026-W44 · mean 0.600 · n=2867 14-day · 2026-W45 · mean 0.597 · n=623 · week still open 14-day 28-day · 2026-W36 · mean 0.518 · n=489 28-day · 2026-W37 · mean 0.580 · n=1581 28-day · 2026-W38 · mean 0.585 · n=874 28-day · 2026-W39 · mean 0.555 · n=892 28-day · 2026-W40 · mean 0.563 · n=2555 28-day · 2026-W41 · mean 0.575 · n=2571 28-day · 2026-W42 · mean 0.579 · n=2526 28-day · 2026-W43 · mean 0.575 · n=2248 28-day · 2026-W44 · mean 0.580 · n=2868 28-day · 2026-W45 · mean 0.591 · n=638 · week still open 28-day
  • 7-day horizon
  • 14-day horizon
  • 28-day horizon
  • week still open
Each point is the mean score of the leading model's predictions that settled in that week, at that horizon. Every score is published per entry in the day's signed receipt, so any point here can be recomputed from the same documents used to verify a day — this chart reports those numbers, it does not compute a separate one. The leading model is shown without identity. A horizon with no settled entries in a week has no point rather than a zero: the 28-day line cannot begin before 8 September 2026.
Winning model mean score by week and horizon
Week Week ending Horizon Mean score Entries Status
2026-W34 2026-08-23 7-day 0.606 1086 settled
2026-W35 2026-08-30 7-day 0.605 390 settled
2026-W35 2026-08-30 14-day 0.592 1174 settled
2026-W36 2026-09-06 7-day 0.591 861 settled
2026-W36 2026-09-06 14-day 0.594 863 settled
2026-W36 2026-09-06 28-day 0.518 489 settled
2026-W37 2026-09-13 7-day 0.600 2502 settled
2026-W37 2026-09-13 14-day 0.567 884 settled
2026-W37 2026-09-13 28-day 0.580 1581 settled
2026-W38 2026-09-20 7-day 0.601 2505 settled
2026-W38 2026-09-20 14-day 0.577 2541 settled
2026-W38 2026-09-20 28-day 0.585 874 settled
2026-W39 2026-09-27 7-day 0.602 2467 settled
2026-W39 2026-09-27 14-day 0.581 2536 settled
2026-W39 2026-09-27 28-day 0.555 892 settled
2026-W40 2026-10-04 7-day 0.605 2181 settled
2026-W40 2026-10-04 14-day 0.582 2511 settled
2026-W40 2026-10-04 28-day 0.563 2555 settled
2026-W41 2026-10-11 7-day 0.635 2820 settled
2026-W41 2026-10-11 14-day 0.590 2236 settled
2026-W41 2026-10-11 28-day 0.575 2571 settled
2026-W42 2026-10-18 7-day 0.617 3063 settled
2026-W42 2026-10-18 14-day 0.602 2849 settled
2026-W42 2026-10-18 28-day 0.579 2526 settled
2026-W43 2026-10-25 7-day 0.618 2825 settled
2026-W43 2026-10-25 14-day 0.593 3130 settled
2026-W43 2026-10-25 28-day 0.575 2248 settled
2026-W44 2026-11-01 7-day 0.633 3080 settled
2026-W44 2026-11-01 14-day 0.600 2867 settled
2026-W44 2026-11-01 28-day 0.580 2868 settled
2026-W45 2026-11-08 7-day 0.623 477 week still open
2026-W45 2026-11-08 14-day 0.597 623 week still open
2026-W45 2026-11-08 28-day 0.591 638 week still open

Where these numbers come from

Every score on this page is the settle-flow score in the daily receipts, published per prediction at /v1/daily — the same numbers that feed the leaderboard. This page and the leaderboard can never disagree, because there is nothing here to disagree with: it is the same data, added up by change type.