Avanciq scoreboard · Round 5 + 6-lite top-up · 16 November 2026

Which AI can you trust with real business work?

Top AI models pass public tests with high scores. We gave them fresh payroll, month-end close, claims and reconciliation work, with the answers hidden and marked to the cent.

What you get

Deliverables
Public results per model and task family, ranges on every score, used tasks shown in full, a signed results file.
Timing
Updated when we run a new round. Free to read.
What we need
Nothing. To have your model tested, use the form below.
Example
This page and the signed results file further down.

Round 5 + 6-liteTasks run 16 November 2026Rules fingerprints (MD5) fdfbbfb2 and 2223c8111194 scored attempts

The headline

Claude Sonnet 5.5 scores 80.1% to 94.68% on six public benchmarks. On our fresh business tasks, with no tools, it got 52 of 120 tasks fully right (43.3%). Claude Opus 5.5 got 49 of 60 (81.7%), and Claude Haiku 5.5 got 33 of 120 (27.5%).

Share of tasks fully right
  • Claude Sonnet 5.5 on public benchmarks (lowest of six we found)80.1%
  • Claude Opus 5.5 on our business tasks, no tools81.7%
  • Claude Sonnet 5.5 on our business tasks, no tools43.3%
  • Claude Haiku 5.5 on our business tasks, no tools27.5%

Sonnet got 88.7% of all answer fields right, but a payroll run with one wrong payslip is still a wrong payroll run. Haiku's score is held down by answering at all: 54 of its 120 replies were cut off.

A tool changes the picture. With a locked-down Python sandbox, Haiku got 97 of 120 (80.8%). For this kind of work, the setup around the model matters as much as the model.

Public scores: SWE-bench Pro 81.3%, ExtractBench 94.68%, AA Harvey LAB criterion-pass 93.1%, OSWorld 2.1 80.1%, Terminal-Bench 2.1 83.1%, Toolathlon Verified Pass@3 85.2% (BenchLM model page, opened 15 November 2026). Those benchmarks test other skills, so this is a contrast, not a like-for-like ranking.

Summary, with the cut-off column

"Cut off / no answer" means the reply ran past a length or time limit, the call failed, or the final reply had no answer we could read. It counts as wrong, as the rules said before the run.

Board A, model alone: summary
SystemTasks scoredFully rightAnswer fields rightCut off / no answer
Claude Opus 5.56049 (81.7%)95% range 70.1 to 89.4%95.9%0 (0%)
Claude Sonnet 5.512052 (43.3%)95% range 34.8 to 52.3%88.7%0 (0%)
Claude Haiku 5.512033 (27.5%)95% range 20.3 to 36.1%45.4%54 (45%)
gpt-oss-120b (medium reasoning, 65k answer space)1201 (0.8%)95% range 0.1 to 4.6%28.7%23 (19.2%)
Qwen3.8-27B (default reasoning, 16k answer space)240 (0%)95% range 0 to 13.8%23%0 (0%)
Board B, model with Python: summary
SystemTasks scoredFully rightAnswer fields rightCut off / no answer
Claude Haiku 5.5 + Python12097 (80.8%)95% range 72.9 to 86.9%83.8%15 (12.5%)
Claude Sonnet 5.5 + Python3629 (80.6%)95% range 65 to 90.2%80.6%3 (8.3%)

Board A: the model alone (no tools)

Each cell shows tasks fully right, the share, and the 95% range. With about 10 tasks per family the ranges are wide, so read families as direction, not decimals. Opus ran 5 to 5 tasks per family.

Board A: tasks fully right without tools
Task familyClaude Opus 5.5Claude Sonnet 5.5Claude Haiku 5.5gpt-oss-120b (medium reasoning, 65k answer space)
All 12 families49 of 60 81.7%95% range 70.1 to 89.4%52 of 120 43.3%95% range 34.8 to 52.3%33 of 120 27.5%95% range 20.3 to 36.1%1 of 120 0.8%95% range 0.1 to 4.6%
Payroll4 of 5 80%95% range 37.6 to 96.4%5 of 10 50%95% range 23.7 to 76.3%0 of 10 0%95% range 0 to 27.8%0 of 10 0%95% range 0 to 27.8%
Month-end close3 of 5 60%95% range 23.1 to 88.2%1 of 10 10%95% range 1.8 to 40.4%0 of 10 0%95% range 0 to 27.8%0 of 10 0%95% range 0 to 27.8%
Bank reconciliation5 of 5 100%95% range 56.6 to 100%5 of 10 50%95% range 23.7 to 76.3%0 of 10 0%95% range 0 to 27.8%0 of 10 0%95% range 0 to 27.8%
3-way match4 of 5 80%95% range 37.6 to 96.4%3 of 10 30%95% range 10.8 to 60.3%0 of 10 0%95% range 0 to 27.8%0 of 10 0%95% range 0 to 27.8%
Claims settlement5 of 5 100%95% range 56.6 to 100%2 of 10 20%95% range 5.7 to 51%0 of 10 0%95% range 0 to 27.8%0 of 10 0%95% range 0 to 27.8%
Inventory planning5 of 5 100%95% range 56.6 to 100%4 of 10 40%95% range 16.8 to 68.7%2 of 10 20%95% range 5.7 to 51%0 of 10 0%95% range 0 to 27.8%
Leave balances5 of 5 100%95% range 56.6 to 100%8 of 10 80%95% range 49 to 94.3%10 of 10 100%95% range 72.2 to 100%0 of 10 0%95% range 0 to 27.8%
Staff rosters0 of 5 0%95% range 0 to 43.4%0 of 10 0%95% range 0 to 27.8%0 of 10 0%95% range 0 to 27.8%0 of 10 0%95% range 0 to 27.8%
Delivery routes4 of 5 80%95% range 37.6 to 96.4%5 of 10 50%95% range 23.7 to 76.3%6 of 10 60%95% range 31.3 to 83.2%1 of 10 10%95% range 1.8 to 40.4%
Long documents5 of 5 100%95% range 56.6 to 100%5 of 10 50%95% range 23.7 to 76.3%3 of 10 30%95% range 10.8 to 60.3%0 of 10 0%95% range 0 to 27.8%
Contract schedules4 of 5 80%95% range 37.6 to 96.4%5 of 10 50%95% range 23.7 to 76.3%5 of 10 50%95% range 23.7 to 76.3%0 of 10 0%95% range 0 to 27.8%
Support agent5 of 5 100%95% range 56.6 to 100%9 of 10 90%95% range 59.6 to 98.2%7 of 10 70%95% range 39.7 to 89.2%0 of 10 0%95% range 0 to 27.8%

Round 6-lite filled the cells that ran out of budget in round 5 (same tasks, same rules): 0 Sonnet tasks, 0 Opus tasks and the open-model rows. Finished round-5 cells were not re-run.

Board B: the model with a Python sandbox

A different setup, so a separate table. The sandbox has no internet and allows up to 5 code runs per task.

Board B: tasks fully right with a Python sandbox
Task familyClaude Haiku 5.5 + PythonClaude Sonnet 5.5 + Python
All 12 families97 of 120 80.8%95% range 72.9 to 86.9%29 of 36 80.6%95% range 65 to 90.2%
Payroll10 of 10 100%95% range 72.2 to 100%2 of 3 66.7%95% range 20.8 to 93.9%
Month-end close9 of 10 90%95% range 59.6 to 98.2%3 of 3 100%95% range 43.8 to 100%
Bank reconciliation6 of 10 60%95% range 31.3 to 83.2%3 of 3 100%95% range 43.8 to 100%
3-way match9 of 10 90%95% range 59.6 to 98.2%3 of 3 100%95% range 43.8 to 100%
Claims settlement0 of 10 0%95% range 0 to 27.8%3 of 3 100%95% range 43.8 to 100%
Inventory planning9 of 10 90%95% range 59.6 to 98.2%3 of 3 100%95% range 43.8 to 100%
Leave balances8 of 10 80%95% range 49 to 94.3%2 of 3 66.7%95% range 20.8 to 93.9%
Staff rosters9 of 10 90%95% range 59.6 to 98.2%3 of 3 100%95% range 43.8 to 100%
Delivery routes10 of 10 100%95% range 72.2 to 100%2 of 3 66.7%95% range 20.8 to 93.9%
Long documents10 of 10 100%95% range 72.2 to 100%0 of 3 0%95% range 0 to 56.2%
Contract schedules9 of 10 90%95% range 59.6 to 98.2%2 of 3 66.7%95% range 20.8 to 93.9%
Support agent8 of 10 80%95% range 49 to 94.3%3 of 3 100%95% range 43.8 to 100%

Sonnet with Python ran 3 tasks per family (36 in total), so its family cells are very rough.

Same model, same tasks, twice

We ran Claude Haiku 5.5 on the same 120 tasks a second time. First run: 33 of 120 (27.5%, 95% range 20.3 to 36.1%). Second run: 38 of 120 (31.7%). The same task got the same result (right or wrong) 84.2% of the time.

Our bars, set before round 5: the second score must sit inside the first run's range, and at least 80% of tasks must agree. Both bars were met.

Other rows

Four used tasks, in full

These tasks were already scored in round 5, so showing them does not spoil any future round. Open one to read the full task, the correct answer, the model's reply and which fields were wrong. The held-back sealed batch is never shown.

Payroll · Claude Sonnet 5.5 One employee short-paid

86.7% of the answer fields were right, but 2 were not, so the task counts as wrong. Claude Opus 5.5 solved the same task exactly, so it can be done from the text.

Wrong fields
FieldCorrectModel gave
gross/E198781.54778.84
total15560.3715557.67

The task, exactly as the model saw it

You are the payroll officer for Delta Design (a fictional company). Work out each employee's GROSS pay for one week (no tax, no super) by the rules below. All rules are invented for this exercise.

PAY WEEK: Mon 2027-11-29, Tue 2027-11-30, Wed 2027-12-01, Thu 2027-12-02, Fri 2027-12-03, Sat 2027-12-04, Sun 2027-12-05.
PUBLIC HOLIDAY: Wed 2027-12-01 (the whole calendar day 00:00-24:00).

TIMESHEET RULES: Each timesheet row is one shift. A shift belongs to the date it STARTS on. Shifts that START outside the pay week are ignored entirely, even if they end inside it; a shift that starts inside the pay week is paid in full even if it ends after it. All times are on the quarter hour. If a shift's end time is not later than its start time, the shift ends on the next day. Times may be written 07:30, 0730, 7:30am or 7.30pm (12:00am = midnight, 12:00pm = noon). Dates may be written YYYY-MM-DD, DD/MM/YYYY or '4 Mar' (the year is the one that puts the date inside the pay week). Rows with status VOID are cancelled entries: ignore them completely. Ignore rows whose employee ID is not in the staff table.

AWARD (Energy Services Award (fictional) clause book 7.0):
A1 Base rate. Hourly base rate by classification level: Level 1 $25.25, Level 2 $26.45, Level 3 $27.47, Level 4 $29.01, Level 5 $31.17. Employees under 21 are paid a percentage of the base rate for their level: age 16-17 = 60%, 18 = 70%, 19 = 80%, 20 = 90%; this junior rate is rounded to cents (half up) before any other calculation. Call the resulting hourly rate B.
A2 Unpaid break. A shift whose length (start to end) is more than 5 hours has a 30-minute unpaid break; a shift longer than 10 hours has a 60-minute unpaid break instead. The break always starts exactly 4 hours after the shift start. Break minutes are not worked and not paid. Worked time = shift length minus the break.
A3 Daily overtime. In each shift, worked time after the first 9 worked hours of that shift is overtime (this applies to every employee type, casuals included).
A4 Weekly overtime (full-time and part-time only; never casuals). Weekly limit of ordinary hours: 38 hours for full-time; the contracted hours shown in the staff table for part-time. Go through the employee's shifts in time order, minute by minute: once the ordinary worked time in the week has reached the limit, every further worked minute is overtime. Minutes that are daily overtime under A3 are NOT ordinary, are never counted towards the limit and are never paid twice. Weekend and public-holiday minutes that are not overtime are ordinary and do count towards the limit.
A5 Overtime rate. In each shift, the first 2 hours of overtime (daily and weekly overtime counted together, in time order) are paid at 1.5x, any further overtime in that same shift at 2.0x. Count every overtime minute towards these hours even when a higher day penalty wins under A7.
A6 Day penalties. Worked minutes on a Saturday 1.5x, on a Sunday 2x, on the public holiday 2.25x. The calendar date of each minute decides (a shift crossing midnight changes day at 00:00). Other days 1.0x.
A7 Precedence. For every worked minute only the HIGHEST single multiplier among 1.0x, its overtime rate (A5) and its day penalty (A6) applies. Multipliers never add up and never multiply together.
A8 Night loading (this one STACKS). Every worked minute between 22:00 and 06:00 earns an extra 15% of B per hour ON TOP of whatever the A7 multiplier gives - EXCEPT minutes on the public holiday, which get no night loading.
A9 Casual loading. Casuals (type CAS) get a 25% loading applied AFTER penalties: the loading is never multiplied, so each worked hour pays B x multiplier + 0.25 x B. Night loading is always a percentage of B, never of the casual rate.
A10 Minimum engagement. If a casual's worked time in a shift is less than 3 hours, the missing time up to 3 hours is ALSO paid, at B x 1.25 per hour (no penalty, overtime or night loading). This extra time is not worked time for any other clause.
A11 Allowances (flat amounts, never multiplied or loaded). Meal allowance $15.10 for each shift that has MORE than 1 hour of overtime (any kind) in it. Vehicle allowance $0.98 per km in the km column, capped at $108.00 per employee per week. Laundry allowance $1.68 per paid shift, capped at $9.00 per employee per week.

ENTERPRISE AGREEMENT (Delta Design Enterprise Agreement, fictional). It covers ONLY employees with EA = Y in the staff table. For them it replaces ONLY the following award clauses, even where the result is less favourable: A1 base rates (EA rates: Level 1 $27.07, Level 2 $28.28, Level 3 $28.51, Level 4 $30.46, Level 5 $32.39; junior percentages still apply, to the EA rate); A3 daily overtime starts after the first 8 worked hours of a shift; A6 Sunday penalty 1.75x (Saturday and public holiday penalties stay as in the award); A2 break: a shift longer than 6 hours has one 45-minute unpaid break starting exactly 4 hours after the shift start, and no other break. Every other award clause still applies to EA employees unchanged.

CALCULATION: gross = sum over all worked minutes of (hourly pay for that minute / 60), plus any minimum-engagement pay, plus allowances. Do NOT round per shift or per line: round each employee's weekly gross ONCE to cents (half up). total = sum of the rounded employee gross amounts.

STAFF (14; FT = full-time, PT = part-time, CAS = casual):
emp_id,name,type,level,age,EA,contracted_hours
E8344,Gus Tanaka,FT,2,18,Y,
E198,Raj Ferreira,PT,1,19,Y,20
E4463,Uma Chen,PT,2,35,N,25
E5410,Hugo Ito,PT,5,19,Y,24
E8866,Zoe Nair,PT,5,20,N,24
E8999,Noah Usman,PT,4,33,N,22.5
E8308,Hana Okafor,CAS,1,54,N,
E6194,Chloe Xu,CAS,4,45,N,
E2342,Grace Varga,PT,4,58,N,16
E4628,Isla Torres,CAS,2,25,Y,
E5151,Vik Zhou,FT,3,28,Y,
E3321,Hana Dubois,PT,2,26,Y,24
E3247,Dina Walsh,CAS,3,35,N,
E7639,Kai Ekström,CAS,2,21,N,

TIMESHEET (61 rows):
row,emp_id,date,start,end,km,status
T001,E3247,01/12/2027,1015,17:45,,OK
T002,E8866,30/11/2027,10.30pm,3:15am,,OK
T003,E3321,2027-12-03,0800,1:30pm,,OK
T004,E7639,03/12/2027,9.15am,1630,,VOID
T005,E6194,2027-12-01,8.30am,11:45,,VOID
T006,E2342,29/11/2027,11:00am,7:15pm,31,OK
T007,E4500,2027-11-30,7:00am,2:30pm,,OK
T008,E3247,29/11/2027,17:00,7:30pm,,OK
T009,E5410,30 Nov,8.30am,1630,,VOID
T010,E8999,01/12/2027,0645,3.30pm,,OK
T011,E2342,03/12/2027,8:00pm,01:00,138.4,OK
T012,E3247,05/12/2027,18:00,0000,47.8,OK
T013,E4628,5 Dec,7.15am,5:45pm,37,OK
T014,E8999,03/12/2027,7.45am,1530,,VOID
T015,E7639,30/11/2027,0615,3.15pm,,VOID
T016,E8866,2027-12-01,21:30,0130,,VOID
T017,E6194,2027-11-29,10.15am,19:00,120,OK
T018,E8344,30/11/2027,8:30am,1830,,OK
T019,E3321,2027-11-30,22:30,0845,94,OK
T020,E198,01/12/2027,07:45,1315,,OK
T021,E3321,2027-12-04,1745,01:30,8,OK
T022,E8308,2027-12-04,10.15am,1945,60.2,OK
T023,E4463,01/12/2027,9.15am,6.30pm,,OK
T024,E4463,2027-11-28,9.30pm,5:00am,,OK
T025,E2342,2027-12-04,2015,2.30am,,OK
T026,E8344,5 Dec,4:45pm,3.15am,91.8,OK
T027,E6194,01/12/2027,8.30am,10.45am,,OK
T028,E8866,2027-12-01,9.30pm,01:30,,OK
T029,E5151,2027-12-05,8.15am,2015,94,OK
T030,E4628,2027-11-30,05:45,10.15am,,OK
T031,E3321,2027-12-02,10.30am,14:45,,OK
T032,E8308,2027-12-05,0515,10.30am,,OK
T033,E5410,4 Dec,1115,2000,,OK
T034,E198,03/12/2027,20:00,00:45,,OK
T035,E8999,29 Nov,0500,12:45pm,,OK
T036,E6194,04/12/2027,07:45,1230,,OK
T037,E8999,04/12/2027,2115,06:15,,OK
T038,E2342,30/11/2027,2300,3.30am,,OK
T039,E8344,03/12/2027,11:15am,8:45pm,139,OK
T040,E5151,30/11/2027,08:00,15:30,14,OK
T041,E4628,04/12/2027,8:30am,3.30pm,,OK
T042,E8344,2027-12-04,22:30,0800,18.8,OK
T043,E8999,04/12/2027,06:30,11.45am,,OK
T044,E3247,2027-12-03,8.30am,11:45am,35,OK
T045,E5151,2027-12-02,09:15,6.15pm,,OK
T046,E6194,30 Nov,7:45am,10:15am,,OK
T047,E5410,30 Nov,8.30am,1630,,OK
T048,E198,05/12/2027,10:30am,4.45pm,,OK
T049,E198,2027-12-01,0745,14:15,,VOID
T050,E4463,2027-12-04,1845,02:45,29.8,OK
T051,E9514,2027-12-03,8.15am,5:45pm,,OK
T052,E8999,2027-12-03,07:45,3.30pm,,OK
T053,E2342,2027-12-06,09:00,1400,,OK
T054,E198,30/11/2027,5:45am,1345,,OK
T055,E8344,1 Dec,1130,9:45pm,,OK
T056,E5151,2027-12-01,7.45am,4.30pm,,OK
T057,E5151,04/12/2027,0845,9:00pm,,OK
T058,E4463,2027-12-02,9.30pm,2:30am,68,OK
T059,E4628,29/11/2027,5.30am,15:00,,OK
T060,E3247,4 Dec,5:45am,1.00pm,,OK
T061,E6194,2027-12-03,7:00am,1200,,OK

Answer format: {"gross": {"E1234": 1234.56, ...}, "total": 12345.67}  List EVERY employee in the staff table (0.00 if nothing is payable). Amounts in dollars rounded to cents.

Reply with ONE JSON object only (no markdown fences, no text before or after), exactly in the format asked.

Correct answer (fixed before the run)

{
 "gross": {
  "E8344": 1631.6,
  "E198": 781.54,
  "E4463": 1122.52,
  "E5410": 502.13,
  "E8866": 463.03,
  "E8999": 1749.1,
  "E8308": 732.74,
  "E6194": 1137.19,
  "E2342": 1129.81,
  "E4628": 1401.03,
  "E5151": 2177.56,
  "E3321": 1275.6,
  "E3247": 1456.52,
  "E7639": 0.0
 },
 "total": 15560.37
}

Model reply (final text as stored)

{"gross": {"E8344": 1631.60, "E198": 778.84, "E4463": 1122.52, "E5410": 502.13, "E8866": 463.03, "E8999": 1749.10, "E8308": 732.74, "E6194": 1137.19, "E2342": 1129.81, "E4628": 1401.03, "E5151": 2177.56, "E3321": 1275.60, "E3247": 1456.52, "E7639": 0.00}, "total": 15557.67}

Task T-6972cc136a. Answer fingerprint 65f09a31957384fe1c1ff0253fbcc27b9318d8a44a3d22937af1b55af39c9a7c

Bank reconciliation · Claude Sonnet 5.5 Late interest left out

98.3% of the answer fields were right, but 2 were not, so the task counts as wrong. Claude Opus 5.5 solved the same task exactly, so it can be done from the text.

Wrong fields
FieldCorrectModel gave
interest/INV-05871.960.0
interest_total/USD344.45342.49

The task, exactly as the model saw it

You are closing the receivables ledger of a small business at the STATEMENT DATE 2026-11-30. Follow these rules exactly; do every calculation yourself with the exact decimal arithmetic stated (no estimates).

RULES
1. Each customer has ONE currency (USD, EUR or GBP): all its invoices, credit notes, balances and interest are in that currency. Due date = invoice date + the customer's NET days.
2. CORRECTION MEMOS (table below) replace a value by id: kind LINE replaces the GROSS amount of that bank line (same currency as the line); kind INV replaces the INVOICE amount (before credit notes). A memo counts only if its memo date is on or before the statement date AND its id exists in the invoice / bank line table (otherwise ignore it). If several counting memos target the same id, the one with the latest memo date wins; on the same date the higher memo number wins. Corrected values are used everywhere below.
3. BASE of an invoice = corrected invoice amount minus the sum of credit notes naming it (never below 0.00).
4. BANK FEE of each line (in the line's own currency), computed on the corrected gross amount: marginal tiers: 0.60% of the part up to 1,000.00; 0.35% of the part from 1,000.00 up to 5,000.00; 0.15% of the part above 5,000.00. Add the three parts unrounded, then raise to 3.00 if below and cut to 60.00 if above, then round half up to cents. NET = gross - fee.
5. CREDIT to the customer = NET if the line currency equals the customer currency; otherwise the line is in USD and the credit = NET / rate, rounded half up to cents, where rate = USD per 1 unit of the customer currency from the FX table row with the latest rate date on or before the LINE date.
6. APPLICATION. Process bank lines in order of line date (ties: line id). Each customer has a cash POOL, starting at 0.00. A line adds its credit to its customer's pool. Then walk that customer's invoices that are dated on or before the line date, oldest invoice date first (ties: lower invoice number), skipping invoices whose balance is 0; while the pool is above 0.00:
   a. If this is the first time the invoice is reached with a positive pool (it has never received cash) and the customer has early-payment terms 'p% d days' and the line date is on or before invoice date + d days, the invoice gets a DISCOUNT = p% of its BASE, rounded half up to cents, subtracted from its balance now (once only). Without terms, or if too late, no discount ever. An invoice's balance starts at its BASE.
   b. Apply min(pool, balance) to the invoice: reduce both. If the pool is still above 0.00 move to the next invoice.
   Cash left in the pool stays in the pool (it is not an invoice payment; it waits for the same customer's next line).
7. LATE INTEREST (simple, per invoice, annual rate of the customer, 365-day year, actual days). For every amount applied at line date L where L is after the due date: amount x rate% x (L - due date in days) / 365. Plus, for the balance still open at the statement date, if the statement date is after the due date: balance x rate% x (statement date - due date in days) / 365. Add all these parts of one invoice UNROUNDED, then round that invoice's interest half up to cents. Interest never changes any balance.
8. The invoice balance is what remains open after rules 3-6 (0.00 if fully paid).

ANSWER (JSON, all money as plain numbers with 2 decimals, no thousands separators):
 "balance": {invoice id: balance in the customer currency, for EVERY invoice},
 "interest": {invoice id: rounded interest of rule 7, for EVERY invoice},
 "customer_balance": {customer id: sum of that customer's invoice balances, for EVERY customer},
 "unapplied_cash": {customer id: pool left at the end, for EVERY customer},
 "fees": {"USD": ..., "EUR": ..., "GBP": ...} total of the rule 4 fees of lines in that currency (0.00 if none),
 "interest_total": {"USD": ..., "EUR": ..., "GBP": ...} sum of the rounded invoice interests of invoices in that currency.
Invoice ids are written INV-dddd (4 digits), e.g. "INV-0123".

CUSTOMERS (id, name, currency, net days, early-payment terms, annual late rate %)
id,name,currency,net_days,early_terms,late_rate
C01,Dunmore Freight,USD,60,2% 10 days,6.5
C02,Alder Foods,EUR,30,2% 14 days,6.5
C03,Ironbark Parts,GBP,60,3% 7 days,8
C04,Kestrel Optics,EUR,30,2% 10 days,9.5
C05,Fernhill Labs,EUR,30,3% 7 days,12
C06,Granite Supply,USD,45,2% 10 days,12
C07,Juniper Cycles,USD,30,none,6.5
C08,Brightwater Co,EUR,30,none,8
C09,Cobalt Tooling,USD,45,2% 10 days,9.5
C10,Harbour Linen,USD,30,2.5% 15 days,8

INVOICES (invoice, customer, invoice date, amount in customer currency)
invoice,customer,date,amount
INV-0338,C01,2026-08-24,16766.10
INV-0345,C01,2026-09-14,14554.17
INV-0354,C01,2026-10-04,8739.83
INV-0360,C01,2026-09-12,9667.70
INV-0364,C01,2026-08-16,14093.20
INV-0373,C02,2026-10-05,2931.74
INV-0379,C02,2026-10-25,16925.69
INV-0380,C02,2026-09-20,13488.43
INV-0386,C02,2026-08-07,5630.10
INV-0390,C03,2026-08-22,1349.68
INV-0393,C03,2026-10-19,7635.04
INV-0400,C03,2026-08-19,4452.62
INV-0408,C03,2026-09-28,1388.58
INV-0413,C03,2026-10-03,13321.51
INV-0420,C04,2026-08-31,10466.57
INV-0423,C04,2026-09-17,7941.74
INV-0429,C04,2026-08-03,8106.23
INV-0435,C04,2026-10-23,4195.88
INV-0444,C04,2026-09-11,4822.61
INV-0447,C05,2026-08-07,1272.71
INV-0450,C05,2026-09-02,6772.82
INV-0455,C05,2026-09-28,5367.78
INV-0457,C05,2026-08-28,11614.44
INV-0459,C06,2026-10-14,4090.93
INV-0467,C06,2026-10-14,10053.82
INV-0472,C06,2026-10-11,15005.64
INV-0480,C06,2026-08-05,7218.07
INV-0486,C07,2026-09-27,15774.14
INV-0488,C07,2026-09-28,13058.60
INV-0491,C07,2026-08-26,15830.70
INV-0495,C07,2026-08-27,3166.20
INV-0502,C08,2026-09-10,5102.68
INV-0509,C08,2026-10-03,7787.56
INV-0518,C08,2026-10-16,4311.63
INV-0524,C08,2026-09-29,7521.02
INV-0532,C08,2026-09-03,9467.10
INV-0539,C09,2026-09-03,7856.38
INV-0545,C09,2026-10-17,16828.37
INV-0554,C09,2026-08-21,6991.07
INV-0557,C09,2026-10-23,16692.44
INV-0563,C09,2026-08-31,8528.95
INV-0571,C10,2026-10-03,4117.41
INV-0579,C10,2026-10-07,13640.57
INV-0580,C10,2026-09-29,15455.05
INV-0587,C10,2026-10-26,1787.06
INV-0592,C10,2026-10-22,11803.10

CREDIT NOTES (note, invoice, date, amount)
note,invoice,date,amount
CN-01,INV-0444,2026-09-17,482.26
CN-02,INV-0423,2026-09-28,1826.60
CN-03,INV-0408,2026-10-07,180.52
CN-04,INV-0373,2026-10-17,586.35
CN-05,INV-0455,2026-10-22,1341.95
CN-06,INV-0592,2026-11-14,1180.31
CN-07,INV-0545,2026-11-15,2355.97

BANK LINES (line, date, customer, currency, gross amount)
line,date,customer,currency,gross
L01,2026-08-13,C06,USD,6829.45
L02,2026-08-20,C05,EUR,384.22
L03,2026-08-22,C04,EUR,20194.10
L04,2026-08-23,C03,GBP,2778.42
L05,2026-08-24,C04,USD,3729.36
L06,2026-08-24,C09,USD,8191.65
L07,2026-08-29,C01,USD,7090.67
L08,2026-08-29,C02,USD,381.62
L09,2026-09-02,C07,USD,916.23
L10,2026-09-09,C01,USD,1913.89
L11,2026-09-11,C06,USD,12103.68
L12,2026-09-12,C02,USD,26382.15
L13,2026-09-13,C03,USD,7595.35
L14,2026-09-14,C08,USD,1655.21
L15,2026-09-15,C05,EUR,3252.68
L16,2026-09-18,C02,USD,618.83
L17,2026-09-25,C09,USD,7616.72
L18,2026-09-28,C01,USD,24872.41
L19,2026-09-28,C05,USD,11567.24
L20,2026-09-29,C06,USD,2912.48
L21,2026-09-30,C03,USD,4494.57
L22,2026-10-03,C03,GBP,3862.15
L23,2026-10-03,C04,USD,2446.48
L24,2026-10-04,C06,USD,9431.27
L25,2026-10-05,C08,EUR,8549.42
L26,2026-10-07,C05,USD,5526.80
L27,2026-10-07,C07,USD,5659.20
L28,2026-10-10,C07,USD,4301.15
L29,2026-10-12,C10,USD,6482.18
L30,2026-10-16,C04,USD,142.95
L31,2026-10-22,C01,USD,16541.62
L32,2026-10-22,C09,USD,6553.21
L33,2026-10-31,C02,USD,6683.67
L34,2026-11-01,C10,USD,13104.97
L35,2026-11-03,C10,USD,3288.06
L36,2026-11-04,C08,USD,11744.02
L37,2026-11-10,C07,USD,20076.55
L38,2026-11-11,C08,USD,3783.10
L39,2026-11-17,C09,USD,9293.86
L40,2026-11-18,C09,USD,16707.19
L41,2026-11-21,C07,USD,15919.91
L42,2026-11-22,C10,USD,994.41
L43,2026-11-28,C03,GBP,6936.26

CORRECTION MEMOS (memo, memo date, kind, id, new amount)
memo,date,kind,id,new_amount
M01,2026-08-22,INV,INV-0400,3829.25
M02,2026-09-03,INV,INV-0386,5123.39
M03,2026-09-03,INV,INV-0386,4815.99
M04,2026-09-10,INV,INV-0554,7969.82
M05,2026-09-14,INV,INV-0480,6424.08
M06,2026-09-27,LINE,L08,282.40
M07,2026-10-01,LINE,L26,7184.84
M08,2026-10-05,LINE,L19,9138.12
M09,2026-10-09,LINE,L33,6215.81
M10,2026-10-12,LINE,L54,8906.12
M11,2026-10-20,INV,INV-0678,8444.55
M12,2026-10-30,LINE,L16,668.34
M13,2026-11-06,INV,INV-0373,2609.25
M14,2026-12-05,LINE,L24,7073.45
M15,2026-12-05,INV,INV-0457,7167.75
M16,2026-12-09,LINE,L18,16664.51

FX RATES (rate date, USD per 1 EUR, USD per 1 GBP)
rate_date,EUR,GBP
2026-07-27,1.0750,1.2632
2026-08-03,1.0854,1.2496
2026-08-07,1.0754,1.2618
2026-08-11,1.0863,1.2473
2026-08-14,1.0884,1.2436
2026-08-18,1.0890,1.2443
2026-08-25,1.0863,1.2398
2026-08-28,1.0775,1.2418
2026-08-31,1.0884,1.2410
2026-09-07,1.0949,1.2390
2026-09-14,1.1011,1.2318
2026-09-18,1.1057,1.2201
2026-09-25,1.1142,1.2296
2026-10-02,1.1165,1.2392
2026-10-05,1.1048,1.2274
2026-10-12,1.1061,1.2252
2026-10-19,1.0966,1.2229
2026-10-26,1.0887,1.2349
2026-10-30,1.0830,1.2232
2026-11-02,1.0917,1.2319
2026-11-06,1.0919,1.2278
2026-11-13,1.0995,1.2206
2026-11-20,1.1054,1.2107
2026-11-23,1.1167,1.2235
2026-11-26,1.1156,1.2151

Reply format: {"balance": {"INV-0101": 0.00, ...}, "interest": {...}, "customer_balance": {"C01": 0.00, ...}, "unapplied_cash": {...}, "fees": {"USD": 0.00, "EUR": 0.00, "GBP": 0.00}, "interest_total": {"USD": 0.00, "EUR": 0.00, "GBP": 0.00}}

Reply with ONE JSON object only (no markdown fences, no text before or after), exactly in the format asked.

Correct answer (fixed before the run)

{
 "balance": {
  "INV-0338": 0.0,
  "INV-0345": 4782.04,
  "INV-0354": 8739.83,
  "INV-0360": 0.0,
  "INV-0364": 0.0,
  "INV-0373": 0.0,
  "INV-0379": 6287.16,
  "INV-0380": 0.0,
  "INV-0386": 0.0,
  "INV-0390": 0.0,
  "INV-0393": 3515.66,
  "INV-0400": 0.0,
  "INV-0408": 0.0,
  "INV-0413": 0.0,
  "INV-0420": 0.0,
  "INV-0423": 3158.86,
  "INV-0429": 0.0,
  "INV-0435": 4195.88,
  "INV-0444": 0.0,
  "INV-0447": 0.0,
  "INV-0450": 1379.75,
  "INV-0455": 4025.83,
  "INV-0457": 0.0,
  "INV-0459": 4090.93,
  "INV-0467": 10053.82,
  "INV-0472": 15005.64,
  "INV-0480": 0.0,
  "INV-0486": 0.0,
  "INV-0488": 1079.63,
  "INV-0491": 0.0,
  "INV-0495": 0.0,
  "INV-0502": 0.0,
  "INV-0509": 5678.32,
  "INV-0518": 4311.63,
  "INV-0524": 0.0,
  "INV-0532": 0.0,
  "INV-0539": 0.0,
  "INV-0545": 0.0,
  "INV-0554": 0.0,
  "INV-0557": 7133.01,
  "INV-0563": 0.0,
  "INV-0571": 0.0,
  "INV-0579": 9031.39,
  "INV-0580": 0.0,
  "INV-0587": 1787.06,
  "INV-0592": 10622.79
 },
 "interest": {
  "INV-0338": 0.0,
  "INV-0345": 14.48,
  "INV-0354": 0.0,
  "INV-0360": 0.0,
  "INV-0364": 0.0,
  "INV-0373": 0.0,
  "INV-0379": 6.72,
  "INV-0380": 26.42,
  "INV-0386": 4.87,
  "INV-0390": 0.0,
  "INV-0393": 0.0,
  "INV-0400": 0.0,
  "INV-0408": 0.0,
  "INV-0413": 0.0,
  "INV-0420": 8.17,
  "INV-0423": 36.18,
  "INV-0429": 0.0,
  "INV-0435": 8.74,
  "INV-0444": 0.0,
  "INV-0447": 2.64,
  "INV-0450": 35.63,
  "INV-0455": 43.68,
  "INV-0457": 6.27,
  "INV-0459": 2.69,
  "INV-0467": 6.61,
  "INV-0472": 24.67,
  "INV-0480": 0.0,
  "INV-0486": 46.98,
  "INV-0488": 57.54,
  "INV-0491": 64.44,
  "INV-0495": 25.37,
  "INV-0502": 24.93,
  "INV-0509": 39.01,
  "INV-0518": 14.18,
  "INV-0524": 11.95,
  "INV-0532": 3.49,
  "INV-0539": 21.07,
  "INV-0545": 0.0,
  "INV-0554": 0.0,
  "INV-0557": 0.0,
  "INV-0563": 1.06,
  "INV-0571": 0.0,
  "INV-0579": 50.97,
  "INV-0580": 5.66,
  "INV-0587": 1.96,
  "INV-0592": 20.95
 },
 "customer_balance": {
  "C01": 13521.87,
  "C02": 6287.16,
  "C03": 3515.66,
  "C04": 7354.74,
  "C05": 5405.58,
  "C06": 29150.39,
  "C07": 1079.63,
  "C08": 9989.95,
  "C09": 7133.01,
  "C10": 21441.24
 },
 "unapplied_cash": {
  "C01": 0.0,
  "C02": 0.0,
  "C03": 0.0,
  "C04": 0.0,
  "C05": 0.0,
  "C06": 24888.54,
  "C07": 0.0,
  "C08": 0.0,
  "C09": 0.0,
  "C10": 0.0
 },
 "fees": {
  "USD": 800.91,
  "EUR": 84.99,
  "GBP": 51.14
 },
 "interest_total": {
  "USD": 344.45,
  "EUR": 272.88,
  "GBP": 0.0
 }
}

Model reply (final text as stored)

{"balance": {"INV-0338": 0.00, "INV-0345": 4782.04, "INV-0354": 8739.83, "INV-0360": 0.00, "INV-0364": 0.00, "INV-0373": 0.00, "INV-0379": 6287.16, "INV-0380": 0.00, "INV-0386": 0.00, "INV-0390": 0.00, "INV-0393": 3515.66, "INV-0400": 0.00, "INV-0408": 0.00, "INV-0413": 0.00, "INV-0420": 0.00, "INV-0423": 3158.86, "INV-0429": 0.00, "INV-0435": 4195.88, "INV-0444": 0.00, "INV-0447": 0.00, "INV-0450": 1379.75, "INV-0455": 4025.83, "INV-0457": 0.00, "INV-0459": 4090.93, "INV-0467": 10053.82, "INV-0472": 15005.64, "INV-0480": 0.00, "INV-0486": 0.00, "INV-0488": 1079.63, "INV-0491": 0.00, "INV-0495": 0.00, "INV-0502": 0.00, "INV-0509": 5678.32, "INV-0518": 4311.63, "INV-0524": 0.00, "INV-0532": 0.00, "INV-0539": 0.00, "INV-0545": 0.00, "INV-0554": 0.00, "INV-0557": 7133.01, "INV-0563": 0.00, "INV-0571": 0.00, "INV-0579": 9031.39, "INV-0580": 0.00, "INV-0587": 1787.06, "INV-0592": 10622.79}, "interest": {"INV-0338": 0.00, "INV-0345": 14.48, "INV-0354": 0.00, "INV-0360": 0.00, "INV-0364": 0.00, "INV-0373": 0.00, "INV-0379": 6.72, "INV-0380": 26.42, "INV-0386": 4.87, "INV-0390": 0.00, "INV-0393": 0.00, "INV-0400": 0.00, "INV-0408": 0.00, "INV-0413": 0.00, "INV-0420": 8.17, "INV-0423": 36.18, "INV-0429": 0.00, "INV-0435": 8.74, "INV-0444": 0.00, "INV-0447": 2.64, "INV-0450": 35.63, "INV-0455": 43.68, "INV-0457": 6.27, "INV-0459": 2.69, "INV-0467": 6.61, "INV-0472": 24.67, "INV-0480": 0.00, "INV-0486": 46.98, "INV-0488": 57.54, "INV-0491": 64.44, "INV-0495": 25.37, "INV-0502": 24.93, "INV-0509": 39.01, "INV-0518": 14.18, "INV-0524": 11.95, "INV-0532": 3.49, "INV-0539": 21.07, "INV-0545": 0.00, "INV-0554": 0.00, "INV-0557": 0.00, "INV-0563": 1.06, "INV-0571": 0.00, "INV-0579": 50.97, "INV-0580": 5.66, "INV-0587": 0.00, "INV-0592": 20.95}, "customer_balance": {"C01": 13521.87, "C02": 6287.16, "C03": 3515.66, "C04": 7354.74, "C05": 5405.58, "C06": 29150.39, "C07": 1079.63, "C08": 9989.95, "C09": 7133.01, "C10": 21441.24}, "unapplied_cash": {"C01": 0.00, "C02": 0.00, "C03": 0.00, "C04": 0.00, "C05": 0.00, "C06": 24888.54, "C07": 0.00, "C08": 0.00, "C09": 0.00, "C10": 0.00}, "fees": {"USD": 800.91, "EUR": 84.99, "GBP": 51.14}, "interest_total": {"USD": 342.49, "EUR": 272.88, "GBP": 0.00}}

Task T-fa487527a3. Answer fingerprint c820bb251262575d5dd8e35a639d9ac5531f3a0cdbdd14e2e690e4209ba7f700

Claims settlement · Claude Sonnet 5.5 Two payouts one cent off

97.5% of the answer fields were right, but 4 were not, so the task counts as wrong. Claude Opus 5.5 solved the same task exactly, so it can be done from the text.

Wrong fields
FieldCorrectModel gave
claims/CL-5463/payable2515.052515.04
claims/CL-5800/payable3524.583524.59
claims/CL-1770/interest71.470.42
policies/HP-437148/interest71.470.42

The task, exactly as the model saw it

You are a claims officer at Summitcover Training Mutual. This is a FICTIONAL TRAINING POLICY (an invented exercise: not a real insurance product, not legal or financial advice). Triage every claim using ONLY the wording, schedule, endorsements, claims, settlements and correction notices below. Work out every amount exactly.

GENERAL WORDING
SECTION 1 - DEFINITIONS. 'Incident date' = the date the loss happened. 'Lodged date' = the date the claim was made. 'Settled date' = the date the claim was paid or closed (given per claim in the SETTLEMENTS table). 'Claimed amount' of an item = the amount in the CLAIMS table after applying Section 9 (correction notices). 'Covered amount' of an item = its value after the rules in Sections 3-4. 'Event' = all loss from one cause on one date; claims of one event carry the same event reference. A 'secured vehicle' means a vehicle that was locked AND with the items out of sight. 'Full years' between two dates = the number of whole years: the year difference, minus 1 if the earlier date's month and day have not yet been reached on the later date (an exact anniversary counts as reached). Items are numbered 1, 2, 3... within each claim (item_no).
SECTION 2 - COVER. Perils covered: fire, storm, theft, water damage, accidental damage. Flood is NOT a covered peril. Waiting period: storm claims with an incident date less than 14 days after the policy start date (incident date < start date + 14 days) are not covered, UNLESS the schedule shows Renewal: yes (then there is no waiting period). Premium: if the instalment is not paid by its due date, there is a grace period of 21 days (cover continues). If it is paid within the grace period (paid date <= due date + 21 days) nothing changes. Otherwise cover LAPSES from the day after the grace period ends until the day before the paid date (cover restarts ON the paid date); if never paid, cover stays lapsed. Incidents during a lapse are not covered.
SECTION 3 - LIMITS. For each item with a covered amount, work in this order. STEP 1 DEPRECIATION: age = full years from the item's purchase date (after Section 9) to the claim's INCIDENT date. Yearly rates per category: electronics 12%, bicycle 10%, jewellery 0%, artwork 0%, furniture 8%, clothing 10%, kitchenware 10%, tools 10%, rugs 4%. Counted percentage = the larger of 40 and (100 - rate x age). Counted amount = claimed amount x counted percentage / 100, rounded to cents (half up), per item. STEP 2 PER-ITEM SUB-LIMIT (the most paid for any one item; applied to the counted amount from step 1): jewellery 1,500.00, electronics 2,500.00, bicycle 1,200.00, artwork 3,000.00. Other categories have no per-item limit. STEP 3 CATEGORY CAP: for each policy, category and POLICY YEAR (policy year number = whole days from the policy start date to the incident date, divided by 365, rounded down; so year 0 is the first 365 days) the covered amounts counted may never exceed the cap: electronics 2,800.00, bicycle 2,800.00, jewellery 1,500.00, artwork 1,800.00, furniture 1,200.00, clothing 1,800.00, kitchenware 1,200.00, tools 3,500.00, rugs 2,800.00. For a claim, add up its items' amounts after step 2 per category; if that category total is above the cap still remaining for that policy, category and policy year, the category counts only as the remaining cap (this counts as a sub-limit cut). The cap is used up by the category amount counted for a claim ONLY if that claim ends with decision pay or partial (declined and referred claims use none of it). Claims are processed in the order given in Section 7. A claim reduced only by depreciation, the excess and/or the co-payment still counts as paid in full. Sum insured: the total paid (the payable amounts, not interest) on a policy over all its claims (processed in lodgement order) can never exceed the sum insured on the schedule; a claim gets at most the sum insured still remaining.
SECTION 4 - EXCLUSIONS. Cash is never covered. Items used for business ('business use: yes') are not covered unless the schedule shows Home business: yes. Loss while away from the home (location 'away' or 'vehicle') is covered only if the schedule shows Portable cover: yes, and then only for these portable categories: jewellery, electronics, bicycle, clothing; other items away from home are not covered. Theft from a vehicle is not covered unless it was a secured vehicle (see Section 1). Items not covered under this section have a covered amount of 0.
SECTION 5 - EXCESS AND CO-PAYMENT. The excess is 200.00 per claim unless the schedule shows another amount. The excess is deducted from the claim's total covered amount (after Section 3 steps 1-3; never below 0). STORM claims: the excess applies ONCE PER EVENT, shared by all storm claims on the same policy with the same event reference: in processing order, each such claim bears as much of the still-untaken event excess as its total covered amount allows; any remainder passes to the next claim of that event. (Claims stopped in Section 7 or with total covered amount 0 bear no excess.) CO-PAYMENT: the policy's copay_pct (schedule) is a percentage of the amount left AFTER the excess; co-payment = that amount x copay_pct / 100 rounded to cents (half up); the claim's amount to pay is the amount left after the excess minus the co-payment.
SECTION 6 - REFERRALS. A claim lodged more than 60 days after its incident date (lodged date - incident date > 60) is referred (LATE_LODGEMENT). A claim whose total CLAIMED amount (all items, using the claimed amounts after Section 9, before any other rule) is above 12,000.00 is referred (HIGH_VALUE). Referred claims are payable 0.00 and do not use the sum insured, any cap or any excess.
SECTION 7 - HOW TO DECIDE. Process claims in order of lodged date, then claim id ascending. For each claim: (a) check in this order and stop at the FIRST that applies (payable 0.00): LAPSED (incident during a lapse) -> decline; PERIL_NOT_COVERED -> decline; WAITING_PERIOD -> decline; LATE_LODGEMENT -> refer; HIGH_VALUE -> refer. (b) work out each item's covered amount (Sections 3-4, steps 1-3); if the total covered amount is 0 -> decline, ITEM_EXCLUDED (but decline, SUBLIMIT if it is 0 only because a category cap was used up). (c) deduct the excess (Section 5); if nothing is left -> decline, BELOW_EXCESS. (d) deduct the co-payment (Section 5) = amount to pay. (e) if no sum insured remains -> decline, SUM_INSURED; otherwise payable = the lower of the amount to pay and the remaining sum insured. (f) decision: if the sum insured cut the amount -> partial, SUM_INSURED; else if any item was not covered -> partial, ITEM_EXCLUDED; else if any sub-limit or category cap cut an item/category -> partial, SUBLIMIT; else pay, OK. Declined and referred claims have interest 0.00.
SECTION 8 - PRECEDENCE. An endorsement overrides the schedule, and the schedule overrides this wording. An endorsement applies only to claims whose INCIDENT date is on or after its effective date. If several endorsements on a policy change the same clause, use the one with the latest effective date that is on or before the incident date. Endorsements only affect their own policy. An endorsement marked 'replaces END-x' cancels END-x for every claim whose incident date is on or after the replacing endorsement's effective date (END-x still applies to incidents before that date); the clause END-x had changed then goes back to any other endorsement on that clause that still applies, else to the schedule, else to this wording. CARVE-OUT (schedule column carve_out): the one exception to this order. A carve-out FIXES that clause for that policy and no endorsement can change it; 'storm excess fixed at X' covers storm claims only (for storm events it is the event excess), so other perils follow the normal order.
SECTION 9 - CORRECTION NOTICES. A notice replaces ONE field of ONE item (claim_id + item_no): field 'claimed' = the item's claimed amount, field 'purchase_date' = the item's purchase date. A notice counts for a claim only if its notice_date is on or before that claim's settled date (notice_date <= settled date); later notices are ignored. For one claim item and field, the notice with the latest notice_date wins; if two have the same date, the one with the higher notice_id (compare the number after CN-) wins. Notices change the claimed amount / purchase date for EVERY rule in this wording (including Section 6 and depreciation). Fields without a counting notice keep the CLAIMS table value.
SECTION 10 - SETTLEMENT INTEREST. A claim with payable above 0 is due 21 days after its lodged date (due date = lodged date + 21 days). If the settled date is after the due date, interest = payable x 12% / 100 x days late / 365, where days late = settled date - due date in actual days, rounded to cents (half up) per claim. Otherwise interest is 0.00. Interest is not part of the payable and does not use the sum insured.
SECTION 11 - POLICY TOTALS. For every policy in the schedule: paid = sum of the payable amounts of its claims; interest = sum of the claim interest amounts; remaining_si = sum insured - paid (interest is not deducted). Policies without claims: paid 0.00, interest 0.00, remaining_si = sum insured.

SCHEDULE (10 policies; amounts in dollars):
policy_no,holder,start_date,sum_insured,excess,sub_limit_overrides,home_business,portable_cover,renewal,premium_due,premium_paid,carve_out,copay_pct
HP-442238,Gus Diaz,2027-02-18,40000.00,100.00,none,no,yes,no,2027-06-07,2027-06-06,none,10
HP-437148,Nina Silva,2027-04-28,40000.00,100.00,bicycle 700.00,no,no,no,2027-07-28,2027-08-23,electronics sub-limit fixed at 3250.00,20
HP-818586,Ava Lopez,2027-02-01,9000.00,as wording,none,no,yes,yes,2027-05-25,2027-08-04,storm excess fixed at 250.00,15
HP-103960,Xin Ortiz,2027-01-24,3000.00,450.00,none,no,yes,yes,2027-04-20,2027-04-12,none,25
HP-295035,Kira Diaz,2027-02-11,50000.00,as wording,none,no,yes,yes,2027-05-30,2027-06-15,none,10
HP-382000,Faye Dubois,2027-04-04,60000.00,600.00,artwork 3500.00,no,yes,yes,2027-07-19,2027-09-01,storm excess fixed at 250.00,0
HP-764334,Eli Dubois,2027-03-29,20000.00,750.00,bicycle 1700.00,no,no,no,2027-08-03,2027-10-21,none,10
HP-861717,Nina Reyes,2027-04-08,40000.00,600.00,none,no,no,no,2027-06-08,unpaid,none,25
HP-407988,Cole Torres,2027-04-12,50000.00,as wording,bicycle 2200.00,yes,yes,no,2027-07-01,2027-06-25,electronics sub-limit fixed at 3250.00,10
HP-899287,Oscar Lopez,2027-01-19,50000.00,as wording,none,no,no,no,2027-05-27,2027-05-27,none,20

ENDORSEMENTS (19):
endorsement_id,policy_no,effective_date,change
END-125,HP-764334,2027-11-05,portable cover added (yes); replaces END-726
END-216,HP-295035,2027-03-25,portable cover removed (no)
END-217,HP-382000,2027-07-09,excess becomes 700.00 per claim (storm: per event)
END-252,HP-764334,2027-11-29,excess becomes 250.00 per claim (storm: per event)
END-263,HP-103960,2027-03-12,excess becomes 300.00 per claim (storm: per event)
END-411,HP-407988,2027-10-04,home business cover added (yes)
END-498,HP-861717,2027-06-24,portable cover added (yes)
END-518,HP-899287,2027-07-23,home business cover removed (no)
END-519,HP-295035,2027-05-20,home business cover added (yes); replaces END-216
END-527,HP-818586,2027-05-20,excess becomes 1000.00 per claim (storm: per event)
END-642,HP-407988,2027-08-24,jewellery sub-limit becomes 750.00 per item; replaces END-684
END-684,HP-407988,2027-07-23,home business cover removed (no)
END-702,HP-103960,2027-06-10,excess becomes 150.00 per claim (storm: per event)
END-726,HP-764334,2027-09-11,excess becomes 200.00 per claim (storm: per event)
END-755,HP-899287,2027-05-19,home business cover added (yes)
END-768,HP-442238,2027-05-18,portable cover added (yes)
END-802,HP-442238,2027-04-13,portable cover removed (no)
END-868,HP-382000,2027-05-14,excess becomes 650.00 per claim (storm: per event)
END-906,HP-442238,2027-05-02,home business cover added (yes); replaces END-802

CLAIMS (33 claims, one row per item):
claim_id,policy_no,event_ref,peril,incident_date,lodged_date,location,vehicle_locked,items_out_of_sight,item_no,item,category,purchase_date,business_use,claimed
CL-1005,HP-407988,EV-122,accidental damage,2027-09-03,2027-09-13,away,-,-,1,bed frame,furniture,2023-02-03,no,1423.88
CL-1005,HP-407988,EV-122,accidental damage,2027-09-03,2027-09-13,away,-,-,2,shoes,clothing,2024-09-02,no,45.23
CL-1005,HP-407988,EV-122,accidental damage,2027-09-03,2027-09-13,away,-,-,3,wool rug,rugs,2024-10-16,no,1300.16
CL-1005,HP-407988,EV-122,accidental damage,2027-09-03,2027-09-13,away,-,-,4,tool chest,tools,2025-01-29,no,114.94
CL-1338,HP-382000,EV-579,water damage,2027-10-05,2027-11-06,home,-,-,1,e-bike,bicycle,2017-08-05,no,2088.26
CL-1338,HP-382000,EV-579,water damage,2027-10-05,2027-11-06,home,-,-,2,coffee machine,kitchenware,2025-10-04,no,305.32
CL-1338,HP-382000,EV-579,water damage,2027-10-05,2027-11-06,home,-,-,3,camera,electronics,2027-10-02,no,194.98
CL-1338,HP-382000,EV-579,water damage,2027-10-05,2027-11-06,home,-,-,4,print,artwork,2027-10-05,no,293.48
CL-1338,HP-382000,EV-579,water damage,2027-10-05,2027-11-06,home,-,-,5,camera,electronics,2017-11-13,no,1073.84
CL-1338,HP-382000,EV-579,water damage,2027-10-05,2027-11-06,home,-,-,6,shoes,clothing,2017-08-03,no,881.57
CL-1338,HP-382000,EV-579,water damage,2027-10-05,2027-11-06,home,-,-,7,runner rug,rugs,2024-05-11,no,1517.93
CL-1338,HP-382000,EV-579,water damage,2027-10-05,2027-11-06,home,-,-,8,cookware set,kitchenware,2020-12-06,no,478.42
CL-1353,HP-382000,EV-998,storm,2027-10-20,2027-11-14,home,-,-,1,cash,cash,-,no,580.00
CL-1611,HP-764334,EV-436,storm,2027-07-03,2027-07-22,home,-,-,1,suit,clothing,2022-12-23,no,31.80
CL-1633,HP-764334,EV-436,storm,2027-07-03,2027-08-01,home,-,-,1,cash,cash,-,no,200.00
CL-1770,HP-437148,EV-863,fire,2028-02-25,2028-02-27,home,-,-,1,oil painting,artwork,2019-01-14,no,956.26
CL-1770,HP-437148,EV-863,fire,2028-02-25,2028-02-27,home,-,-,2,dining table,furniture,2023-04-15,no,421.95
CL-1770,HP-437148,EV-863,fire,2028-02-25,2028-02-27,home,-,-,3,pearl necklace,jewellery,2022-02-26,no,1158.09
CL-1770,HP-437148,EV-863,fire,2028-02-25,2028-02-27,home,-,-,4,sofa,furniture,2022-07-21,no,943.06
CL-1770,HP-437148,EV-863,fire,2028-02-25,2028-02-27,home,-,-,5,e-bike,bicycle,2024-03-08,no,239.38
CL-1770,HP-437148,EV-863,fire,2028-02-25,2028-02-27,home,-,-,6,tool chest,tools,2026-08-27,yes,120.21
CL-1770,HP-437148,EV-863,fire,2028-02-25,2028-02-27,home,-,-,7,suit,clothing,2018-12-22,no,842.30
CL-1770,HP-437148,EV-863,fire,2028-02-25,2028-02-27,home,-,-,8,bed frame,furniture,2022-03-24,no,1054.92
CL-1792,HP-899287,EV-116,storm,2027-10-03,2027-10-23,home,-,-,1,tool chest,tools,2018-03-31,no,1166.40
CL-1792,HP-899287,EV-116,storm,2027-10-03,2027-10-23,home,-,-,2,mixer,kitchenware,2021-07-23,no,1240.16
CL-1792,HP-899287,EV-116,storm,2027-10-03,2027-10-23,home,-,-,3,tool chest,tools,2026-07-13,yes,620.28
CL-1792,HP-899287,EV-116,storm,2027-10-03,2027-10-23,home,-,-,4,earrings,jewellery,2026-08-20,no,242.76
CL-1792,HP-899287,EV-116,storm,2027-10-03,2027-10-23,home,-,-,5,watch,jewellery,2023-01-13,no,524.81
CL-1792,HP-899287,EV-116,storm,2027-10-03,2027-10-23,home,-,-,6,dining table,furniture,2019-11-04,no,309.97
CL-2127,HP-382000,EV-998,storm,2027-10-20,2027-11-15,home,-,-,1,cookware set,kitchenware,2018-04-10,no,1047.03
CL-2127,HP-382000,EV-998,storm,2027-10-20,2027-11-15,home,-,-,2,bed frame,furniture,2018-07-30,no,1124.26
CL-2127,HP-382000,EV-998,storm,2027-10-20,2027-11-15,home,-,-,3,shoes,clothing,2025-09-21,no,355.27
CL-2127,HP-382000,EV-998,storm,2027-10-20,2027-11-15,home,-,-,4,cookware set,kitchenware,2026-09-10,no,1248.93
CL-2127,HP-382000,EV-998,storm,2027-10-20,2027-11-15,home,-,-,5,mixer,kitchenware,2022-06-02,no,1153.47
CL-2127,HP-382000,EV-998,storm,2027-10-20,2027-11-15,home,-,-,6,runner rug,rugs,2027-05-02,no,1195.28
CL-2612,HP-382000,EV-231,flood,2027-07-01,2027-08-04,home,-,-,1,saw,tools,2019-10-14,yes,745.70
CL-2612,HP-382000,EV-231,flood,2027-07-01,2027-08-04,home,-,-,2,shoes,clothing,2027-05-08,no,124.37
CL-2612,HP-382000,EV-231,flood,2027-07-01,2027-08-04,home,-,-,3,road bike,bicycle,2017-02-02,no,875.84
CL-2612,HP-382000,EV-231,flood,2027-07-01,2027-08-04,home,-,-,4,runner rug,rugs,2025-06-05,no,548.99
CL-4810,HP-764334,EV-920,accidental damage,2027-11-05,2028-02-28,home,-,-,1,winter coat,clothing,2017-08-21,no,220.18
CL-4810,HP-764334,EV-920,accidental damage,2027-11-05,2028-02-28,home,-,-,2,dining table,furniture,2026-05-03,no,1228.45
CL-4810,HP-764334,EV-920,accidental damage,2027-11-05,2028-02-28,home,-,-,3,print,artwork,2023-11-05,no,218.75
CL-4810,HP-764334,EV-920,accidental damage,2027-11-05,2028-02-28,home,-,-,4,coffee machine,kitchenware,2024-09-07,no,103.38
CL-4810,HP-764334,EV-920,accidental damage,2027-11-05,2028-02-28,home,-,-,5,drill kit,tools,2026-09-03,yes,815.03
CL-4810,HP-764334,EV-920,accidental damage,2027-11-05,2028-02-28,home,-,-,6,wardrobe,furniture,2026-12-07,no,958.02
CL-4810,HP-764334,EV-920,accidental damage,2027-11-05,2028-02-28,home,-,-,7,drill kit,tools,2021-08-06,no,518.37
CL-4810,HP-764334,EV-920,accidental damage,2027-11-05,2028-02-28,home,-,-,8,print,artwork,2024-12-10,no,917.57
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,1,shoes,clothing,2019-04-28,no,339.02
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,2,saw,tools,2026-04-28,yes,714.32
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,3,dining table,furniture,2023-04-28,no,750.08
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,4,shoes,clothing,2017-07-06,no,1256.42
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,5,e-bike,bicycle,2021-08-08,no,1053.39
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,6,sofa,furniture,2023-07-11,no,389.80
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,7,coffee machine,kitchenware,2026-02-05,no,545.53
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,8,TV,electronics,2017-07-13,no,158.03
CL-4826,HP-861717,EV-622,theft,2027-04-29,2027-05-15,home,-,-,9,tool chest,tools,2020-03-28,yes,317.79
CL-4956,HP-295035,EV-301,theft,2027-05-21,2027-06-02,away,-,-,1,mountain bike,bicycle,2017-01-24,no,283.42
CL-4956,HP-295035,EV-301,theft,2027-05-21,2027-06-02,away,-,-,2,winter coat,clothing,2025-04-14,no,957.77
CL-4956,HP-295035,EV-301,theft,2027-05-21,2027-06-02,away,-,-,3,pearl necklace,jewellery,2023-10-26,no,167.50
CL-4956,HP-295035,EV-301,theft,2027-05-21,2027-06-02,away,-,-,4,bracelet,jewellery,2017-08-15,no,144.11
CL-5019,HP-382000,EV-998,storm,2027-10-20,2027-11-19,home,-,-,1,wool rug,rugs,2017-04-05,no,2.80
CL-5127,HP-764334,EV-436,storm,2027-07-03,2027-07-28,home,-,-,1,earrings,jewellery,2019-01-06,no,943.05
CL-5127,HP-764334,EV-436,storm,2027-07-03,2027-07-28,home,-,-,2,mountain bike,bicycle,2024-04-26,no,374.01
CL-5127,HP-764334,EV-436,storm,2027-07-03,2027-07-28,home,-,-,3,print,artwork,2027-04-30,no,429.07
CL-5127,HP-764334,EV-436,storm,2027-07-03,2027-07-28,home,-,-,4,oil painting,artwork,2019-06-20,no,407.94
CL-5463,HP-764334,EV-966,water damage,2027-12-24,2028-01-04,home,-,-,1,bed frame,furniture,2024-10-10,no,965.80
CL-5463,HP-764334,EV-966,water damage,2027-12-24,2028-01-04,home,-,-,2,runner rug,rugs,2023-04-19,no,1341.05
CL-5463,HP-764334,EV-966,water damage,2027-12-24,2028-01-04,home,-,-,3,runner rug,rugs,2025-06-11,no,120.21
CL-5463,HP-764334,EV-966,water damage,2027-12-24,2028-01-04,home,-,-,4,wardrobe,furniture,2019-03-29,no,445.68
CL-5463,HP-764334,EV-966,water damage,2027-12-24,2028-01-04,home,-,-,5,cookware set,kitchenware,2021-12-23,no,133.68
CL-5463,HP-764334,EV-966,water damage,2027-12-24,2028-01-04,home,-,-,6,wool rug,rugs,2017-12-19,no,1402.80
CL-5800,HP-764334,EV-744,water damage,2028-01-08,2028-02-04,home,-,-,1,wardrobe,furniture,2021-10-22,no,1486.33
CL-5800,HP-764334,EV-744,water damage,2028-01-08,2028-02-04,home,-,-,2,cookware set,kitchenware,2027-03-14,no,1522.59
CL-5800,HP-764334,EV-744,water damage,2028-01-08,2028-02-04,home,-,-,3,oil painting,artwork,2018-03-02,no,1136.21
CL-5800,HP-764334,EV-744,water damage,2028-01-08,2028-02-04,home,-,-,4,wool rug,rugs,2021-01-08,no,1198.14
CL-5800,HP-764334,EV-744,water damage,2028-01-08,2028-02-04,home,-,-,5,cookware set,kitchenware,2025-01-03,no,1586.49
CL-5800,HP-764334,EV-744,water damage,2028-01-08,2028-02-04,home,-,-,6,tool chest,tools,2021-04-24,no,932.05
CL-5800,HP-764334,EV-744,water damage,2028-01-08,2028-02-04,home,-,-,7,wool rug,rugs,2027-07-18,no,828.60
CL-5800,HP-764334,EV-744,water damage,2028-01-08,2028-02-04,home,-,-,8,mountain bike,bicycle,2024-03-13,no,743.45
CL-5939,HP-407988,EV-111,water damage,2027-08-12,2027-09-05,home,-,-,1,road bike,bicycle,2026-08-11,no,4833.73
CL-5939,HP-407988,EV-111,water damage,2027-08-12,2027-09-05,home,-,-,2,winter coat,clothing,2022-10-20,no,1145.87
CL-5939,HP-407988,EV-111,water damage,2027-08-12,2027-09-05,home,-,-,3,runner rug,rugs,2023-10-20,no,1409.86
CL-5939,HP-407988,EV-111,water damage,2027-08-12,2027-09-05,home,-,-,4,oil painting,artwork,2018-10-19,no,1245.70
CL-5939,HP-407988,EV-111,water damage,2027-08-12,2027-09-05,home,-,-,5,print,artwork,2021-08-12,no,210.24
CL-5939,HP-407988,EV-111,water damage,2027-08-12,2027-09-05,home,-,-,6,road bike,bicycle,2023-08-27,no,1177.20
CL-5976,HP-407988,EV-362,accidental damage,2027-09-08,2027-09-20,away,-,-,1,suit,clothing,2017-09-30,no,651.81
CL-5976,HP-407988,EV-362,accidental damage,2027-09-08,2027-09-20,away,-,-,2,road bike,bicycle,2023-09-07,no,725.70
CL-5976,HP-407988,EV-362,accidental damage,2027-09-08,2027-09-20,away,-,-,3,wool rug,rugs,2020-05-09,no,626.55
CL-5976,HP-407988,EV-362,accidental damage,2027-09-08,2027-09-20,away,-,-,4,tablet,electronics,2023-07-27,no,729.70
CL-5976,HP-407988,EV-362,accidental damage,2027-09-08,2027-09-20,away,-,-,5,shoes,clothing,2023-02-15,no,1284.43
CL-5976,HP-407988,EV-362,accidental damage,2027-09-08,2027-09-20,away,-,-,6,e-bike,bicycle,2020-10-06,no,1196.38
CL-6042,HP-382000,EV-998,storm,2027-10-20,2028-01-09,home,-,-,1,coffee machine,kitchenware,2024-01-15,no,1406.35
CL-6042,HP-382000,EV-998,storm,2027-10-20,2028-01-09,home,-,-,2,sculpture,artwork,2023-01-17,no,1138.57
CL-6042,HP-382000,EV-998,storm,2027-10-20,2028-01-09,home,-,-,3,sofa,furniture,2020-10-20,no,816.17
CL-6042,HP-382000,EV-998,storm,2027-10-20,2028-01-09,home,-,-,4,saw,tools,2024-03-03,yes,1261.54
CL-6042,HP-382000,EV-998,storm,2027-10-20,2028-01-09,home,-,-,5,saw,tools,2022-10-20,yes,1164.50
CL-6042,HP-382000,EV-998,storm,2027-10-20,2028-01-09,home,-,-,6,runner rug,rugs,2023-07-17,no,58.04
CL-6042,HP-382000,EV-998,storm,2027-10-20,2028-01-09,home,-,-,7,wool rug,rugs,2027-03-03,no,839.48
CL-6042,HP-382000,EV-998,storm,2027-10-20,2028-01-09,home,-,-,8,phone,electronics,2021-06-17,no,968.03
CL-6353,HP-899287,EV-515,storm,2027-02-05,2027-02-09,home,-,-,1,bed frame,furniture,2018-02-05,no,1244.68
CL-6353,HP-899287,EV-515,storm,2027-02-05,2027-02-09,home,-,-,2,saw,tools,2022-11-17,yes,1392.58
CL-6353,HP-899287,EV-515,storm,2027-02-05,2027-02-09,home,-,-,3,coffee machine,kitchenware,2024-06-15,no,841.81
CL-6353,HP-899287,EV-515,storm,2027-02-05,2027-02-09,home,-,-,4,cookware set,kitchenware,2024-06-03,no,1234.52
CL-6353,HP-899287,EV-515,storm,2027-02-05,2027-02-09,home,-,-,5,cookware set,kitchenware,2026-05-07,no,1108.85
CL-6486,HP-818586,EV-178,theft,2027-09-22,2027-09-29,home,-,-,1,bed frame,furniture,2020-07-17,no,738.29
CL-6486,HP-818586,EV-178,theft,2027-09-22,2027-09-29,home,-,-,2,sofa,furniture,2023-10-10,no,118.58
CL-6486,HP-818586,EV-178,theft,2027-09-22,2027-09-29,home,-,-,3,cookware set,kitchenware,2019-11-14,no,91.96
CL-6486,HP-818586,EV-178,theft,2027-09-22,2027-09-29,home,-,-,4,drill kit,tools,2021-06-22,no,107.22
CL-6486,HP-818586,EV-178,theft,2027-09-22,2027-09-29,home,-,-,5,shoes,clothing,2018-10-29,no,106.40
CL-6486,HP-818586,EV-178,theft,2027-09-22,2027-09-29,home,-,-,6,tool chest,tools,2018-06-24,yes,1932.16
CL-6740,HP-764334,EV-716,storm,2027-04-03,2027-04-10,home,-,-,1,road bike,bicycle,2016-10-20,no,331.29
CL-6740,HP-764334,EV-716,storm,2027-04-03,2027-04-10,home,-,-,2,drill kit,tools,2018-08-21,yes,737.56
CL-6740,HP-764334,EV-716,storm,2027-04-03,2027-04-10,home,-,-,3,mountain bike,bicycle,2022-10-02,no,44.16
CL-6740,HP-764334,EV-716,storm,2027-04-03,2027-04-10,home,-,-,4,wardrobe,furniture,2021-10-14,no,1267.77
CL-6942,HP-407988,EV-420,storm,2027-09-12,2027-10-06,home,-,-,1,winter coat,clothing,2020-11-19,no,177.95
CL-7202,HP-861717,EV-386,accidental damage,2027-07-19,2027-07-27,home,-,-,1,laptop,electronics,2022-09-06,no,1319.26
CL-7202,HP-861717,EV-386,accidental damage,2027-07-19,2027-07-27,home,-,-,2,TV,electronics,2020-08-24,no,452.67
CL-7202,HP-861717,EV-386,accidental damage,2027-07-19,2027-07-27,home,-,-,3,dining table,furniture,2025-07-18,no,666.82
CL-7202,HP-861717,EV-386,accidental damage,2027-07-19,2027-07-27,home,-,-,4,shoes,clothing,2024-02-08,no,480.99
CL-7202,HP-861717,EV-386,accidental damage,2027-07-19,2027-07-27,home,-,-,5,wool rug,rugs,2017-05-29,no,555.02
CL-7202,HP-861717,EV-386,accidental damage,2027-07-19,2027-07-27,home,-,-,6,oil painting,artwork,2020-01-10,no,998.16
CL-7396,HP-382000,EV-256,theft,2028-02-23,2028-03-07,vehicle,no,yes,1,mixer,kitchenware,2019-02-23,no,797.44
CL-7396,HP-382000,EV-256,theft,2028-02-23,2028-03-07,vehicle,no,yes,2,watch,jewellery,2021-02-15,no,92.15
CL-7396,HP-382000,EV-256,theft,2028-02-23,2028-03-07,vehicle,no,yes,3,e-bike,bicycle,2023-01-13,no,961.15
CL-7396,HP-382000,EV-256,theft,2028-02-23,2028-03-07,vehicle,no,yes,4,sculpture,artwork,2023-12-10,no,1119.21
CL-7396,HP-382000,EV-256,theft,2028-02-23,2028-03-07,vehicle,no,yes,5,earrings,jewellery,2022-01-03,no,841.96
CL-8040,HP-407988,EV-964,fire,2027-08-25,2027-09-16,home,-,-,1,cookware set,kitchenware,2023-07-31,no,754.60
CL-8040,HP-407988,EV-964,fire,2027-08-25,2027-09-16,home,-,-,2,saw,tools,2018-02-24,no,872.17
CL-8040,HP-407988,EV-964,fire,2027-08-25,2027-09-16,home,-,-,3,coffee machine,kitchenware,2025-04-28,no,151.79
CL-8040,HP-407988,EV-964,fire,2027-08-25,2027-09-16,home,-,-,4,sofa,furniture,2023-02-09,no,280.99
CL-8040,HP-407988,EV-964,fire,2027-08-25,2027-09-16,home,-,-,5,wool rug,rugs,2027-03-28,no,385.60
CL-8040,HP-407988,EV-964,fire,2027-08-25,2027-09-16,home,-,-,6,wardrobe,furniture,2020-06-04,no,302.83
CL-8040,HP-407988,EV-964,fire,2027-08-25,2027-09-16,home,-,-,7,wool rug,rugs,2022-10-11,no,1108.59
CL-8040,HP-407988,EV-964,fire,2027-08-25,2027-09-16,home,-,-,8,cash,cash,-,no,50.00
CL-8456,HP-899287,EV-515,storm,2027-02-05,2027-02-15,home,-,-,1,cookware set,kitchenware,2026-01-23,no,1195.81
CL-8456,HP-899287,EV-515,storm,2027-02-05,2027-02-15,home,-,-,2,watch,jewellery,2024-02-05,no,368.75
CL-8456,HP-899287,EV-515,storm,2027-02-05,2027-02-15,home,-,-,3,winter coat,clothing,2025-02-04,no,611.14
CL-8456,HP-899287,EV-515,storm,2027-02-05,2027-02-15,home,-,-,4,print,artwork,2025-12-16,no,909.83
CL-8456,HP-899287,EV-515,storm,2027-02-05,2027-02-15,home,-,-,5,shoes,clothing,2022-08-09,no,1014.53
CL-8711,HP-103960,EV-104,accidental damage,2027-07-20,2027-08-13,away,-,-,1,TV,electronics,2020-07-19,no,77.32
CL-8711,HP-103960,EV-104,accidental damage,2027-07-20,2027-08-13,away,-,-,2,tool chest,tools,2022-10-12,yes,100.17
CL-8711,HP-103960,EV-104,accidental damage,2027-07-20,2027-08-13,away,-,-,3,gold ring,jewellery,2019-07-19,no,497.43
CL-8711,HP-103960,EV-104,accidental damage,2027-07-20,2027-08-13,away,-,-,4,earrings,jewellery,2017-08-04,no,983.92
CL-9038,HP-899287,EV-694,accidental damage,2027-12-15,2028-01-10,home,-,-,1,wool rug,rugs,2021-10-07,no,1501.73
CL-9038,HP-899287,EV-694,accidental damage,2027-12-15,2028-01-10,home,-,-,2,bed frame,furniture,2022-03-27,no,459.93
CL-9038,HP-899287,EV-694,accidental damage,2027-12-15,2028-01-10,home,-,-,3,dining table,furniture,2025-09-08,no,1568.30
CL-9038,HP-899287,EV-694,accidental damage,2027-12-15,2028-01-10,home,-,-,4,laptop,electronics,2020-12-11,no,936.36
CL-9038,HP-899287,EV-694,accidental damage,2027-12-15,2028-01-10,home,-,-,5,runner rug,rugs,2020-12-15,no,5145.60
CL-9038,HP-899287,EV-694,accidental damage,2027-12-15,2028-01-10,home,-,-,6,bed frame,furniture,2020-09-26,no,7752.17
CL-9228,HP-103960,EV-793,accidental damage,2027-06-07,2027-06-29,home,-,-,1,suit,clothing,2017-12-14,no,1510.41
CL-9228,HP-103960,EV-793,accidental damage,2027-06-07,2027-06-29,home,-,-,2,coffee machine,kitchenware,2020-05-19,no,568.43
CL-9228,HP-103960,EV-793,accidental damage,2027-06-07,2027-06-29,home,-,-,3,oil painting,artwork,2018-06-07,no,1133.25
CL-9228,HP-103960,EV-793,accidental damage,2027-06-07,2027-06-29,home,-,-,4,drill kit,tools,2024-12-09,yes,597.72
CL-9228,HP-103960,EV-793,accidental damage,2027-06-07,2027-06-29,home,-,-,5,suit,clothing,2023-04-14,no,278.71
CL-9228,HP-103960,EV-793,accidental damage,2027-06-07,2027-06-29,home,-,-,6,tool chest,tools,2019-02-26,yes,1079.87
CL-9228,HP-103960,EV-793,accidental damage,2027-06-07,2027-06-29,home,-,-,7,tool chest,tools,2020-04-08,yes,653.38
CL-9228,HP-103960,EV-793,accidental damage,2027-06-07,2027-06-29,home,-,-,8,shoes,clothing,2018-06-07,no,841.42
CL-9233,HP-103960,EV-151,fire,2027-12-07,2027-12-11,home,-,-,1,wool rug,rugs,2022-08-28,no,537.13
CL-9233,HP-103960,EV-151,fire,2027-12-07,2027-12-11,home,-,-,2,coffee machine,kitchenware,2019-07-17,no,135.52
CL-9233,HP-103960,EV-151,fire,2027-12-07,2027-12-11,home,-,-,3,runner rug,rugs,2018-11-14,no,1462.81
CL-9233,HP-103960,EV-151,fire,2027-12-07,2027-12-11,home,-,-,4,sculpture,artwork,2027-12-07,no,1497.36
CL-9233,HP-103960,EV-151,fire,2027-12-07,2027-12-11,home,-,-,5,wool rug,rugs,2018-12-07,no,449.85
CL-9233,HP-103960,EV-151,fire,2027-12-07,2027-12-11,home,-,-,6,wardrobe,furniture,2019-06-22,no,1456.85
CL-9375,HP-407988,EV-453,theft,2027-12-04,2027-12-04,home,-,-,1,camera,electronics,2024-02-15,no,3329.98
CL-9375,HP-407988,EV-453,theft,2027-12-04,2027-12-04,home,-,-,2,runner rug,rugs,2019-03-30,no,806.09
CL-9375,HP-407988,EV-453,theft,2027-12-04,2027-12-04,home,-,-,3,sofa,furniture,2025-12-04,no,920.30
CL-9375,HP-407988,EV-453,theft,2027-12-04,2027-12-04,home,-,-,4,tool chest,tools,2020-08-08,yes,445.47
CL-9375,HP-407988,EV-453,theft,2027-12-04,2027-12-04,home,-,-,5,games console,electronics,2025-10-20,no,1080.95
CL-9375,HP-407988,EV-453,theft,2027-12-04,2027-12-04,home,-,-,6,runner rug,rugs,2018-08-12,no,493.98
CL-9375,HP-407988,EV-453,theft,2027-12-04,2027-12-04,home,-,-,7,tool chest,tools,2023-12-03,yes,683.94
CL-9785,HP-442238,EV-262,theft,2027-09-26,2027-10-22,home,-,-,1,dining table,furniture,2026-09-26,no,28.48

SETTLEMENTS (settled date per claim):
claim_id,settled_date
CL-1005,2027-11-02
CL-1338,2027-11-28
CL-1353,2028-01-06
CL-1611,2027-09-01
CL-1633,2027-09-02
CL-1770,2028-05-31
CL-1792,2027-11-01
CL-2127,2028-01-04
CL-2612,2027-09-14
CL-4810,2028-06-02
CL-4826,2027-06-19
CL-4956,2027-08-20
CL-5019,2027-12-15
CL-5127,2027-10-31
CL-5463,2028-04-05
CL-5800,2028-02-20
CL-5939,2027-10-06
CL-5976,2027-10-25
CL-6042,2028-02-01
CL-6353,2027-04-10
CL-6486,2027-10-14
CL-6740,2027-05-10
CL-6942,2027-12-07
CL-7202,2027-10-11
CL-7396,2028-05-28
CL-8040,2027-10-03
CL-8456,2027-05-25
CL-8711,2027-11-14
CL-9038,2028-04-11
CL-9228,2027-09-14
CL-9233,2028-02-22
CL-9375,2028-02-28
CL-9785,2027-12-18

CORRECTION NOTICES (74):
notice_id,notice_date,claim_id,item_no,field,new_value
CN-100,2027-09-14,CL-2612,3,claimed,586.81
CN-102,2027-10-01,CL-7202,5,claimed,910.23
CN-104,2027-10-25,CL-1792,1,claimed,1236.38
CN-128,2027-11-07,CL-9785,1,purchase_date,2026-09-27
CN-138,2027-08-29,CL-2612,2,claimed,78.35
CN-160,2027-09-25,CL-5127,2,claimed,561.02
CN-162,2028-05-18,CL-7396,5,claimed,1380.81
CN-174,2027-10-10,CL-5939,1,purchase_date,2026-08-10
CN-183,2028-03-11,CL-7396,4,claimed,917.75
CN-193,2027-08-25,CL-2612,3,claimed,1261.21
CN-196,2028-01-19,CL-9233,4,purchase_date,2027-12-06
CN-197,2027-07-18,CL-4956,3,claimed,189.28
CN-220,2027-08-14,CL-5127,3,purchase_date,2023-03-22
CN-223,2028-05-30,CL-4810,5,claimed,1051.39
CN-234,2027-08-27,CL-4956,3,claimed,88.78
CN-243,2027-09-17,CL-8711,4,claimed,669.07
CN-245,2027-11-28,CL-8711,4,claimed,1643.15
CN-264,2027-11-06,CL-8711,2,claimed,68.12
CN-273,2027-11-22,CL-8711,1,claimed,123.71
CN-284,2027-09-29,CL-7202,5,claimed,765.93
CN-289,2027-09-25,CL-8711,1,claimed,62.63
CN-290,2027-10-23,CL-5976,2,purchase_date,2023-09-06
CN-293,2028-05-22,CL-7396,3,claimed,1086.10
CN-301,2028-05-12,CL-4810,3,claimed,220.94
CN-306,2028-04-05,CL-4810,5,claimed,668.32
CN-308,2028-03-08,CL-7396,3,claimed,1557.06
CN-315,2027-08-26,CL-8711,2,purchase_date,2018-09-03
CN-327,2027-10-23,CL-8711,2,purchase_date,2022-10-13
CN-328,2027-10-11,CL-1005,4,purchase_date,2025-01-30
CN-337,2027-10-26,CL-1792,1,claimed,1761.26
CN-362,2028-03-27,CL-1770,2,claimed,278.49
CN-368,2028-04-21,CL-4810,3,purchase_date,2022-10-01
CN-430,2028-01-16,CL-9233,4,purchase_date,2027-05-21
CN-433,2027-09-26,CL-5976,2,claimed,1168.38
CN-440,2027-11-09,CL-1792,1,purchase_date,2018-03-01
CN-470,2027-09-24,CL-5976,2,purchase_date,2023-08-08
CN-471,2027-10-05,CL-5939,1,purchase_date,2026-01-23
CN-480,2027-09-26,CL-2612,2,claimed,79.60
CN-487,2028-02-16,CL-9233,6,purchase_date,2019-06-23
CN-491,2027-10-14,CL-1005,1,claimed,1167.58
CN-500,2027-11-03,CL-8711,4,claimed,747.78
CN-513,2027-10-17,CL-5976,2,claimed,754.73
CN-539,2028-01-15,CL-9375,6,purchase_date,2018-08-11
CN-552,2027-12-05,CL-5019,1,claimed,3.47
CN-565,2027-09-22,CL-5939,1,claimed,6863.90
CN-581,2027-12-16,CL-9233,3,claimed,716.78
CN-593,2028-05-11,CL-7396,4,claimed,1869.08
CN-603,2027-09-29,CL-5127,2,claimed,590.94
CN-612,2027-10-04,CL-5939,1,claimed,6525.54
CN-670,2028-03-24,CL-4810,7,claimed,368.04
CN-674,2028-06-05,CL-4810,7,claimed,787.92
CN-688,2027-10-19,CL-5127,3,claimed,274.60
CN-699,2028-03-05,CL-4810,3,claimed,266.88
CN-700,2028-03-17,CL-9038,3,claimed,737.10
CN-713,2027-08-26,CL-5127,3,purchase_date,2027-04-29
CN-726,2028-04-16,CL-4810,7,claimed,300.65
CN-729,2027-12-21,CL-9233,6,claimed,728.43
CN-735,2028-05-21,CL-7396,3,purchase_date,2020-11-04
CN-738,2028-02-11,CL-9233,3,purchase_date,2018-04-28
CN-803,2028-04-11,CL-7396,5,claimed,1027.19
CN-824,2027-11-23,CL-9785,1,purchase_date,2025-08-22
CN-843,2027-09-27,CL-5127,2,purchase_date,2024-03-27
CN-847,2027-08-28,CL-5127,2,purchase_date,2024-04-27
CN-850,2028-03-09,CL-9375,6,purchase_date,2017-07-08
CN-868,2028-02-21,CL-9233,6,claimed,1063.50
CN-887,2027-09-16,CL-5939,5,purchase_date,2021-08-13
CN-888,2027-11-22,CL-1005,1,claimed,1025.19
CN-920,2027-11-09,CL-8711,1,claimed,50.26
CN-936,2027-10-01,CL-7202,1,purchase_date,2022-09-07
CN-959,2027-08-16,CL-7202,1,purchase_date,2022-02-18
CN-965,2027-10-25,CL-1792,1,purchase_date,2017-09-12
CN-969,2027-10-07,CL-1005,1,claimed,1637.46
CN-991,2028-02-11,CL-9233,3,purchase_date,2016-09-05
CN-992,2027-11-12,CL-5976,2,claimed,696.67

Answer format: {"claims": {"CL-1234": {"decision": "partial", "payable": 1234.56, "reason": "SUBLIMIT", "interest": 12.34}, ...}, "policies": {"HP-123456": {"paid": 5000.00, "interest": 12.34, "remaining_si": 15000.00}, ...}}  One entry for EVERY claim id and EVERY policy number. decision is one of: pay, partial, decline, refer. payable and interest in dollars to the cent (0 for decline/refer). reason is one of: OK, SUBLIMIT, ITEM_EXCLUDED, SUM_INSURED, BELOW_EXCESS, LAPSED, PERIL_NOT_COVERED, WAITING_PERIOD, LATE_LODGEMENT, HIGH_VALUE.

Reply with ONE JSON object only (no markdown fences, no text before or after), exactly in the format asked.

Correct answer (fixed before the run)

{
 "claims": {
  "CL-6353": {
   "decision": "partial",
   "payable": 1198.3,
   "reason": "ITEM_EXCLUDED",
   "interest": 15.36
  },
  "CL-8456": {
   "decision": "partial",
   "payable": 1900.97,
   "reason": "SUBLIMIT",
   "interest": 48.75
  },
  "CL-6740": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "WAITING_PERIOD",
   "interest": 0.0
  },
  "CL-4826": {
   "decision": "partial",
   "payable": 1444.03,
   "reason": "ITEM_EXCLUDED",
   "interest": 6.65
  },
  "CL-4956": {
   "decision": "pay",
   "payable": 911.68,
   "reason": "OK",
   "interest": 17.38
  },
  "CL-9228": {
   "decision": "partial",
   "payable": 1626.43,
   "reason": "ITEM_EXCLUDED",
   "interest": 29.94
  },
  "CL-1611": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "BELOW_EXCESS",
   "interest": 0.0
  },
  "CL-7202": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "LAPSED",
   "interest": 0.0
  },
  "CL-5127": {
   "decision": "pay",
   "payable": 1177.5,
   "reason": "OK",
   "interest": 28.65
  },
  "CL-1633": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "ITEM_EXCLUDED",
   "interest": 0.0
  },
  "CL-2612": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "PERIL_NOT_COVERED",
   "interest": 0.0
  },
  "CL-8711": {
   "decision": "partial",
   "payable": 836.48,
   "reason": "ITEM_EXCLUDED",
   "interest": 19.8
  },
  "CL-5939": {
   "decision": "partial",
   "payable": 5385.73,
   "reason": "SUBLIMIT",
   "interest": 17.71
  },
  "CL-1005": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "BELOW_EXCESS",
   "interest": 0.0
  },
  "CL-8040": {
   "decision": "partial",
   "payable": 2127.78,
   "reason": "ITEM_EXCLUDED",
   "interest": 0.0
  },
  "CL-5976": {
   "decision": "partial",
   "payable": 1089.74,
   "reason": "ITEM_EXCLUDED",
   "interest": 5.02
  },
  "CL-6486": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "BELOW_EXCESS",
   "interest": 0.0
  },
  "CL-6942": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "BELOW_EXCESS",
   "interest": 0.0
  },
  "CL-9785": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "BELOW_EXCESS",
   "interest": 0.0
  },
  "CL-1792": {
   "decision": "partial",
   "payable": 1126.77,
   "reason": "ITEM_EXCLUDED",
   "interest": 0.0
  },
  "CL-1338": {
   "decision": "pay",
   "payable": 3177.34,
   "reason": "OK",
   "interest": 1.04
  },
  "CL-1353": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "ITEM_EXCLUDED",
   "interest": 0.0
  },
  "CL-2127": {
   "decision": "partial",
   "payable": 2443.57,
   "reason": "SUBLIMIT",
   "interest": 23.3
  },
  "CL-5019": {
   "decision": "pay",
   "payable": 2.08,
   "reason": "OK",
   "interest": 0.0
  },
  "CL-9375": {
   "decision": "partial",
   "payable": 3442.19,
   "reason": "SUBLIMIT",
   "interest": 73.56
  },
  "CL-9233": {
   "decision": "partial",
   "payable": 537.09,
   "reason": "SUM_INSURED",
   "interest": 9.18
  },
  "CL-5463": {
   "decision": "pay",
   "payable": 2515.05,
   "reason": "OK",
   "interest": 58.71
  },
  "CL-6042": {
   "decision": "refer",
   "payable": 0.0,
   "reason": "LATE_LODGEMENT",
   "interest": 0.0
  },
  "CL-9038": {
   "decision": "refer",
   "payable": 0.0,
   "reason": "HIGH_VALUE",
   "interest": 0.0
  },
  "CL-5800": {
   "decision": "partial",
   "payable": 3524.58,
   "reason": "SUBLIMIT",
   "interest": 0.0
  },
  "CL-1770": {
   "decision": "partial",
   "payable": 2975.07,
   "reason": "ITEM_EXCLUDED",
   "interest": 71.4
  },
  "CL-4810": {
   "decision": "refer",
   "payable": 0.0,
   "reason": "LATE_LODGEMENT",
   "interest": 0.0
  },
  "CL-7396": {
   "decision": "decline",
   "payable": 0.0,
   "reason": "ITEM_EXCLUDED",
   "interest": 0.0
  }
 },
 "policies": {
  "HP-442238": {
   "paid": 0.0,
   "interest": 0.0,
   "remaining_si": 40000.0
  },
  "HP-437148": {
   "paid": 2975.07,
   "interest": 71.4,
   "remaining_si": 37024.93
  },
  "HP-818586": {
   "paid": 0.0,
   "interest": 0.0,
   "remaining_si": 9000.0
  },
  "HP-103960": {
   "paid": 3000.0,
   "interest": 58.92,
   "remaining_si": 0.0
  },
  "HP-295035": {
   "paid": 911.68,
   "interest": 17.38,
   "remaining_si": 49088.32
  },
  "HP-382000": {
   "paid": 5622.99,
   "interest": 24.34,
   "remaining_si": 54377.01
  },
  "HP-764334": {
   "paid": 7217.13,
   "interest": 87.36,
   "remaining_si": 12782.87
  },
  "HP-861717": {
   "paid": 1444.03,
   "interest": 6.65,
   "remaining_si": 38555.97
  },
  "HP-407988": {
   "paid": 12045.44,
   "interest": 96.29,
   "remaining_si": 37954.56
  },
  "HP-899287": {
   "paid": 4226.04,
   "interest": 64.11,
   "remaining_si": 45773.96
  }
 }
}

Model reply (final text as stored)

{"claims":{"CL-1005":{"decision":"decline","payable":0,"reason":"BELOW_EXCESS","interest":0},"CL-1338":{"decision":"pay","payable":3177.34,"reason":"OK","interest":1.04},"CL-1353":{"decision":"decline","payable":0,"reason":"ITEM_EXCLUDED","interest":0},"CL-1611":{"decision":"decline","payable":0,"reason":"BELOW_EXCESS","interest":0},"CL-1633":{"decision":"decline","payable":0,"reason":"ITEM_EXCLUDED","interest":0},"CL-1770":{"decision":"partial","payable":2975.07,"reason":"ITEM_EXCLUDED","interest":70.42},"CL-1792":{"decision":"partial","payable":1126.77,"reason":"ITEM_EXCLUDED","interest":0},"CL-2127":{"decision":"partial","payable":2443.57,"reason":"SUBLIMIT","interest":23.30},"CL-2612":{"decision":"decline","payable":0,"reason":"PERIL_NOT_COVERED","interest":0},"CL-4810":{"decision":"refer","payable":0,"reason":"LATE_LODGEMENT","interest":0},"CL-4826":{"decision":"partial","payable":1444.03,"reason":"ITEM_EXCLUDED","interest":6.65},"CL-4956":{"decision":"pay","payable":911.68,"reason":"OK","interest":17.38},"CL-5019":{"decision":"pay","payable":2.08,"reason":"OK","interest":0.00},"CL-5127":{"decision":"pay","payable":1177.50,"reason":"OK","interest":28.65},"CL-5463":{"decision":"pay","payable":2515.04,"reason":"OK","interest":58.71},"CL-5800":{"decision":"partial","payable":3524.59,"reason":"SUBLIMIT","interest":0},"CL-5939":{"decision":"partial","payable":5385.73,"reason":"SUBLIMIT","interest":17.71},"CL-5976":{"decision":"partial","payable":1089.74,"reason":"ITEM_EXCLUDED","interest":5.02},"CL-6042":{"decision":"refer","payable":0,"reason":"LATE_LODGEMENT","interest":0},"CL-6353":{"decision":"partial","payable":1198.30,"reason":"ITEM_EXCLUDED","interest":15.36},"CL-6486":{"decision":"decline","payable":0,"reason":"BELOW_EXCESS","interest":0},"CL-6740":{"decision":"decline","payable":0,"reason":"WAITING_PERIOD","interest":0},"CL-6942":{"decision":"decline","payable":0,"reason":"BELOW_EXCESS","interest":0},"CL-7202":{"decision":"decline","payable":0,"reason":"LAPSED","interest":0},"CL-7396":{"decision":"decline","payable":0,"reason":"ITEM_EXCLUDED","interest":0},"CL-8040":{"decision":"partial","payable":2127.78,"reason":"ITEM_EXCLUDED","interest":0},"CL-8456":{"decision":"partial","payable":1900.97,"reason":"SUBLIMIT","interest":48.75},"CL-8711":{"decision":"partial","payable":836.48,"reason":"ITEM_EXCLUDED","interest":19.80},"CL-9038":{"decision":"refer","payable":0,"reason":"HIGH_VALUE","interest":0},"CL-9228":{"decision":"partial","payable":1626.43,"reason":"ITEM_EXCLUDED","interest":29.94},"CL-9233":{"decision":"partial","payable":537.09,"reason":"SUM_INSURED","interest":9.18},"CL-9375":{"decision":"partial","payable":3442.19,"reason":"SUBLIMIT","interest":73.56},"CL-9785":{"decision":"decline","payable":0,"reason":"BELOW_EXCESS","interest":0}},"policies":{"HP-442238":{"paid":0.00,"interest":0.00,"remaining_si":40000.00},"HP-437148":{"paid":2975.07,"interest":70.42,"remaining_si":37024.93},"HP-818586":{"paid":0.00,"interest":0.00,"remaining_si":9000.00},"HP-103960":{"paid":3000.00,"interest":58.92,"remaining_si":0.00},"HP-295035":{"paid":911.68,"interest":17.38,"remaining_si":49088.32},"HP-382000":{"paid":5622.99,"interest":24.34,"remaining_si":54377.01},"HP-764334":{"paid":7217.13,"interest":87.36,"remaining_si":12782.87},"HP-861717":{"paid":1444.03,"interest":6.65,"remaining_si":38555.97},"HP-407988":{"paid":12045.44,"interest":96.29,"remaining_si":37954.56},"HP-899287":{"paid":4226.04,"interest":64.11,"remaining_si":45773.96}}}

Task T-ed79c4460f. Answer fingerprint 6d695ff883db4eb2f0eea387a2dd25ac5d994396045cb554b92cd2dbfe622c10

Payroll · Claude Haiku 5.5 Cut off: no answer at all

No answer. The reply ran past the answer length limit after 485 seconds, so there was nothing to mark. It counts as wrong and is shown in the cut-off column.

Wrong fields: none could be marked (no answer).

The task, exactly as the model saw it

You are the payroll officer for Pioneer Farms (a fictional company). Work out each employee's GROSS pay for one week (no tax, no super) by the rules below. All rules are invented for this exercise.

PAY WEEK: Mon 2027-04-26, Tue 2027-04-27, Wed 2027-04-28, Thu 2027-04-29, Fri 2027-04-30, Sat 2027-05-01, Sun 2027-05-02.
PUBLIC HOLIDAY: Wed 2027-04-28 (the whole calendar day 00:00-24:00).

TIMESHEET RULES: Each timesheet row is one shift. A shift belongs to the date it STARTS on. Shifts that START outside the pay week are ignored entirely, even if they end inside it; a shift that starts inside the pay week is paid in full even if it ends after it. All times are on the quarter hour. If a shift's end time is not later than its start time, the shift ends on the next day. Times may be written 07:30, 0730, 7:30am or 7.30pm (12:00am = midnight, 12:00pm = noon). Dates may be written YYYY-MM-DD, DD/MM/YYYY or '4 Mar' (the year is the one that puts the date inside the pay week). Rows with status VOID are cancelled entries: ignore them completely. Ignore rows whose employee ID is not in the staff table.

AWARD (Tools Services Award (fictional) clause book 9.1):
A1 Base rate. Hourly base rate by classification level: Level 1 $26.05, Level 2 $28.59, Level 3 $29.94, Level 4 $32.33, Level 5 $34.44. Employees under 21 are paid a percentage of the base rate for their level: age 16-17 = 60%, 18 = 70%, 19 = 80%, 20 = 90%; this junior rate is rounded to cents (half up) before any other calculation. Call the resulting hourly rate B.
A2 Unpaid break. A shift whose length (start to end) is more than 5 hours has a 30-minute unpaid break; a shift longer than 10 hours has a 60-minute unpaid break instead. The break always starts exactly 4 hours after the shift start. Break minutes are not worked and not paid. Worked time = shift length minus the break.
A3 Daily overtime. In each shift, worked time after the first 10 worked hours of that shift is overtime (this applies to every employee type, casuals included).
A4 Weekly overtime (full-time and part-time only; never casuals). Weekly limit of ordinary hours: 38 hours for full-time; the contracted hours shown in the staff table for part-time. Go through the employee's shifts in time order, minute by minute: once the ordinary worked time in the week has reached the limit, every further worked minute is overtime. Minutes that are daily overtime under A3 are NOT ordinary, are never counted towards the limit and are never paid twice. Weekend and public-holiday minutes that are not overtime are ordinary and do count towards the limit.
A5 Overtime rate. In each shift, the first 3 hours of overtime (daily and weekly overtime counted together, in time order) are paid at 1.5x, any further overtime in that same shift at 2.0x. Count every overtime minute towards these hours even when a higher day penalty wins under A7.
A6 Day penalties. Worked minutes on a Saturday 1.25x, on a Sunday 2x, on the public holiday 2.5x. The calendar date of each minute decides (a shift crossing midnight changes day at 00:00). Other days 1.0x.
A7 Precedence. For every worked minute only the HIGHEST single multiplier among 1.0x, its overtime rate (A5) and its day penalty (A6) applies. Multipliers never add up and never multiply together.
A8 Night loading (this one STACKS). Every worked minute between 22:00 and 06:00 earns an extra 15% of B per hour ON TOP of whatever the A7 multiplier gives - EXCEPT minutes on the public holiday, which get no night loading.
A9 Casual loading. Casuals (type CAS) get a 25% loading applied AFTER penalties: the loading is never multiplied, so each worked hour pays B x multiplier + 0.25 x B. Night loading is always a percentage of B, never of the casual rate.
A10 Minimum engagement. If a casual's worked time in a shift is less than 3 hours, the missing time up to 3 hours is ALSO paid, at B x 1.25 per hour (no penalty, overtime or night loading). This extra time is not worked time for any other clause.
A11 Allowances (flat amounts, never multiplied or loaded). Meal allowance $17.42 for each shift that has MORE than 1 hour of overtime (any kind) in it. Vehicle allowance $0.86 per km in the km column, capped at $66.00 per employee per week. Laundry allowance $2.15 per paid shift, capped at $8.00 per employee per week.

ENTERPRISE AGREEMENT (Pioneer Farms Enterprise Agreement, fictional). It covers ONLY employees with EA = Y in the staff table. For them it replaces ONLY the following award clauses, even where the result is less favourable: A1 base rates (EA rates: Level 1 $27.87, Level 2 $29.88, Level 3 $30.99, Level 4 $34.21, Level 5 $35.75; junior percentages still apply, to the EA rate); A3 daily overtime starts after the first 8 worked hours of a shift; A6 Sunday penalty 1.75x (Saturday and public holiday penalties stay as in the award); A2 break: a shift longer than 6 hours has one 45-minute unpaid break starting exactly 4 hours after the shift start, and no other break. Every other award clause still applies to EA employees unchanged.

CALCULATION: gross = sum over all worked minutes of (hourly pay for that minute / 60), plus any minimum-engagement pay, plus allowances. Do NOT round per shift or per line: round each employee's weekly gross ONCE to cents (half up). total = sum of the rounded employee gross amounts.

STAFF (14; FT = full-time, PT = part-time, CAS = casual):
emp_id,name,type,level,age,EA,contracted_hours
E2439,Vik Costa,FT,2,20,Y,
E2708,Vik Tanaka,CAS,1,45,Y,
E311,Ella Hale,PT,2,34,N,30
E1691,Jon Morris,PT,5,20,N,22.5
E3582,Ava Lopez,FT,4,19,N,
E2540,Raj Zhou,FT,4,27,Y,
E8975,Omar Novak,PT,2,39,Y,32
E542,Isla Rossi,FT,2,42,N,
E824,Jai Evans,FT,4,19,N,
E5813,Gus Young,CAS,4,30,N,
E6427,Xin Gupta,PT,2,53,Y,24
E9311,Uma Weber,FT,2,19,N,
E5759,Gus Evans,CAS,2,34,N,
E4410,Wes Chen,FT,2,18,Y,

TIMESHEET (60 rows):
row,emp_id,date,start,end,km,status
T001,E824,2 May,8.00am,1830,85.5,OK
T002,E3582,28/04/2027,10.45am,7.15pm,,OK
T003,E5813,2027-05-01,11.30am,2.00pm,40,OK
T004,E311,26/04/2027,23:00,7.45am,42,OK
T005,E824,2027-04-28,5.30pm,05:15,,OK
T006,E8975,26/04/2027,0845,12:45,,OK
T007,E5813,28/04/2027,11:00am,4:45pm,,OK
T008,E2540,2027-04-28,10.15am,2030,,OK
T009,E3582,29/04/2027,7.45am,7:45pm,,OK
T010,E311,25/04/2027,9.45pm,05:45,,OK
T011,E3582,26 Apr,5.15am,17:00,46.9,OK
T012,E4410,29 Apr,6.00am,15:30,,VOID
T013,E2439,28/04/2027,6.30am,16:15,,OK
T014,E311,28 Apr,0600,1445,,OK
T015,E6427,2027-04-30,0530,11:30am,,OK
T016,E5813,26/04/2027,0745,1100,,OK
T017,E311,1 May,11:45am,1945,,OK
T018,E3582,2 May,10:00,7.30pm,,OK
T019,E4410,28 Apr,6.45am,15:30,,VOID
T020,E2439,2027-04-27,09:45,8:00pm,24.4,OK
T021,E5735,30/04/2027,06:45,1545,,OK
T022,E8975,27 Apr,7:15am,1400,,OK
T023,E2540,30 Apr,2015,06:30,127.9,OK
T024,E9311,26 Apr,10:45pm,06:45,42,OK
T025,E2708,02/05/2027,0545,2:30pm,107,OK
T026,E6427,2027-04-26,10:00,16:45,,OK
T027,E9311,28/04/2027,0715,3.15pm,,OK
T028,E2439,29 Apr,11:15,2100,88,OK
T029,E6427,02/05/2027,0630,12.15pm,79,OK
T030,E824,30 Apr,2045,9:00am,,OK
T031,E8975,26 Apr,8:45am,1245,,VOID
T032,E1691,2027-04-29,9.45pm,2.00am,,OK
T033,E2708,30/04/2027,8.45pm,04:45,,VOID
T034,E2708,2027-04-27,8:30pm,4:00am,,OK
T035,E542,1 May,19:15,3.30am,,OK
T036,E311,02/05/2027,12:00pm,1815,,OK
T037,E5759,29 Apr,8:00am,10.30am,,OK
T038,E5759,2027-05-02,1900,0315,58.7,OK
T039,E1558,2027-04-30,0600,1:15pm,,OK
T040,E3582,2027-04-30,09:45,6:00pm,,OK
T041,E5759,26 Apr,11:15am,2.00pm,,OK
T042,E2540,2027-05-02,8.45am,1945,,OK
T043,E5813,1 May,1130,14:00,40,VOID
T044,E2708,28/04/2027,5.15pm,12.15am,,OK
T045,E2708,30/04/2027,20:45,4:45am,,OK
T046,E2439,2027-04-30,1015,2030,,OK
T047,E9311,2 May,08:45,6.15pm,,OK
T048,E8975,28/04/2027,1930,2.30am,,OK
T049,E5813,2027-05-01,11:30,1.30pm,40,VOID
T050,E5759,2027-04-30,6:00am,10:30,13.1,OK
T051,E5759,27/04/2027,0745,2:45pm,,OK
T052,E2439,2 May,1115,9:45pm,,OK
T053,E6427,28/04/2027,8.00am,5.15pm,130,OK
T054,E9311,2027-05-01,1115,7.30pm,,OK
T055,E824,2027-05-03,09:00,16:30,,OK
T056,E542,29 Apr,10:00pm,7.15am,,OK
T057,E1691,27 Apr,10.30am,5.45pm,68.9,OK
T058,E2540,27/04/2027,0830,16:45,,OK
T059,E1691,2027-04-29,9:45pm,2:00am,,VOID
T060,E824,27/04/2027,11.45am,2200,,OK

Answer format: {"gross": {"E1234": 1234.56, ...}, "total": 12345.67}  List EVERY employee in the staff table (0.00 if nothing is payable). Amounts in dollars rounded to cents.

Reply with ONE JSON object only (no markdown fences, no text before or after), exactly in the format asked.

Correct answer (fixed before the run)

{
 "gross": {
  "E2439": 2001.84,
  "E2708": 1675.48,
  "E311": 1494.35,
  "E1691": 423.15,
  "E3582": 1836.84,
  "E2540": 2233.17,
  "E8975": 681.36,
  "E542": 660.08,
  "E824": 1721.25,
  "E5813": 780.4,
  "E6427": 1387.84,
  "E9311": 1300.83,
  "E5759": 1103.28,
  "E4410": 0.0
 },
 "total": 17299.87
}

Model reply (final text as stored)

(empty: no reply came back)

Task T-e8336112d5. Answer fingerprint 1035fe7925d56bc87f5831854f134962ad78b2fe3b3837f78e00d9f5b7e1b053

How we test, in plain words

  1. Fresh tasks every round. Every task is new, so a model cannot have seen it in training.

  2. Hidden answers, fixed first. Each task has one exact answer, fingerprinted and time-stamped before any model sees it.

  3. Marked by code, not by another AI. A task counts as right when every field is right. A second, separate check confirms every answer.

  4. Rules written down first. Pass bars, task counts, model settings and budgets are fixed and fingerprinted before any result.

  5. Same instructions for every model. One fixed format line and one fixed reminder, for everyone alike.

  6. Honest numbers. Every share has a 95% range (Wilson score interval: Wilson 1927; Brown, Cai and DasGupta 2001). We publish misses, gaps and the checks we failed.

Why we work this way: public test sets leak into training data, so a score can measure memory instead of skill (Magar and Schwartz, ACL 2022). AI judges show known biases such as favouring the first or the longer answer (Zheng et al., NeurIPS 2023), so we mark by code. Results files are fingerprinted with SHA-256 (NIST FIPS 180-4) and signed with Ed25519.

What this does not show

Download and check the results

One file holds every board cell, all 1194 scored attempts (anonymous task ids, right or wrong, share of fields right, cut off or not, answer fingerprint), the repeat run and the four full tasks above.

Results file (JSON, 442 KB)

SHA-256: eec7b20c4af11b4ab8ae4594ccbdf7e1cbc39503f278fac2d6cfdf94b8c279d7

Ed25519 signature: signature file · public key: key file (FG5zHzd6m88JxTMOath9cc6httAaA1kuukDS7rTa5mU=)

To check it yourself:

sha256sum avanciq-scoreboard-r6lite.json
base64 -d avanciq-scoreboard-r6lite.json.sig > sig.bin
openssl pkeyutl -verify -pubin -inkey avanciq-board-key.pem -rawin -in avanciq-scoreboard-r6lite.json -sigfile sig.bin

The round 5 file stays online: round 5 results (signature).

Test your own AI

Using an AI model or agent for payroll, finance, claims or operations? Tell us what it does. We will reply with which task families fit your work and what a private test would show. No payment is taken on this page.

For example: a model name, an agent product, or "our own agent with tools".

Updates

We plan to re-run the scoreboard about once a month with fresh tasks, more models and harder families. Each round gets a new date, rules fingerprint and signed results file, and older rounds stay online.

Questions

Why is the score so much lower than on public benchmarks?

Public tests are fixed sets of questions, and many have been around long enough to leak into training data. Our tasks are new every round and are marked on every field, so 'almost right' counts as wrong. They also measure a different skill: long, exact business calculations.

Is it fair to the models?

Every rule and every rounding point is written in the task, so a careful person with a calculator can get 100%. You can read four used tasks in full above. Every model gets the same instructions and the same one reminder if it forgets to answer.

What does 'cut off / no answer' mean?

The reply ran past a length or time limit, the call failed, or the final reply had no answer we could read. We count it as wrong, as our rules said before the run, and show it in its own column so you can see how much of a score is about answering at all.

Who marks the answers?

Code, not people and not another AI. Each task has one correct answer, fixed and fingerprinted before any model sees it. A second, separately written check confirms each answer from the task text.

Why are some models missing?

We list what we ran. GPT and Gemini need paid keys that we do not hold yet. Open models ran on a hosting provider; we show the settings next to each row.

Can I test my own AI or agent?

Yes. Use the form below. We reply by email with what we can test for you. This page is a preview, so nothing is charged and no automatic emails are sent.