Skip to content

How well it reads

Measured on every release, on the same test sets, for every category.

Whole line right
85.5%
Category right
86.6%
Merchant right
95.1%
Precision
99.2%
Coverage
87.3%
F1
92.5%

On 963 transactions it never saw, measured 5 Nov 2026, under the balanced setting. Each category is held to 95% precision from 20 answers on a test set, and one below it is marked; under 20, its precision is shown as a count. Under the complete setting, which gives every line a category as services that categorise everything do, 92.4% of all lines are right.

The setting

A lender chooses how far to trust Statement. Strict gives only what a rule reads. Balanced, the default, adds the bank’s merchant code where a connection sent one, the business a register of Australian places lists in the line’s suburb, and a modelled reading where it keeps its category at 95% precision or better. Broad holds each category to 90%. Complete gives every line a category, guessing where nothing read it, so Statement can be compared with services that categorise everything; its guesses are marked and it has no precision floor. The thresholds were set on lines kept apart from these test sets.

Test setPrecisionCoverageAll lines rightF1Weakest categoryModelled answers
Strict The rules alone. Every answer is a name or a kind of business a rule read.
Transactions it never saw99.4%74.1%73.7%84.7% Shopping 96.4%—
Real payee names100.0%59.8%59.8%74.8% Transport and fuel 100.0%—
Balanced (default) The rules, the bank’s merchant code where a connection sent one, a register of Australian places, and a modelled reading where it keeps its category at 95% precision or better.
Transactions it never saw99.2%87.3%86.6%92.5% Health 97.1%24 of 26 right
Real payee names100.0%70.1%70.1%82.4% Transport and fuel 100.0%12 of 12 right
Broad More answers. The bank’s merchant code where a connection sent one, a register of Australian places, and a modelled reading where it keeps its category at 90% precision or better.
Transactions it never saw99.0%89.6%88.7%93.5% Health 97.1%44 of 48 right
Real payee names99.4%71.3%70.9%82.7% Entertainment and subscriptions 94.9%21 of 26 right
Complete Every line gets a category. Read as broad reads, and where nothing read a line, the model’s best guess, marked as one: money out as a spending line, money in as a transfer. Never income, a commitment or gambling on a guess, and not held to a precision floor.
Transactions it never saw92.4%100.0%92.4%92.4% Eating out and takeaway 83.3%44 of 48 right
Real payee names75.3%100.0%75.3%75.3% Eating out and takeaway 43.0%21 of 26 right
Precision against coverage for each setting75%80%85%90%95%100%50%60%70%80%90%100%coverageTransactions it never saw, Strict: precision 99.4%, coverage 74.1%Transactions it never saw, Balanced (default): precision 99.2%, coverage 87.3%Transactions it never saw, Broad: precision 99.0%, coverage 89.6%Transactions it never saw, Complete: precision 92.4%, coverage 100.0%Real payee names, Strict: precision 100.0%, coverage 59.8%Real payee names, Balanced (default): precision 100.0%, coverage 70.1%Real payee names, Broad: precision 99.4%, coverage 71.3%Real payee names, Complete: precision 75.3%, coverage 100.0%
  • Transactions it never saw
  • Real payee names
Precision (up) against coverage (across), one point per setting: strict on the left, complete on the right, the default larger. Measured, not drawn by hand.

The line, its category and its merchant

A line is two answers: what the money was for, and who was paid. Each is measured on its own, and the line as a whole.

Transactions it never saw: each line wholly right, then its category and its merchant

SettingWhole line rightCategory rightMerchant right
Strict72.6%73.7%99.4% precise95.1%99.2% precise
Balanced (default)85.5%86.6%99.2% precise95.1%99.2% precise
Broad87.5%88.7%99.0% precise95.1%99.2% precise
Complete91.1%92.4%92.4% precise95.1%99.2% precise

Whole line: the category right and, where the line has a merchant, the merchant named right, of all 963 lines. Category: of every line, a line it declines counted as wrong. Merchant: of the 366 lines whose label names a business. Precise: of the answers it gives, the share right.

Real payee names: each line wholly right, then its category and its merchant

SettingWhole line rightCategory rightMerchant right
Strict43.1%59.8%100.0% precise43.8%98.8% precise
Balanced (default)52.2%70.1%100.0% precise52.9%98.7% precise
Broad52.2%70.9%99.4% precise52.9%98.7% precise
Complete52.3%75.3%75.3% precise52.9%98.7% precise

Whole line: the category right and, where the line has a merchant, the merchant named right, of all 1,143 lines. Category: of every line, a line it declines counted as wrong. Merchant: of the 1,143 lines whose label names a business. Precise: of the answers it gives, the share right.

Counted by household

779 of the 963 transactions it never saw come from one source, so a figure counted by line is mostly that source. Counted by household, each source weighs at most 20 lines and that one is 16% of the figure. Every line still counts.

SettingPrecision
by line
Precision
by household
Coverage
by line
Coverage
by household
Transactions it never saw 14 sources, each counted as at most 20 lines
Strict99.4%97.7%74.1%81.6%
Balanced (default)99.2%97.7%87.3%85.3%
Broad99.0%97.7%89.6%86.5%
Complete92.4%88.1%100.0%100.0%

Test sets

Test setPrecisionCoverageRecallF1F1 since first release
Transactions it never saw 99.2%87.3% 86.6%92.5% +24.5 pts

963 labelled transactions from public datasets, held out while the rules were written. The labels follow this taxonomy; 41 made before four of its decisions were brought into line, as the bank’s-words set’s were. Payee named on 54.7%. Measured 5 Nov 2026.

Real payee names 100.0%70.1% 70.1%82.4% +50.8 pts

1,143 Australian businesses from public registers and map data, each with a right answer. Payee named on 52.9%. Measured 5 Nov 2026.

The bank’s own words not independent 99.8%81.2% 81.0%89.5% +35.5 pts

680 lines from 14 banks. The rules were written from them, so this checks nothing was lost; it does not measure accuracy. 46 lines that should not be read were left unread, except 3. Measured 5 Nov 2026.

BPAY billers not independent 98.7%65.9% 65.0%78.4% +71.9 pts

6,308 billers’ short names as a bank prints them, against their full registered names. Agreement, not correctness. Measured 5 Nov 2026.

F1 on each test set, release by release0%25%50%75%100%19 Sept20 Sept27 Sept30 Sept3 Oct4 Oct23 Oct28 Oct29 Oct5 Nov
  • Transactions it never saw 92.5%
  • Real payee names 82.4%
  • The bank’s own words 89.5%
  • BPAY billers 78.4%
F1 on each test set, release by release, with the latest release’s figure. Every release is scored on today’s test sets, so the lines compare.

By category

F1 and the number of lines in each test set. Open a category for a few of its lines as statements write them, for precision, coverage and recall, and for what the wrong answers were labelled.

CategoryTransactions it never saw
F1 · lines
Real payee names
F1 · lines
The bank’s own words
F1 · lines
Salary or wages too few · 6—92.6% · 29
Examples, precision, coverage and recall
  • SALARY ACME PTY LTD WAGESMoney in · read by a word for its kind
  • DIRECT CREDIT 019283 NORTHWIND LOGISTICS PAYROLLMoney in · read by a word for its kind
  • PAY/SALARY FROM HARBOUR FREIGHT PTY LTDMoney in · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 66 of 6100.0%100.0%100.0%
The bank’s own words 29100.0%89.7%86.2%92.6%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw6 of 66 of 6—
Balanced (default)Transactions it never saw6 of 66 of 6—
BroadTransactions it never saw6 of 66 of 6—
CompleteTransactions it never saw6 of 66 of 6—
Government benefit —90.9% · 24too few · 9
Examples, precision, coverage and recall
  • CENTRELINK DIRECT CREDITMoney in · read by its name
  • SERVICES AUSTRALIA FAMILY TAX BENEFITMoney in · read by its name
  • DVA PENSION PAYMENTMoney in · read by its name
Test setLinesPrecisionCoverageRecallF1
Real payee names 24100.0%83.3%83.3%90.9%
The bank’s own words too few to judge 99 of 9100.0%100.0%100.0%
SettingTest setPrecisionCoverageModelled, right
StrictReal payee names100.0%83.3%—
Balanced (default)Real payee names100.0%83.3%—
BroadReal payee names100.0%83.3%—
CompleteReal payee names100.0%100.0%—
Other income too few · 8—66.7% · 64
Examples, precision, coverage and recall
  • CREDIT INTERESTMoney in · read by a word for its kind
  • ATO TAX REFUNDMoney in · read by its name
  • DIVIDEND NORTHWIND HOLDINGSMoney in · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 85 of 662.5%62.5%71.4%
Wrong answers here: 1 labelled mortgage repayment.
The bank’s own words 64100.0%50.0%50.0%66.7%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw5 of 65 of 8—
Balanced (default)Transactions it never saw5 of 65 of 8—
BroadTransactions it never saw5 of 65 of 8—
CompleteTransactions it never saw5 of 68 of 8—
Loan or advance received ——too few · 2
Examples, precision, coverage and recall
  • LOAN DRAWDOWNMoney in · read by its name
  • PERSONAL LOAN PROCEEDSMoney in · read by its name
  • LOAN ADVANCE 88213Money in · read by its name
Test setLinesPrecisionCoverageRecallF1
The bank’s own words too few to judge 22 of 2100.0%100.0%100.0%
Rent too few · 4too few · 26too few · 15
Examples, precision, coverage and recall
  • RENT PAYMENT RAY WHITE BALMAINMoney out · read by a word for its kind
  • BPAY RENT HARBOUR REAL ESTATEMoney out · read by a word for its kind
  • RENT OAKWOOD PROPERTYMoney out · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 44 of 4100.0%100.0%100.0%
Real payee names too few to judge 2611 of 1142.3%42.3%59.5%
The bank’s own words too few to judge 1513 of 1386.7%86.7%92.9%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw4 of 44 of 4—
StrictReal payee names9 of 934.6%—
Balanced (default)Transactions it never saw4 of 44 of 4—
Balanced (default)Real payee names11 of 1142.3%—
BroadTransactions it never saw4 of 44 of 4—
BroadReal payee names12 of 1246.2%1 of 1
CompleteTransactions it never saw4 of 44 of 4—
CompleteReal payee names13 of 14100.0%1 of 1
Mortgage repayment too few · 397.6% · 21too few · 2
Examples, precision, coverage and recall
  • HOME LOAN REPAYMENT 4512Money out · read by a word for its kind
  • MORTGAGE REPAYMENT DIRECT DEBITMoney out · read by a word for its kind
  • LOAN REPAYMENT HOME LOAN 88213Money out · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 32 of 2100.0%66.7%80.0%
Real payee names 21100.0%95.2%95.2%97.6%
The bank’s own words too few to judge 21 of 150.0%50.0%66.7%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw2 of 23 of 3—
StrictReal payee names100.0%95.2%—
Balanced (default)Transactions it never saw2 of 23 of 3—
Balanced (default)Real payee names100.0%95.2%—
BroadTransactions it never saw2 of 23 of 3—
BroadReal payee names100.0%95.2%—
CompleteTransactions it never saw2 of 23 of 3—
CompleteReal payee names100.0%100.0%—
Strata and body corporate ———

Not measured: Owners corporations are in no public register, so there is nothing independent to test against. The words were checked against 715 strata billers’ names, the same names they were written from: a check, not a measurement.

Examples
  • STRATA LEVY BPAYMoney out · read by a word for its kind
  • BODY CORPORATE OAKWOODMoney out · read by a word for its kind
  • OWNERS CORPORATION LEVYMoney out · read by a word for its kind
Utilities too few · 988.7% · 84too few · 14
Examples, precision, coverage and recall
  • AGL ENERGY LTD ELECTRICITY ACCOUNTMoney out · read by its name
  • ORIGIN ENERGY BPAYMoney out · read by its name
  • SYDNEY WATER BPAYMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 99 of 9100.0%100.0%100.0%
Real payee names 84100.0%79.8%79.8%88.7%
The bank’s own words too few to judge 1413 of 1492.9%92.9%92.9%
Wrong answers here: 1 labelled salary or wages.
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw9 of 99 of 9—
StrictReal payee names100.0%79.8%—
Balanced (default)Transactions it never saw9 of 99 of 9—
Balanced (default)Real payee names100.0%79.8%—
BroadTransactions it never saw9 of 99 of 9—
BroadReal payee names100.0%79.8%—
CompleteTransactions it never saw9 of 99 of 9—
CompleteReal payee names100.0%100.0%—
Groceries 96.3% · 16991.2% · 3198.0% · 25
Examples, precision, coverage and recall
  • WOOLWORTHS 1248 RICHMOND AUS Card xx7113Money out · read by its name
  • COLES 0457 PARRAMATTAMoney out · read by its name
  • ALDI STORES - SPRINGVALEMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw 16999.4%94.1%93.5%96.3%
Wrong answers here: 1 labelled transfer.
Real payee names 31100.0%83.9%83.9%91.2%
The bank’s own words 25100.0%96.0%96.0%98.0%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw99.3%81.7%—
StrictReal payee names100.0%80.7%—
Balanced (default)Transactions it never saw99.4%94.1%—
Balanced (default)Real payee names100.0%83.9%—
BroadTransactions it never saw99.4%95.3%2 of 2
BroadReal payee names100.0%83.9%—
CompleteTransactions it never saw97.6%100.0%2 of 2
CompleteReal payee names92.9%100.0%—
Transport and fuel 95.8% · 13678.7% · 22597.2% · 37
Examples, precision, coverage and recall
  • RETAIL PURCHASE BP CONNECT 2214, MASCOTMoney out · read by its name
  • TRANSPORTFORNSW TAP SYDNEYMoney out · read by its name
  • UBER *TRIP HELP.UBER.COMMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw 13699.2%92.7%92.7%95.8%
Wrong answers here: 1 labelled cash withdrawal.
Real payee names 225100.0%64.9%64.9%78.7%
The bank’s own words 37100.0%94.6%94.6%97.2%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw100.0%91.9%—
StrictReal payee names100.0%60.4%—
Balanced (default)Transactions it never saw99.2%92.7%0 of 1
Balanced (default)Real payee names100.0%64.9%2 of 2
BroadTransactions it never saw99.2%94.1%2 of 3
BroadReal payee names99.3%66.2%4 of 5
CompleteTransactions it never saw99.2%100.0%2 of 3
CompleteReal payee names98.0%100.0%4 of 5
Insurance too few · 885.2% · 6695.2% · 22
Examples, precision, coverage and recall
  • MEDIBANK PRIVATE DIRECT DEBITMoney out · read by its name
  • NRMA INSURANCE CAR POLICYMoney out · read by a word for its kind
  • BUPA AUSTRALIA HEALTH COVERMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 88 of 8100.0%100.0%100.0%
Real payee names 66100.0%74.2%74.2%85.2%
The bank’s own words 22100.0%90.9%90.9%95.2%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw8 of 88 of 8—
StrictReal payee names100.0%63.6%—
Balanced (default)Transactions it never saw8 of 88 of 8—
Balanced (default)Real payee names100.0%74.2%—
BroadTransactions it never saw8 of 88 of 8—
BroadReal payee names100.0%74.2%—
CompleteTransactions it never saw8 of 88 of 8—
CompleteReal payee names90.7%100.0%—
Health 90.4% · 3971.9% · 41too few · 19
Examples, precision, coverage and recall
  • CHEMIST WAREHOUSE 0421 PARRAMATTAMoney out · read by its name
  • PRICELINE PHARMACY 2044Money out · read by its name
  • SMILE DENTAL HURSTVILLEMoney out · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw 3997.1%84.6%84.6%90.4%
Wrong answers here: 1 labelled education and childcare.
Real payee names 41100.0%56.1%56.1%71.9%
The bank’s own words too few to judge 1915 of 1579.0%79.0%88.2%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw100.0%84.6%—
StrictReal payee names100.0%53.7%—
Balanced (default)Transactions it never saw97.1%84.6%0 of 1
Balanced (default)Real payee names100.0%56.1%1 of 1
BroadTransactions it never saw97.1%84.6%0 of 1
BroadReal payee names100.0%63.4%4 of 4
CompleteTransactions it never saw97.1%100.0%0 of 1
CompleteReal payee names90.0%100.0%4 of 4
Education and childcare too few · 3too few · 18too few · 12
Examples, precision, coverage and recall
  • SCHOOL FEES BPAY ST MARYMoney out · read by a word for its kind
  • UNIVERSITY OF SYDNEY FEESMoney out · read by a word for its kind
  • GOODSTART EARLY LEARNINGMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 32 of 2100.0%66.7%80.0%
Real payee names too few to judge 1813 of 1372.2%72.2%83.9%
The bank’s own words too few to judge 129 of 966.7%66.7%80.0%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw2 of 22 of 3—
StrictReal payee names12 of 1212 of 18—
Balanced (default)Transactions it never saw2 of 23 of 3—
Balanced (default)Real payee names13 of 1313 of 18—
BroadTransactions it never saw2 of 23 of 3—
BroadReal payee names13 of 1314 of 18—
CompleteTransactions it never saw2 of 43 of 3—
CompleteReal payee names13 of 1318 of 18—
Phone and internet too few · 4too few · 6100.0% · 20
Examples, precision, coverage and recall
  • Direct Debit 142619 TPG InternetMoney out · read by its name
  • TELSTRA BPAY 4521Money out · read by its name
  • OPTUS MOBILE DIRECT DEBITMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 44 of 4100.0%100.0%100.0%
Real payee names too few to judge 64 of 483.3%83.3%90.9%
The bank’s own words 20100.0%100.0%100.0%100.0%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw4 of 44 of 4—
StrictReal payee names3 of 33 of 6—
Balanced (default)Transactions it never saw4 of 44 of 4—
Balanced (default)Real payee names4 of 45 of 6—
BroadTransactions it never saw4 of 44 of 4—
BroadReal payee names4 of 45 of 6—
CompleteTransactions it never saw4 of 44 of 4—
CompleteReal payee names4 of 46 of 6—
Loan repayment —70.1% · 113too few · 9
Examples, precision, coverage and recall
  • PERSONAL LOAN REPAYMENT 88213Money out · read by a word for its kind
  • CAR LOAN DIRECT DEBIT 5521Money out · read by a word for its kind
  • LN REPAY 0042Money out · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Real payee names 113100.0%54.0%54.0%70.1%
The bank’s own words too few to judge 97 of 777.8%77.8%87.5%
SettingTest setPrecisionCoverageModelled, right
StrictReal payee names100.0%54.0%—
Balanced (default)Real payee names100.0%54.0%—
BroadReal payee names100.0%54.0%—
CompleteReal payee names100.0%100.0%—
Credit card payment —too few · 4too few · 16
Examples, precision, coverage and recall
  • CREDIT CARD PAYMENT THANK YOUMoney out · read by a word for its kind
  • CC PAYMENT 7113Money out · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Real payee names too few to judge 45 of 5100.0%100.0%100.0%
The bank’s own words too few to judge 1612 of 1275.0%75.0%85.7%
SettingTest setPrecisionCoverageModelled, right
StrictReal payee names5 of 54 of 4—
Balanced (default)Real payee names5 of 54 of 4—
BroadReal payee names5 of 54 of 4—
CompleteReal payee names5 of 54 of 4—
Buy now pay later too few · 3said 2too few · 9
Examples, precision, coverage and recall
  • PAY IN 4 INSTALMENT 2Money out · read by its name
  • PAY IN 4 PURCHASEMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 33 of 3100.0%100.0%100.0%
Real payee names too few to judge 02 of 2———
The bank’s own words too few to judge 99 of 9100.0%100.0%100.0%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw3 of 33 of 3—
StrictReal payee names2 of 2——
Balanced (default)Transactions it never saw3 of 33 of 3—
Balanced (default)Real payee names2 of 2——
BroadTransactions it never saw3 of 33 of 3—
BroadReal payee names2 of 2——
CompleteTransactions it never saw3 of 33 of 3—
CompleteReal payee names2 of 2——
Child support paid ———

Not measured: One payee, Services Australia’s Child Support program, so there is no register of payees to test against; the line is read by the program’s own name. Checked on every corpus here for a collision and found none.

Examples
  • CHILD SUPPORT DIRECT DEBITMoney out · read by a word for its kind
  • SERVICES AUSTRALIA CHILD SUPPORTMoney out · read by a word for its kind
Eating out and takeaway 91.7% · 25385.5% · 19093.1% · 31
Examples, precision, coverage and recall
  • SQ *WHITE HORSE COFFEE Sutherland NS AUSMoney out · read by a word for its kind
  • UBER *EATS SYDNEYMoney out · read by its name
  • MCDONALDS RANDWICKMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw 25399.5%85.0%85.0%91.7%
Wrong answers here: 1 labelled groceries.
Real payee names 190100.0%74.7%74.7%85.5%
The bank’s own words 31100.0%87.1%87.1%93.1%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw100.0%60.9%—
StrictReal payee names100.0%61.1%—
Balanced (default)Transactions it never saw99.5%85.0%—
Balanced (default)Real payee names100.0%74.7%—
BroadTransactions it never saw99.1%90.9%15 of 16
BroadReal payee names98.6%76.8%3 of 5
CompleteTransactions it never saw83.3%100.0%15 of 16
CompleteReal payee names43.0%100.0%3 of 5
Shopping 80.4% · 12086.1% · 19381.7% · 55
Examples, precision, coverage and recall
  • KMART 1045 BONDI JUNCTIONMoney out · read by its name
  • JB HI FI 0112 SYDNEYMoney out · read by its name
  • BUNNINGS 6721 ALEXANDRIAMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw 12097.6%68.3%68.3%80.4%
Wrong answers here: 2 labelled entertainment and subscriptions.
Real payee names 193100.0%75.6%75.6%86.1%
The bank’s own words 55100.0%69.1%69.1%81.7%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw96.4%45.0%—
StrictReal payee names100.0%47.1%—
Balanced (default)Transactions it never saw97.6%68.3%20 of 20
Balanced (default)Real payee names100.0%75.6%4 of 4
BroadTransactions it never saw97.6%68.3%20 of 20
BroadReal payee names100.0%76.7%4 of 4
CompleteTransactions it never saw92.7%100.0%20 of 20
CompleteReal payee names93.4%100.0%4 of 4
Entertainment and subscriptions 92.2% · 6286.1% · 4996.2% · 27
Examples, precision, coverage and recall
  • NETFLIX.COM MELBOURNEMoney out · read by its name
  • SPOTIFY P1A2B3 SYDNEYMoney out · read by its name
  • HOYTS 0012 BROADWAYMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw 62100.0%88.7%85.5%92.2%
Real payee names 49100.0%75.5%75.5%86.1%
The bank’s own words 27100.0%92.6%92.6%96.2%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw100.0%77.4%—
StrictReal payee names100.0%55.1%—
Balanced (default)Transactions it never saw100.0%88.7%1 of 1
Balanced (default)Real payee names100.0%75.5%3 of 3
BroadTransactions it never saw98.2%90.3%2 of 3
BroadReal payee names94.9%75.5%3 of 5
CompleteTransactions it never saw98.2%100.0%2 of 3
CompleteReal payee names92.5%100.0%3 of 5
Travel too few · 11too few · 8too few · 13
Examples, precision, coverage and recall
  • QANTAS AIRWAYS 081Money out · read by its name
  • JETSTAR AIRWAYSMoney out · read by its name
  • BOOKING.COM HOTELMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 116 of 654.5%54.5%70.6%
Real payee names too few to judge 87 of 787.5%87.5%93.3%
The bank’s own words too few to judge 138 of 861.5%61.5%76.2%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw2 of 22 of 11—
StrictReal payee names4 of 44 of 8—
Balanced (default)Transactions it never saw6 of 66 of 112 of 2
Balanced (default)Real payee names7 of 77 of 82 of 2
BroadTransactions it never saw6 of 68 of 112 of 2
BroadReal payee names7 of 77 of 82 of 2
CompleteTransactions it never saw7 of 911 of 112 of 2
CompleteReal payee names7 of 138 of 82 of 2
Donations and charity ———

Not measured: Charities are in a public register, the ACNC’s, and that register is where the names this reads them by come from, so it cannot also measure them; no other corpus here names a charity a household paid. Added on 29 October 2026.

Examples
  • WORLD VISION AUSTRALIAMoney out · read by its name
  • GOFUNDME *MEDICAL APPEALMoney out · read by its name
  • SALVATION ARMY DONATIONMoney out · read by a word for its kind
Gambling —too few · 1too few · 3
Examples, precision, coverage and recall
  • SPORTSBET PTY LTD DEPOSITMoney out · read by its name
  • TABCORP WAGERINGMoney out · read by its name
  • LADBROKES DEPOSITMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Real payee names too few to judge 11 of 1100.0%100.0%100.0%
The bank’s own words too few to judge 33 of 3100.0%100.0%100.0%
SettingTest setPrecisionCoverageModelled, right
StrictReal payee names1 of 11 of 1—
Balanced (default)Real payee names1 of 11 of 1—
BroadReal payee names1 of 11 of 1—
CompleteReal payee names1 of 11 of 1—
Cash withdrawal 98.5% · 3369.7% · 4390.3% · 34
Examples, precision, coverage and recall
  • WDL ATM RICHMONDMoney out · read by a word for its kind
  • CARDLESS CASH WITHDRAWALMoney out · read by a word for its kind
  • ATM WITHDRAWAL 0042 SYDNEYMoney out · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw 33100.0%100.0%97.0%98.5%
Real payee names 43100.0%53.5%53.5%69.7%
The bank’s own words 34100.0%82.3%82.3%90.3%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw100.0%97.0%—
StrictReal payee names100.0%53.5%—
Balanced (default)Transactions it never saw100.0%100.0%—
Balanced (default)Real payee names100.0%53.5%—
BroadTransactions it never saw100.0%100.0%—
BroadReal payee names100.0%53.5%—
CompleteTransactions it never saw100.0%100.0%—
CompleteReal payee names100.0%100.0%—
Transfer 96.8% · 80—87.5% · 140
Examples, precision, coverage and recall
  • TRANSFER TO SAVINGS 88231Money out · read by a word for its kind
  • Transfer from SpendingMoney in · read by a word for its kind
  • Savings (~49%)Money out · read as one half of an app’s split of a payment
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw 80100.0%95.0%93.8%96.8%
The bank’s own words 140100.0%77.9%77.9%87.5%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw100.0%95.0%—
Balanced (default)Transactions it never saw100.0%95.0%—
BroadTransactions it never saw100.0%95.0%—
CompleteTransactions it never saw96.2%100.0%—
CompleteReal payee names0 of 4——
External transfer ——said 23

Not measured: People are in no public register, by design. Read from the bank’s own wording and a given name, and checked on the bank-wording lines and on transfers between common Australian names.

Examples
  • TRANSFER TO J CITIZEN DINNERMoney out · read by its name
  • OSKO PAYMENT TO S NGUYEN DINNERMoney out · read by its name
  • PAYMENT FROM M TAYLORMoney in · read by its name
Bank fees and interest too few · 6—95.7% · 60
Examples, precision, coverage and recall
  • ACCOUNT FEEMoney out · read by a word for its kind
  • INTERNATIONAL TRANSACTION FEEMoney out · read by a word for its kind
  • OVERDRAWN FEEMoney out · read by a word for its kind
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 65 of 583.3%83.3%90.9%
The bank’s own words 60100.0%91.7%91.7%95.7%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw5 of 55 of 6—
Balanced (default)Transactions it never saw5 of 55 of 6—
BroadTransactions it never saw5 of 55 of 6—
CompleteTransactions it never saw6 of 66 of 6—
Tax, rates and government charges too few · 6—too few · 13
Examples, precision, coverage and recall
  • ATO PAYMENT BPAYMoney out · read by its name
  • CITY OF SYDNEY RATESMoney out · read by its name
  • REVENUE NSW LAND TAXMoney out · read by its name
Test setLinesPrecisionCoverageRecallF1
Transactions it never saw too few to judge 66 of 6100.0%100.0%100.0%
The bank’s own words too few to judge 1313 of 13100.0%100.0%100.0%
SettingTest setPrecisionCoverageModelled, right
StrictTransactions it never saw3 of 33 of 6—
Balanced (default)Transactions it never saw6 of 66 of 61 of 1
BroadTransactions it never saw6 of 66 of 61 of 1
CompleteTransactions it never saw6 of 76 of 61 of 1

Releases

  1. Registers read again 5 Nov 2026 · ff86718

    The public registers read again for November. Every figure held.

    Transactions it never saw F1 92.5% +0.0 ptsReal payee names F1 82.4% +0.0 pts

  2. Registers read again 5 Nov 2026 · 2b2015a

    The public registers, places, names, web addresses and bank logos read again for November. Every figure held.

    Transactions it never saw F1 92.5% +0.0 ptsReal payee names F1 82.4% +0.0 pts

  3. Bank formats read through 29 Oct 2026 · 868fd65

    HSBC’s terminal number and country written onto a suburb, and ING’s and Bendigo’s purchase words before a merchant’s name, no longer hide the business from the register of places.

    Transactions it never saw F1 92.5% +0.0 ptsReal payee names F1 82.4% +0.0 pts

  4. Every free register, and a donations line 29 Oct 2026 · 8ff7816

    Foursquare’s places and seventeen state and Commonwealth registers — liquor and gaming licences, schools, hospitals, care services, fuel sites, chain stores — join the register of places. Charities, councils, health funds, universities and chains are read by name. Donations and charity is a line. A company suffix written onto a name is split off.

    Transactions it never saw F1 92.5% +0.4 ptsReal payee names F1 82.4% +2.3 pts

  5. Web addresses and words for food 29 Oct 2026 · a0bf0e5

    A shop named by its own web address, from Wikidata. Words that name a place to eat, from the register of places. An app bank’s own covers and forwards, and the holder’s own name mid-line.

    Transactions it never saw F1 92.0% +0.2 ptsReal payee names F1 80.1% +0.5 pts

  6. Own money moving, and chains on a campus 28 Oct 2026 · cover-1028

    An app bank’s “Cover to Spending” and “Cover from” lines are the holder’s own money covering a purchase, whatever purchase they name, and are read as transfers. A university’s name is read after the chains’ names, so a chain’s shop on a campus is the chain. Both came from real statements, where coverage rose from 82.1% to 83.7%; the test sets here hold few such lines, and one more payee is named right.

    Transactions it never saw F1 91.8% +0.0 ptsReal payee names F1 79.6% +0.0 pts

  7. A setting that answers every line 28 Oct 2026 · complete-1028

    Complete reads as broad reads and then gives every line nothing read the model’s best guess, marked as one: a spending line for money out, a transfer for money in, never income, a commitment or gambling. It is for comparing with services that categorise every line and quote accuracy over all of them, which is recall here, now published for every setting. Not held to a precision floor, and never the default. Published with it: the merchant on its own, on the lines whose label names a business, and the line as a whole.

    Transactions it never saw F1 91.8% +0.0 ptsReal payee names F1 79.6% +0.0 pts

  8. A register of Australian places 28 Oct 2026 · places-1028

    A card line no rule reads is now read from the business a register of 724,000 Australian places (Overture Maps) lists by those words in the suburb the line names, matched by the suburb’s postcodes from G-NAF, and named. Only where every place that matches says the same line of a budget, and the line’s own words do not point elsewhere. Balanced and broad; never strict, and never money in. Most of the rise is the synthetic account’s own shops, which are real and listed: on held-out lines from shops the development half never had, the default went from 67.4% to 70.9%, at 97.1% precision.

    Transactions it never saw F1 91.8% +5.9 ptsReal payee names F1 79.6% +3.8 pts

  9. Every set measured again 28 Oct 2026 · measured-1028

    The held-out set was rebuilt from its public sources, line for line, and the BPAY directory fetched again; both were measured with the reader of 23 October. No reading changed. The billers’ figures moved because the directory did.

    Transactions it never saw F1 86.0%Real payee names F1 75.8% +0.0 pts

  10. Lines as the bank writes them 23 Oct 2026 · rules-1023

    An accented letter, a payment terminal’s code and a date or time written into a line no longer hide the payee, so four brands a rule was written for are read, and a monthly payment written with its date is one arrangement. Pay, dividends and workers’ compensation read from the words of a credit. Measured on the payee names and the bank’s words only: the held-out set and the billers are kept outside the repository and keep the figures of the release before.

    Real payee names F1 75.8% +0.3 pts

  11. Rules tidied 4 Oct 2026 · no-lenders-1004

    One rule and one test line taken out. No other reading changed.

    Transactions it never saw F1 86.0% +0.0 ptsReal payee names F1 75.5% +0.0 pts

  12. More read by a rule 4 Oct 2026 · rules-1004

    Chiropractors, orthodontists and psychologists, which a rule meant to read and never did. Wineries, cellars, chicken shops, nail bars and shoe shops by the word, from a larger map. The model’s thresholds set again on what the rules now leave: strict reads more, and the default reads what it did, more of it by a rule.

    Transactions it never saw F1 86.0% +0.0 ptsReal payee names F1 75.5% +0.3 pts

  13. A model, and a setting 3 Oct 2026 · 6772eda

    A model fitted here reads lines no rule reads. A lender chooses strict (the rules alone), balanced (the default, each category held to 95%) or broad (90%). The figures from this release are the default’s.

    Transactions it never saw F1 86.0% +2.3 ptsReal payee names F1 75.2% +2.2 pts

  14. Car makes, benefits and account conduct 3 Oct 2026 · 3dc6fd7

    Every car and motorcycle make on Queensland’s register of new vehicles. Government payments named with the Act they are paid under. Dishonours, overdraws and late fees as the banks write them. A loan received and child support paid are lines of their own.

    Transactions it never saw F1 83.7% +0.0 ptsReal payee names F1 73.0% +2.4 pts

  15. Every category over 95% 30 Sept 2026 · bf28028

    A transfer’s reference no longer reads as a power bill. The held-out labels follow the taxonomy for liquor, gyms, councils and bakeries, and every release is re-scored on them.

    Transactions it never saw F1 83.7% +0.1 ptsReal payee names F1 70.5% +0.0 pts

  16. Forecourts, cash machines and agencies 30 Sept 2026 · d11e7a4

    Fuel retailers from two state price registers, cash-machine operators and agency groups, each named from a public register.

    Transactions it never saw F1 83.6% +0.1 ptsReal payee names F1 70.5% +5.2 pts

  17. Three categories and BPAY 27 Sept 2026 · a72888b

    Tax and government, paid to a person, and strata. BPAY billers by code and short name. Car finance.

    Transactions it never saw F1 83.4% +4.0 ptsReal payee names F1 65.3% +3.3 pts

  18. Kinds of business 27 Sept 2026 · 9c4b485

    Kinds of business mined from real venue names. A transfer under the holder’s own name is their own money.

    Transactions it never saw F1 79.5% +6.1 ptsReal payee names F1 62.0% +3.6 pts

  19. The bank’s own words 27 Sept 2026 · 6c6f733

    Fees, cash, transfers, pay and benefits, read from how 14 banks write them. Licensed bookmakers and debt collectors.

    Transactions it never saw F1 73.3% +3.7 ptsReal payee names F1 58.4% +3.7 pts

  20. Australian brands 27 Sept 2026 · 8e4b79f

    Brands from a national index of shop names, one name for each merchant.

    Transactions it never saw F1 69.6% +0.8 ptsReal payee names F1 54.6% +11.6 pts

  21. Enrich 20 Sept 2026 · 67c74e1

    Each reading names the payee and says how sure it is. Energy retailers and lenders named from public registers.

    Transactions it never saw F1 68.9% +0.9 ptsReal payee names F1 43.1% +11.4 pts

  22. First release 19 Sept 2026 · 413245b

    A bank export read into income, commitments and spending.

    Transactions it never saw F1 68.0%Real payee names F1 31.6%

What the figures mean

Precision
Of the lines Statement put in a category, the share that were right.
Coverage
The share of lines Statement put in any category. The rest it declines.
Recall
The share of all lines put in the right category, a line Statement declines counted as wrong: accuracy over all lines, the figure services that categorise every line quote as their accuracy. Under the complete setting, which answers every line, it is the same as precision.
F1
Precision and recall together, as their harmonic mean.
Payee named
The share of lines where the business was identified by name.
Merchant right
Of the lines whose label names a business, the share where Statement named that business. Beside it, of the names it gave, the share that were right.
Whole line right
Of all lines, the share with the category right and, where the line has a merchant, the merchant named right too.

AUC is not reported: it measures how well a score ranks, and Statement answers or declines rather than ranking. The same figures, for a program: /v1/statement/accuracy.