How well it reads

Measured on every release, on the same test sets, for every category.

Precision: 96.7%
Coverage: 72.5%
F1: 81.3%
Payee named: 44.0%

On 963 transactions it never saw, measured 27 Sept 2026. Each category is held to 95% precision; one below it on a test set is marked.

Test sets

Test set	Precision	Coverage	Recall	F1	F1 since first release
Transactions it never saw	96.7%	72.5%	70.1%	81.3%	+13.4 pts
963 labelled transactions from public datasets, held out while the rules were written. The labels are the datasets’ own. Payee named on 44.0%. Measured 27 Sept 2026.
Real payee names	99.6%	48.5%	48.4%	65.1%	+32.7 pts
1,102 Australian businesses from public registers and map data, each with a right answer. Payee named on 34.8%. Measured 27 Sept 2026.
The bank’s own words not independent	100.0%	79.0%	79.0%	88.3%	+34.3 pts
681 lines from 14 banks. The rules were written from them, so this checks nothing was lost; it does not measure accuracy. 46 lines that should not be read were left unread. Measured 27 Sept 2026.
BPAY billers not independent	99.5%	64.0%	63.7%	77.6%	+71.1 pts
6,217 billers’ short names as a bank prints them, against their full registered names. Agreement, not correctness. Measured 27 Sept 2026.

Transactions it never saw 81.3%
Real payee names 65.1%
The bank’s own words 88.3%
BPAY billers 77.6%

F1 on each test set, release by release, with the latest release’s figure. Every release is scored on today’s test sets, so the lines compare.

By category

F1 and the number of lines in each test set. Open a category for precision, coverage and recall, and for what the wrong answers were labelled.

Category

Transactions it never saw
F1 · lines

Real payee names
F1 · lines

The bank’s own words
F1 · lines

Salary or wages

100.0% · 6

—

92.6% · 29

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	6	100.0%	100.0%	100.0%	100.0%
The bank’s own words	29	100.0%	86.2%	86.2%	92.6%

Government benefit

—

82.9% · 24

100.0% · 9

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Real payee names	24	100.0%	70.8%	70.8%	82.9%
The bank’s own words	9	100.0%	100.0%	100.0%	100.0%

Other income

71.4% · 8

—

63.9% · 66

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	8	83.3%	62.5%	62.5%	71.4%
Wrong answers here: 1 labelled mortgage repayment.
The bank’s own words	66	100.0%	47.0%	47.0%	63.9%

Rent

100.0% · 4

47.1% · 26

92.9% · 15

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	4	100.0%	100.0%	100.0%	100.0%
Real payee names	26	100.0%	30.8%	30.8%	47.1%
The bank’s own words	15	100.0%	86.7%	86.7%	92.9%

Mortgage repayment

80.0% · 3

97.6% · 21

66.7% · 2

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	3	100.0%	100.0%	66.7%	80.0%
Real payee names	21	100.0%	95.2%	95.2%	97.6%
The bank’s own words	2	100.0%	50.0%	50.0%	66.7%

Strata and body corporate

—

Not measured: Owners corporations are in no public register, so there is nothing independent to test against. The words were checked against 715 strata billers’ names, the same names they were written from: a check, not a measurement.

Utilities below 95%

72.0% · 15

88.7% · 84

96.3% · 14

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw below 95%	15	90.0%	80.0%	60.0%	72.0%
Wrong answers here: 1 labelled transfer.
Real payee names	84	100.0%	79.8%	79.8%	88.7%
The bank’s own words	14	100.0%	92.9%	92.9%	96.3%

Groceries

84.6% · 183

85.2% · 31

95.8% · 25

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	183	99.3%	73.8%	73.8%	84.6%
Wrong answers here: 1 labelled transfer.
Real payee names	31	100.0%	74.2%	74.2%	85.2%
The bank’s own words	25	100.0%	92.0%	92.0%	95.8%

Transport and fuel

95.0% · 136

37.0% · 225

97.2% · 37

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	136	100.0%	90.4%	90.4%	95.0%
Real payee names	225	100.0%	23.1%	22.7%	37.0%
The bank’s own words	37	100.0%	94.6%	94.6%	97.2%

Insurance

100.0% · 8

77.1% · 66

95.2% · 22

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	8	100.0%	100.0%	100.0%	100.0%
Real payee names	66	97.7%	63.6%	63.6%	77.1%
Wrong answers here: 1 labelled transport and fuel.
The bank’s own words	22	100.0%	90.9%	90.9%	95.2%

Health

83.3% · 42

63.3% · 41

84.9% · 19

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	42	100.0%	78.6%	71.4%	83.3%
Real payee names	41	100.0%	46.3%	46.3%	63.3%
The bank’s own words	19	100.0%	73.7%	73.7%	84.9%

Education and childcare below 95%

80.0% · 3

75.9% · 17

80.0% · 12

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	3	100.0%	66.7%	66.7%	80.0%
Real payee names below 95%	17	91.7%	64.7%	64.7%	75.9%
Wrong answers here: 1 labelled shopping.
The bank’s own words	12	100.0%	66.7%	66.7%	80.0%

Phone and internet

100.0% · 4

66.7% · 6

100.0% · 20

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	4	100.0%	100.0%	100.0%	100.0%
Real payee names	6	100.0%	50.0%	50.0%	66.7%
The bank’s own words	20	100.0%	100.0%	100.0%	100.0%

Loan repayment

—

69.4% · 113

88.9% · 10

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Real payee names	113	100.0%	53.1%	53.1%	69.4%
The bank’s own words	10	100.0%	80.0%	80.0%	88.9%

Credit card payment

—

100.0% · 4

85.7% · 16

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Real payee names	4	100.0%	100.0%	100.0%	100.0%
The bank’s own words	16	100.0%	75.0%	75.0%	85.7%

Buy now pay later

100.0% · 3

said 2

100.0% · 9

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	3	100.0%	100.0%	100.0%	100.0%
Real payee names	0	100.0%	—	—	—
The bank’s own words	9	100.0%	100.0%	100.0%	100.0%

Eating out and takeaway below 95%

74.4% · 221

68.5% · 190

83.0% · 31

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw below 95%	221	92.0%	62.4%	62.4%	74.4%
Wrong answers here: 12 labelled entertainment and subscriptions.
Real payee names	190	100.0%	52.1%	52.1%	68.5%
The bank’s own words	31	100.0%	71.0%	71.0%	83.0%

Shopping

59.0% · 120

62.1% · 193

75.0% · 55

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	120	96.2%	42.5%	42.5%	59.0%
Wrong answers here: 2 labelled entertainment and subscriptions.
Real payee names	193	100.0%	45.6%	45.1%	62.1%
The bank’s own words	55	100.0%	60.0%	60.0%	75.0%

Entertainment and subscriptions below 95%

69.9% · 77

87.5% · 9

96.2% · 27

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw below 95%	77	93.5%	74.0%	55.8%	69.9%
Wrong answers here: 3 labelled health.
Real payee names	9	100.0%	77.8%	77.8%	87.5%
The bank’s own words	27	100.0%	92.6%	92.6%	96.2%

Travel

16.7% · 11

66.7% · 8

76.2% · 13

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	11	100.0%	9.1%	9.1%	16.7%
Real payee names	8	100.0%	50.0%	50.0%	66.7%
The bank’s own words	13	100.0%	61.5%	61.5%	76.2%

Gambling

—

100.0% · 1

100.0% · 3

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Real payee names	1	100.0%	100.0%	100.0%	100.0%
The bank’s own words	3	100.0%	100.0%	100.0%	100.0%

Cash withdrawal

98.5% · 33

37.7% · 43

90.3% · 34

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	33	100.0%	97.0%	97.0%	98.5%
Real payee names	43	100.0%	23.3%	23.3%	37.7%
The bank’s own words	34	100.0%	82.3%	82.3%	90.3%

Transfer

96.1% · 80

—

88.0% · 140

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	80	100.0%	95.0%	92.5%	96.1%
The bank’s own words	140	100.0%	78.6%	78.6%	88.0%

Paid to or from a person

—

said 22

Not measured: People are in no public register, by design. Read from the bank’s own wording and a given name, and checked on the bank-wording lines and on transfers between common Australian names.

Bank fees and interest

90.9% · 6

—

95.7% · 60

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	6	100.0%	83.3%	83.3%	90.9%
The bank’s own words	60	100.0%	91.7%	91.7%	95.7%

Tax, rates and government charges

said 3

—

100.0% · 13

Precision, coverage and recall

Test set	Lines	Precision	Coverage	Recall	F1
Transactions it never saw	0	0.0%	—	—	—
Wrong answers here: 3 labelled utilities.
The bank’s own words	13	100.0%	100.0%	100.0%	100.0%

Releases

Three categories and BPAY 27 Sept 2026 · a72888b
Tax and government, paid to a person, and strata. BPAY billers by code and short name. Car finance.
Transactions it never saw F1 81.3% +2.8 ptsReal payee names F1 65.1% +3.5 pts
Kinds of business 27 Sept 2026 · 9c4b485
Kinds of business mined from real venue names. A transfer under the holder’s own name is their own money.
Transactions it never saw F1 78.5% +5.8 ptsReal payee names F1 61.7% +3.6 pts
The bank’s own words 27 Sept 2026 · 6c6f733
Fees, cash, transfers, pay and benefits, read from how 14 banks write them. Licensed bookmakers and debt collectors.
Transactions it never saw F1 72.7% +3.2 ptsReal payee names F1 58.1% +3.5 pts
Australian brands 27 Sept 2026 · 8e4b79f
Brands from a national index of shop names, one name for each merchant.
Transactions it never saw F1 69.5% +0.7 ptsReal payee names F1 54.5% +10.4 pts
Enrich 20 Sept 2026 · 67c74e1
Each reading names the payee and says how sure it is. Energy retailers and lenders named from public registers.
Transactions it never saw F1 68.7% +0.9 ptsReal payee names F1 44.2% +11.7 pts
First release 19 Sept 2026 · 413245b
A bank export read into income, commitments and spending.
Transactions it never saw F1 67.8%Real payee names F1 32.4%

What the figures mean

Precision: Of the lines Statement put in a category, the share that were right.
Coverage: The share of lines Statement put in any category. The rest it declines.
Recall: The share of lines put in the right category.
F1: Precision and recall together, as their harmonic mean.
Payee named: The share of lines where the business was identified by name.

AUC is not reported: it measures how well a score ranks, and Statement answers or declines rather than ranking. The same figures, for a program: /v1/statement/accuracy.