Brief us
BRUSHWORKS DESK · 01 · THE DATA ENGINEIndex

The data engine that Terrain, Program and Response draw on.

The Index resolves identity, builds the behavioral graph, curates the signal registry and trains the model catalog, then holds every model at a gate on the client’s own holdout before it reaches a single voter. Terrain, Program and Response all draw from it.

62Bobserved behaviors
270M+adults and households
17,000+active signals, pruned monthly
MODEL FAMILY AMODEL FAMILY BMODEL FAMILY CMODEL FAMILY DMODEL FAMILY ES-01S-02S-03S-04BEHAVIORS62BPEOPLE270M+SIGNALS17,000+MODELS5 FAMILIESGATE2 BASELINESCOHORTSSCORED
The stackChoose a layer

Four layers and a publish gate, with measurement kept separate.

LAYER 1Identity resolution

Records from licensed sources are matched to people and households. Identifiers are keyed hashes before anything is stored; no name travels past this layer.

Keyedhashes, at the edge
Per programmatching, under a written data-use agreement
LAYER 2Behavioral graph

62 billion observed behaviors resolved over 270 million adults and their households. The graph is rebuilt every month; activity arrives every day.

62Bobserved behaviors
270M+adults and households
LAYER 3Signal registry

A signal is an observed behavior, never an opinion and never an inference about who someone is. Signals that stop predicting are pruned every month.

17,000+active signals
10,000topics, twenty-five domains
LAYER 4Model catalog

Five model families trained on recorded outcomes. Nothing ships without beating two baselines on the client’s own holdout; failures are logged.

5model families
34 of 84candidates survive the gate, a representative year
BEFORE ANY VOTERThe gate

A model ships only if it beats the stronger of two baselines on your holdout by a margin set in advance: 0.03 in AUC and ten percent relative in top-decile lift.

+0.03AUC margin, pre-registered
+10%top-decile lift, pre-registered
BESIDE THE STACKMeasurement

Measurement sits beside the stack, not inside it: it can see everything and change nothing, which is what makes its judgment worth having.

10%of every cohort sealed, day five
Dailylift with its interval
WORKS WITHTerrainProgramResponse
The registryThe evidence

The behavioral graph, by signal family.

Purchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · entered a scored model this monthPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPurchasing and commerce · active signalPURCHASING AND COMMERCEMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · entered a scored model this monthMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · entered a scored model this monthMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMedia and attention · active signalMEDIA AND ATTENTIONCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · entered a scored model this monthCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCivic and community · active signalCIVIC AND COMMUNITYHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · entered a scored model this monthHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · active signalHousehold and mobility · entered a scored model this monthHousehold and mobility · active signalHOUSEHOLD AND MOBILITYHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · entered a scored model this monthHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · active signalHealth, work and finance · entered a scored model this monthHealth, work and finance · active signalHealth, work and finance · active signalHEALTH, WORK AND FINANCE
62Bobserved behaviors, resolved over 270 million adults and their households
10,000topics in the dictionary, in twenty-five domains
17,000+active signals in the registry, pruned monthly
5model families, trained on recorded outcomes
ILLUSTRATIVE · THE REGISTRY DRAWN BY FAMILY; HOVER A TILE FOR ITS FAMILY. BRIGHT TILES ENTERED A SCORED MODEL THIS MONTH.
The gateBefore any voter

A model ships only if it beats two baselines on your holdout.

DEMOGRAPHIC BASELINE0.61LOOK-ALIKE BASELINE0.64CANDIDATE0.69stronger baseline + 0.03, set in advancebin 1 · observed 0.06bin 2 · observed 0.13bin 3 · observed 0.24bin 4 · observed 0.33bin 5 · observed 0.47bin 6 · observed 0.55bin 7 · observed 0.66bin 8 · observed 0.73bin 9 · observed 0.86bin 10 · observed 0.93PREDICTED →OBSERVED
MODEL CARD · PERSUASION · PROGRAM 0417
Stronger baseline0.64
Candidate0.69
Margin+0.05 (pre-reg. +0.03)
Top-decile lift+14% (pre-reg. +10%)
Brier score0.19
Ledger entryDR-0417-0021
SHIPPED

The exclusion check, before the gate.

Every candidate model and signal is tested for whether it can predict an attribute the data use policy excludes: health conditions, religion, sexual orientation, union membership, immigration status and the others listed there. Above an AUC of 0.60, it does not go forward.

candidate · AUC 0.59 on an excluded attributecandidate · AUC 0.50 on an excluded attributecandidate · AUC 0.47 on an excluded attributecandidate · AUC 0.69 on an excluded attribute · struckcandidate · AUC 0.61 on an excluded attribute · struckcandidate · AUC 0.48 on an excluded attributecandidate · AUC 0.65 on an excluded attribute · struckcandidate · AUC 0.65 on an excluded attribute · struckcandidate · AUC 0.53 on an excluded attributecandidate · AUC 0.60 on an excluded attributecandidate · AUC 0.62 on an excluded attribute · struckcandidate · AUC 0.57 on an excluded attributecandidate · AUC 0.50 on an excluded attributecandidate · AUC 0.64 on an excluded attribute · struckcandidate · AUC 0.58 on an excluded attributecandidate · AUC 0.54 on an excluded attributecandidate · AUC 0.54 on an excluded attributecandidate · AUC 0.52 on an excluded attributecandidate · AUC 0.69 on an excluded attribute · struckcandidate · AUC 0.56 on an excluded attributecandidate · AUC 0.48 on an excluded attributecandidate · AUC 0.70 on an excluded attribute · struckcandidate · AUC 0.62 on an excluded attribute · struckcandidate · AUC 0.61 on an excluded attribute · struckcandidate · AUC 0.52 on an excluded attributecandidate · AUC 0.49 on an excluded attributecandidate · AUC 0.47 on an excluded attributecandidate · AUC 0.59 on an excluded attributecandidate · AUC 0.58 on an excluded attributecandidate · AUC 0.63 on an excluded attribute · struckcandidate · AUC 0.61 on an excluded attribute · struckcandidate · AUC 0.62 on an excluded attribute · struckcandidate · AUC 0.48 on an excluded attributecandidate · AUC 0.62 on an excluded attribute · struckcandidate · AUC 0.54 on an excluded attributecandidate · AUC 0.72 on an excluded attribute · struckcandidate · AUC 0.65 on an excluded attribute · struckcandidate · AUC 0.53 on an excluded attributecandidate · AUC 0.48 on an excluded attributecandidate · AUC 0.64 on an excluded attribute · struckcandidate · AUC 0.66 on an excluded attribute · struckcandidate · AUC 0.56 on an excluded attributecandidate · AUC 0.62 on an excluded attribute · struckcandidate · AUC 0.57 on an excluded attributecandidate · AUC 0.61 on an excluded attribute · struckcandidate · AUC 0.67 on an excluded attribute · struckcandidate · AUC 0.58 on an excluded attributecandidate · AUC 0.58 on an excluded attributecandidate · AUC 0.49 on an excluded attributecandidate · AUC 0.50 on an excluded attributecandidate · AUC 0.48 on an excluded attributecandidate · AUC 0.67 on an excluded attribute · struckcandidate · AUC 0.65 on an excluded attribute · struckcandidate · AUC 0.65 on an excluded attribute · struckcandidate · AUC 0.53 on an excluded attributecandidate · AUC 0.57 on an excluded attributecandidate · AUC 0.68 on an excluded attribute · struckcandidate · AUC 0.64 on an excluded attribute · struckcandidate · AUC 0.68 on an excluded attribute · struckcandidate · AUC 0.48 on an excluded attributecandidate · AUC 0.51 on an excluded attributecandidate · AUC 0.72 on an excluded attribute · struckcandidate · AUC 0.47 on an excluded attributecandidate · AUC 0.52 on an excluded attributecandidate · AUC 0.62 on an excluded attribute · struckcandidate · AUC 0.56 on an excluded attributecandidate · AUC 0.61 on an excluded attribute · struckcandidate · AUC 0.49 on an excluded attributecandidate · AUC 0.64 on an excluded attribute · struckcandidate · AUC 0.58 on an excluded attribute0.60: DOES NOT SHIP0.50: NO BETTER THAN CHANCE
ILLUSTRATIVE · HOVER A POINT OR A BIN FOR ITS VALUE
DriftAfter the gate

Checked daily in the field, retired after three days below threshold.

0.550.600.650.70KILL THRESHOLD, STATED ON THE CARDPERSUASION, S-04TURNOUT, S-01PERSUASION, S-06 · RETIRED, THIRD DAY BELOWDAY 1DAY 8DAY 15DAY 22DAY 29DAY 36

Drift is checked every day after launch.

Every card states an in-field discrimination level. A model that falls below it for three consecutive days is retired, the cohorts it scored go back to the stronger baseline, and the retirement is written into the kill log with its reason.

Drift is how a model fails quietly: the electorate moves and the signals that predicted it stop predicting. Watching for it is the discipline that keeps a score honest after launch.

ILLUSTRATIVE · THREE MODELS IN FIELD; THE THRESHOLD IS SET PER CARD
What you receiveEvery program

Four documents ship with every score.

DELIVERABLE 01

Model card

Baselines, the pre-registered margin, discrimination and calibration on your holdout, and the ledger entry that recorded the decision.

COMMERCEMEDIACIVICHOUSEHOLDHEALTH
DELIVERABLE 02

Registry extract

The signals that entered your program’s models, by family and month, with the ones pruned since.

CONTACTEDSEALED CONTROL
DELIVERABLE 03

Kill log

Every model tested for your program: the baselines it faced, the result and the reason for each retirement.

S-01 · compositeThe StewardSame hardware store, 11 yrsLibrary board minutesS-03 · compositeThe Night NurseShift, overnightHospital story, 1:04S-04 · compositeThe RenterLease renewal, MarchMoving searchesS-06 · compositeThe CommuterCommute +14 minTransit app, dailyS-07 · compositeThe CertainVoted every cycleHeld out of every send
DELIVERABLE 04

Exclusion report

The test for excluded attributes on every candidate model and signal, with anything struck before the gate.

The Index, second editionIn the build now

The same behavior, read in depth.

Being built now
Electoral recordFactsPlaceWorkBehaviorContextOutcomesCIV23 DOMAINS
ILLUSTRATIVE · SEVEN KINDS OF EVIDENCE MEET ON ONE ID; EACH BEHAVIOR MEASURED EIGHTEEN WAYS AND READ EIGHT WAYS

Today’s Index stays. The second edition adds depth beneath every reading.

The Index already reads 62B observed behaviors across 270M+ adults and holds every model at a gate on the client’s own holdout. The second edition, being built now, keeps all of it.

Beneath each reading it adds seven kinds of evidence on one permanent id, eighteen measures of every behavior and eight reads of every construct, from who people usually are to where they are heading and when.

Every score will carry its range, its basis and a status it has to earn against the program’s own control.

23domains in one tree, the civic domain our own
18measures of every behavior
8reads of every construct
7kinds of evidence on one id
6grains, person to community
5bases on every score
9checks before a model is offered
4statuses, grounded to proven
DESIGN COUNTS FOR THE SECOND EDITION, NOW BEING BUILT · NO RESULT IS CLAIMED FOR THEM

Each line keeps today’s read and adds to it.

Inputs

TODAYBehavior and the electoral record

SECOND EDITIONSeven kinds of evidence on one permanent id

Each behavior

TODAYRead by topic

SECOND EDITIONEighteen measures, regularity and context stability among them

Reads

TODAYTrait or state, one per model

SECOND EDITIONEight, adding trajectory, next, timing, value and interaction

Certainty

TODAYA score and its model card

SECOND EDITIONA score with a range, a basis and an evidence depth

Grading

TODAYThe gate on the client’s holdout

SECOND EDITIONThe gate, forward tests on held data, and a scorecard per program

History

TODAYThis week’s reading

SECOND EDITIONAny reading as it stood on any date

RECORD · READINESS TO ACT · DISTRICT 0036Illustrative
0255075100−25 wk−19 wk−13 wk−7 wkThis weekHearing set
Position76 of 100
Range70 to 81
BasisBlended
Evidence depthB
Two ranks4 of 65 · 3 of 22
Last evidenceTwo days ago
TrendRising, 30 days
TenureSix weeks
ExpiryThree weeks
Top reasonsNews ↑ sign-ups ↑
Model and gradev3 · Checked
Rules of useOpen tier

Every score will travel with its own record.

A score on its own invites more trust than it has earned. In the second edition no score moves without its range, the evidence it rests on, the date of its last evidence and the status its model has earned.

A recipient can be sent a score without its basis; never the other way round. Every score is kept as it stood each week, so a program can read back exactly what was known on the day it acted.

Inside a program’s own instance the same record reads a person in full: open models only, reached through an audience and never by name.

A model earns its status in order.

01GroundedPublished research supports the construct, with the passage on file.
02CheckedNine checks pass on our own data, each one dated.
03Forward-testedIt ranks later behavior on held data it never saw, before any program.
04ProvenA program read it against its sealed holdout.
ConvergentDiscriminantKnown groupsStabilityCoverage and spreadProxy: under 0.60 for any excluded traitSensitivityIncrementalDecay
  • A health condition, read on a person or a place
  • Sexual orientation, immigration status or criminal history
  • Anyone under 18
  • A score built on emotional state, distress or money trouble
  • A lookup by name, or an eligibility decision of any kind

More depth calls for a firmer line.

Identity reaches a program by a separate and narrower door: as the composition of districts, in cells of at least twenty-five, or, for a single person-level use, under a written approval that names the trait, the purpose, who sees it and when it is deleted.

Emotional tone is read for groups of twenty-five or more. It is never a score for a person and never a condition of an audience.

Brushworks Index

See the second edition in Terrain.

ILLUSTRATIVE · A DESIGN PREVIEW OF THE SECOND EDITION, BEING BUILT NOW · NOTHING HERE IS A MEASURED RESULT
The limitsWritten into every engagement

What the Index is never for.

I

No model without the gate.

Nothing ships without beating two baselines on your own holdout. Failures are logged and published in aggregate.

II

No candidate that learns an excluded attribute.

The exclusion check runs before the gate, on every model and every signal.

III

No commingling.

Client files are matched per program under written data-use agreements and never shared between clients.

IV

Nothing in the clear.

Individuals and households are matched on keyed hashes, at the edge.

V

No guesses presented as scores.

A score is calibrated or it is re-fitted before it can ship.

NEXT ON THE DESKThe map
Terrain→

Start a conversation

Brief us.

Tell us the race, the calendar and the margin. Within a week we will tell you whether we can move it and what it would take. Candidate work and independent-expenditure work are taken by separate teams; say which you are. Governments and institutions: tell us the mandate and the jurisdiction, and we will tell you what registration it requires before we say anything else.

Send a briefbrief@brwrks.com

  • Candidate practice
  • Independent-expenditure practice
  • International practice

Brushworks Strategies Inc., a Wyoming corporation · Washington, New York, Ottawa, London, Munich, Dubai, Tokyo