Repository navigation
Conversation
Scripts and a draft note on why Populace US state child SPM poverty rates miss Census P60-290 Table 18. Figures still running carry slots in the README. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Fills the note from the 51-state runs: noise and systematic error, the step decomposition, the rent assignment bug, ACS-local results, the dashboard's exposure and the ordered fixes. Scripts, state-level outputs and receipts sit beside it. Poverty stays a holdout throughout. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The review found the dense pool at initial weights fits Census far better than at published weights, so weights, not missing records, carry most of the systematic error. The note now leads with that, reports noise's share with its interval, and reorders the fixes. It also corrects the ablation labels, the null-test intervals, the dashboard's build comparison, the PUF housing mechanism and the ACS rent path. Clusters now merge an ASEC record with its PUF clone on every file, and receipts pin input contents. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The initial-weight columns share households with Table 18, so state-specific error rises about 1.7 times, not double, and a test with no shared households keeps the direction. Scope the weights finding to the dense pool, name Louisiana alone among persistent misses, and call the fix order a judgement. Also corrects the ablation, anchor and ASEC-PUF claims, adds the corrected-rent reform pass, and stores the threshold swap and Kish figures. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Stop naming Louisiana as a finding: one joint miss matches chance. Compare the rent fix's moves like for like and trace Florida's swing to a few donor households. Correct the shared-Census correlations for shared households, add the same-pipeline row that anchors the penalty grid, and leave unrun reform deltas empty. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
The p of .53 answered whether any state clears 1.96 on both comparisons, not whether a miss as large as Louisiana's beats chance. A permutation of the largest joint z gives .19. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
|
Hold: don't cite this PR's ACS-local figures yet. They rest on a wrong fill, and a rerun is pending. The evidence scripts filled blank parent links in the ACS-local file with -1. PolicyEngine-US reads 0 as unknown ( Every blank sits on a donor: all 166,321 ASEC and PUF-channel people, in 57,240 households. They carry 70% of the weighted people and 68% of the weighted children. No ACS person holds a blank. The deck's 51-state run uses fill 0 on the same file and model (PolicyEngine/policyengine-slides#95 at 99ee5b354). Comparing the two baselines gives this, as arithmetic on real runs:
Census reads 17.9 for California, so its gap reads +2.47, not +1.91. Still stale on the ACS-local file: standard errors, the ACS and donor splits, reform effects, the #1078 solves and the corrected-rent runs. Not affected: everything on the default and dense files. The default file stores no parent columns, and the dense file stores no blanks. Next: a full 51-state rerun under fill 0 replaces these figures. The host's release booking holds new microsim runs until the release passes its terminal gates, and Fleet ops asked me to wait for that. This PR stays in draft until the rerun lands. |
Adds
docs/evidence/us-state-child-spm-2026-11/, a diagnosis of why Populace US state child SPM rates miss Census P60-290 Table 18, with its scripts, state-level outputs and receipts. It changes no code and no data. Next steps sit in #1446.What it finds
policyengine.pyroutes state regions to the ACS-local file, which gives a mean gap of +0.88 and a mean absolute gap of 3.18, with a median state standard error of 2.98.How to check it
receipts.jsonlists digests for the scripts, the outputs and every input outside the repo. Scripts inscripts/ran on policyengine-us 2.90.2, cutting one state at a time. The README's reproduction section gives the order. Poverty stays out of the targets. Model figures come from microsimulation runs or labelled arithmetic on them, and Census comparisons use published tables or raw ASEC.Any release of rebuilt data waits on Max: d2300 covers the rebuild and d2301 the ACS-share default.
axiom: n/a: evidence only, no policy logic.
🤖 Generated with Claude Code