Skip to content

Dogfood setup for this repository, and a README that leads with the point (story 28.10) - #227

Merged
fabbrik merged 2 commits into
mainfrom
feat/28-10-dogfood
Oct 31, 2026
Merged

fabbrik merged 2 commits into
mainfrom
feat/28-10-dogfood

Conversation

@fabbrik

@fabbrik fabbrik commented Oct 31, 2026

Copy link
Copy Markdown
Owner

Story 28.10, the last of Epic 28. Everything to run the Claude Code recipe on this repository's own development and read the result honestly, up to but not including switching it on (installing hooks and aexp trust are the maintainer's steps by design).

  • dogfood/aexp.config.json (SQLite, holdout 0.5, recall on, no recipe consents), dogfood/verify.sh (build plus the Docker-free test projects from CONTRIBUTING; a test keeps the two lists equal), dogfood/preregistration.json written before any session (sessions are randomized, turns analysed, clustering stated; at least 20 verified runs per arm; one reading plus a stated second look; deadline 2027-04-30; file digests checked by a test), dogfood/README.md with the human steps.
  • aexp benefit --markdown <file>: a results page in the CI-triage style.
  • README now opens with what the library is for, one example on a failure, and an honest "Does it help?" (benefit on one synthetic task; no overall benefit yet on realistic tasks; wrong lessons worse than none), then three ways in (MAF, CLI/MCP, Claude Code). A new "The evidence so far" section holds the real-task, transfer and CI-triage results; a stale "no live results yet" claim is corrected.

Tests: Cli 102, Release 200, every Docker-free project, pack and verify-packages.

🤖 Generated with Claude Code

https://claude.ai/code/session_01GPXz56QPQAzDSyJTxbQTTy

fabbrik and others added 2 commits October 30, 2026 20:44
…ory 28.10)

- aexp benefit --markdown <file>: the holdout's estimate as a committable results page
  (counts, rates, difference with 95% interval, verdict, pending/unverified, reading rules,
  what it can and cannot say, including session clustering).
- dogfood/: config (copied to .aexp/config.json), verify.sh (the Docker-free test set,
  kept equal to CONTRIBUTING.md by a test), pre-registration written before any session
  (session = randomized unit, run = analysed unit, file digests checked by a test),
  and the human steps to switch it on. Nothing is switched on.
- README leads with purpose, the loop on a failure, the evidence (now with real-task,
  transfer and CI-triage results) and the three ways in; detail moved down.
- .gitignore excludes .aexp/. No library API change.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GPXz56QPQAzDSyJTxbQTTy
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01GPXz56QPQAzDSyJTxbQTTy
@fabbrik
fabbrik merged commit e8ba59a into main Oct 31, 2026
23 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant