Skip to content

fix: honest empty city + no verdict without samples - #17

Merged
arko33 merged 1 commit into
mainfrom
fix/live-no-filler
Oct 21, 2026
Merged

arko33 merged 1 commit into
mainfrom
fix/live-no-filler

Conversation

@arko33

@arko33 arko33 commented Oct 21, 2026

Copy link
Copy Markdown
Owner

Real-user live session exposed demo set-dressing leaking into recordings:

  • The 44 'district block' ambient filler towers were added to every city, including live recordings — an empty repo rendered dozens of fake buildings. Live sessions now get zero filler: the skyline is exactly the files the session touched.
  • Autopsy verdict 'no anomaly detected — samples stayed inside every threshold' is a claim we cannot make with 0 runtime samples; live with no probes now shows 'runtime monitor waiting' and points at --app-url. typecheck green.

…e); autopsy verdict refuses to judge with 0 samples
@vercel

vercel Bot commented Oct 21, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
ghostinthecodebase Ready Ready Preview Oct 21, 2026 7:17pm UTC

@testsprite

testsprite Bot commented Oct 21, 2026 •

Copy link
Copy Markdown

Caution

Failed Widespread failures — 23 failed

The backend run is not demonstrating stable, verifiable behavior: 1 test passed and 24 tests failed, with no frontend coverage in this run. Because the failures all reported the same TestSprite internal error reference, the executable subset effectively showed one passing integration path and a broad inability to complete the rest of the suite. The score is computed only from the executable subset (passed vs failed) and excludes any blocked tests; there were no explicit blocked results here. Overall, confidence in invoice create/read/list/auth flows is low, and the current run does not provide evidence that the API is consistently meeting its contract.

Results: Passed 1 passed • Failed 23 failed • 24 total  ·  View Full Report ↗


Failed 23 failed tests

Failed Create an invoice then read it back

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed List invoices does not leak other users' invoice records or fields

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Create invoice with malformed JSON body returns 400 invalid_json

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Reject unauthenticated invoice read

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Create invoice without x-user-id returns 401 and no invoice is created

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Unauthenticated request to invoices endpoint should not reveal data even if caller is otherwise valid

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed List invoices with a real user session returns only that user's seeded invoice

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed List bob's own invoices

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Create and read invoice as Alice, ensuring owner isolation fields

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Reject invoice listing without authentication

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Unknown x-user-id value returns 401 on POST /api/invoices

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Invoice list response shape is stable for seeded invoices

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Reject missing auth before invoice existence is evaluated

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Unknown invoice id returns not_found even for authenticated user

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Get own seeded invoice by id as Alice

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Reject invoice listing with unknown user identity

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Create invoice with non-numeric amount returns 422 and creates nothing

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Deny access when Alice reads Bob's invoice

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Get own seeded invoice by id as Bob

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed List alice's own invoices

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Create invoice with missing customer returns 422 and creates nothing

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Read a created invoice using the id captured from create

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)


Failed Return 404 for an unknown invoice id

Screenshot Error details

—

TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)

Passed 1 passed test
Test Case Status Screenshot
Invoice visibility and retrieval flow Passed Passed —
Evaluation Evaluation details

What could be better What could be better: The main issue is that nearly every invoice-related scenario failed at execution time with the same harness-side message: "TestSprite hit an internal error while running this test; our team has been notified. (ref: d1e0cc82-242a-48ed-ac90-ee8f22471074)". That prevents the suite from distinguishing real API defects from test-environment problems. Still, the coverage areas are clear: create/read flows, list isolation, auth rejection, malformed JSON handling, and 404/422 validation on /api/invoices. If these endpoints are intended to be production-ready, they need to be re-run under a stable harness so status codes, ownership isolation, and request validation can be confirmed.

Next steps Recommended next steps: First, rerun the invoice API suite in a clean environment to determine whether the repeated TestSprite internal error is masking real backend failures or is purely a harness issue. If the error persists, inspect the test runner logs and any shared setup/teardown around invoice fixtures, auth headers, and seeded users. If the runner succeeds, focus on the highest-risk behaviors in the invoice endpoints: authenticated create/read/list, owner isolation, malformed JSON, missing x-user-id, and unknown invoice IDs. Then fix the API until POST /api/invoices, GET /api/invoices, and invoice-by-id responses consistently match the expected auth and validation contract. See the fix prompt for a copy-ready task list.


Automated end-to-end testing powered by TestSprite

@arko33
arko33 merged commit db4efd7 into main Oct 21, 2026
4 checks passed
@arko33
arko33 deleted the fix/live-no-filler branch October 21, 2026 19:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant