Gap
Validation findings are errors or warnings, with no severity grading and no suppression mechanism.
That gap has already forced at least two design compromises:
- Requirement object-coverage shipped as a WARNING deliberately — because on a real repo carrying one requirement it reports ~93 unclaimed entities, so promoting it to an error would fail a project's first
verify. With suppressions it could be an error with recorded, reviewable opt-outs, which is strictly more useful than a warning everyone learns to ignore.
@verifiedBy convention detection (0.23.1) hit the same shape — an unrecognised test convention had to WARN rather than convict, because there was no way for a project to say "this is fine, here's why."
The pattern: when a check cannot be suppressed, the only way to avoid false convictions is to weaken it for everyone.
Prior art (open source)
Smithy grades validation events NOTE / WARNING / DANGER / ERROR and supports per-finding suppressions. https://smithy.io/2.0/guides/smithy-build-json.html
Notes
Gap
Validation findings are errors or warnings, with no severity grading and no suppression mechanism.
That gap has already forced at least two design compromises:
verify. With suppressions it could be an error with recorded, reviewable opt-outs, which is strictly more useful than a warning everyone learns to ignore.@verifiedByconvention detection (0.23.1) hit the same shape — an unrecognised test convention had to WARN rather than convict, because there was no way for a project to say "this is fine, here's why."The pattern: when a check cannot be suppressed, the only way to avoid false convictions is to weaken it for everyone.
Prior art (open source)
Smithy grades validation events NOTE / WARNING / DANGER / ERROR and supports per-finding suppressions. https://smithy.io/2.0/guides/smithy-build-json.html
Notes