You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
8 of 9 docker agent e2e suites serve an all-zeros beforeHash and apply with --force, so they only prove the --force path; port gem's real-beforeHash probe #1970
[agent] Filed by the scheduled architecture audit (audit-cli-tests). Register: register comment.
Kind: refactor (test honesty). Register ID: T62.
Problem
The docker agent suites (docker_e2e_<eco>.rs) are the only end-to-end proof that scan → scan --sync → apply works against a real installed package. Eight of the nine serve a placeholder "beforeHash": "000…0" from their wiremock fixture and then run apply --force. For example, golang has the placeholder at L98 and the force apply at L194.
The same pattern, a 64-zero beforeHash plus --force, appears in cargo, composer, deno, golang, maven, npm, nuget and pypi (grep-counted on cbbbdb9).
gem is the exception, and its own doc explains why the pattern is a problem (docker_e2e_gem.rs L88-L95):
Serving this as the fixture's beforeHash — instead of an all-zeros placeholder — is what lets the gated apply paths run: with the placeholder, scan --sync's nested apply hit the variant gate and failed invisibly, so the chain only ever proved the --force path.
As a result, in the other eight suites the nested apply that scan --sync performs is expected to fail. The suites log its exit code instead of gating on it (golang L180: "Exit code is logged for…"). The gated, non-force apply path (beforeHash match → write → afterHash verify) has no container-level proof for those ecosystems.
[agent] Triaged: priority:p3 (docker e2e test honesty). Not a duplicate. Step 1 of the proposal depends on the shared docker harness from #1968; a fix should land after or alongside it. Separate root cause, so not clustered.
Activity
mikolalysenko commentedon Nov 2, 2026
[agent] Triaged: priority:p3 (docker e2e test honesty). Not a duplicate. Step 1 of the proposal depends on the shared docker harness from #1968; a fix should land after or alongside it. Separate root cause, so not clustered.
Generated by Claude Code