Sutura Case Lab

Upstream dependency incident

Recorded live result Gave up

No patch: the evidence did not support one

The available checks could not decide whether a patch preserved the required behavior. This did not match what the case expected, and the mismatch is kept in the record.

Historical recorded result · A CommonJS service breaks on an ESM-only release. Sutura must ground the diagnosis before it repairs. · subject 3b6152d9d72beebd7dcbaaa4045c94d640456adb · 2026-10-27T08:37:36.514Z

Add or declare a contract that states the required behavior, then run again.

This result is a recorded live benchmark evaluation of the released Sutura version, not a run started from this page.

Expected Fixed; this result does not match. The failure is kept in the record.

Failed commit and CI evidence

Nano diagnosis and confidence

Failure class
infra
Confidence
49%
Signals
  • TypeError: chalk.green is not a function
  • mechanical:infra
  • llm:test-bug
  • llm-command-mismatch
  • llm-excerpt-ungrounded
  • llm-class-ungrounded

Diagnosis recovery

Clean audit branch and Ultra verdict

Not run. No candidate survived for adversarial audit.

Final outcome

Gave up Recorded live result

Sutura never merges a generated repair. A gave up result still needs human review.

Check a patch this page did not produce

This run did not record an exact failing commit and policy commit, so both are shown as placeholders. Verification is always tied to exact commits. A patch cannot ask for a more permissive policy by carrying one, and no green log is accepted in place of execution.

sutura verify \
  --case-dir <checkout> \
  --source-sha <failing commit> \
  --policy-base-sha <trusted policy commit> \
  --candidate-diff <patch file> \
  --failing-command diagnosed \
  --format json

The same route runs as a GitHub Action and needs no repository write access. Uploading a patch stays a command-line and Action route; this page never runs one.

Execution and cost detail
Release
v0.4.1 · Action 3b6152d9d72beebd7dcbaaa4045c94d640456adb
Controller
3b6152d9d72beebd7dcbaaa4045c94d640456adb
Request
recorded-upstream-incident · 2026-10-30T06:58:46.085Z

ConTree search tree and branch status

Triage: real · reproduced 4/4 · stop reason failure-boundary · method sprt-p20-p80-a05-b05-v1

NodeParentDepthTerminal reasonTest exitPolicyChanged filesDiff bytes
search-001root1open1valid1245
search-002root1failed1valid00
search-003root1repeated-state1valid1245
search-004search-0012repeated-state1valid1245

Super proposals and candidate patches

No candidate patch was proposed.

Rejected patches and rejection reasons

No candidate was rejected.

Token cost, provider cost, latency, and sandbox operations

Inference cost
USD 0.003059
Sandbox cost
USD 0.074661
Elapsed
102.7 s
CPU time
6.90 s
Peak memory
120 MiB
Sandbox stages
21 (10 with an operation id)
RoleCallsInput tokensOutput tokensCost
nano11887447USD 0.000221
super59022146USD 0.002838

Recorded from docs/demo/placebo-v0.4.1-live-2026-10-27.json (result hash d8eb9f18c578…) at 2026-10-27T08:37:36.514Z, subject 3b6152d9d72beebd7dcbaaa4045c94d640456adb.

Result hash 7d96cf1921e62b71bcf6bde0d21a819ba430ae32bdf3df2a466632ea3aba21d1