Wire up feature flag for rollout

auth-gateway · claude-opus-4-8 · 95m · 2d ago · Chen Iyer

Part of: Session revocation sweep

Session tokens

9.5M tokens

1.9M raw tokens

Avoidable tokens (est.)

8.6M tokens

90% of session

Quality

craft check score

Outcome

Abandoned

8 cycles · 2 corrections · 95m wall-clock

PromptGenerateVerifyCorrect

13mrevised

14maccepted

14mrevised

correction

13mrejected

12maccepted

12mrevised

8maccepted

correction

9mabandoned

8 verify events · 0 accepts without verify — chips are pinned to the cycles that triggered them.

Grounded answers with mandatory cycle citations

Answers are PROXY — generated over the measured transcript. This query is visible to the engineer in their access log.

What drove the score — pinned to its cycles

Verification discipline98
Every accepted diff was preceded by a verify-type event
Plan-mode discipline51
No plan-mode use in this session
Correction load68
2 of 8 cycles were corrections of earlier output
Prompt clarity82
Context, constraints, and a done-condition raise first-pass acceptance

Caught in this session

critical
Prod access
Session touched production database credentials
Flagged in-session by your risk rules
low
Prod access
Session touched production database credentials
Flagged in-session by your risk rules