 teamchong
|
8417380061
|
test: e2e guards for cache stability, dashboard honesty, and design behaviors
Test-only (no src changes). Adds fake-upstream + real-createProxy suites:
- cache-stability-e2e: byte-identical cacheable prefix across growth, marker
conservation + relocation onto the history image, tool-pair integrity.
- savings-math-e2e: gate never images at a net loss; baselineImagedTokens
cross-checked against the real o200k tokenizer; baselineTokens wired from
the count_tokens probe.
- savings-honesty: categorical no-overclaim invariants (warm <= cold,
saved==delta*weight, zero credit on passthrough) + per-model pricing guards
(Anthropic 1.25/0.1 shared policy; GPT 0.1x model-gated).
- design-behavior-e2e: system-prompt imaging, history collapse (old imaged /
recent legible), tools-in-recent-turns kept usable.
- dashboard-api: GPT cold-cache parity (full text delta, not 0.1x warm rate).
Each guard mutation-verified (broke source, confirmed red, reverted).
|
2026-06-23 12:30:16 -04:00 |
|