dashboard: fix bogus savings math + emit compressed_chars

The dashboard headline was showing 0% saved because the math was
apples-to-oranges:
  - orig_chars = static slab + tool docs ONLY (~135 KB)
  - image_count = ALL images including reminders + tool_results (~33)
  - txtReplaced = 135k/4 = 33.7k tokens
  - imgTokensEst = 33 × 2500 = 82.5k tokens
  - extraText = max(0, 33.7k - 82.5k) = 0  ← clamped negative
  - baseline == paid → 'saved 0%' headline despite real savings happening

Two fixes:

1. Track 'compressedChars' separately from 'origChars'. It accumulates
   only when a block actually image-renders (passes the break-even gate
   AND any per-block min thresholds). Includes the static slab + all
   compressed reminders + all compressed tool_results.

2. Remove the Math.max(0,...) clamp in baselineCost(). Negative savings
   surface honestly — they're the signal that small-block compressions
   are cost-bleeding, which the break-even gate is supposed to prevent.

Wires:
  - TransformInfo.compressedChars (new field, mandatory).
  - All 4 image-render success paths accumulate (static slab + reminder
    + tool_result string branch + tool_result array branch).
  - TrackEvent.compressed_chars (new optional field, emitted when > 0).
  - dashboard.baselineCost() takes compressedChars now; clamp removed.
  - sessions.aggregateSessions() also uses compressed_chars + honest math.

229/229 tests passing. Bundle stays at 496 KB gzipped.

Post-restart, the dashboard 'tokens saved' will show real numbers
including negatives. Empirically expect ~1-5% net positive in
steady-state cache-hit traffic.
This commit is contained in:
teamchong
2026-05-18 23:01:12 -04:00
parent 4f5b10aaee
commit 8fbd53ea3e
5 changed files with 51 additions and 17 deletions
+7
View File
@@ -29,6 +29,10 @@ export interface TrackEvent {
compressed?: boolean;
reason?: string;
orig_chars?: number;
/** Sum of text-chars actually replaced by image blocks this request (static
* slab + reminders + tool_results). Apples-to-apples with image_count for
* savings math: textTokens(compressed_chars/4) vs imageTokens(image_count×2500). */
compressed_chars?: number;
image_count?: number;
image_bytes?: number;
static_chars?: number;
@@ -160,6 +164,9 @@ export function toTrackEvent(ev: ProxyEvent): TrackEvent {
if (info.compressed !== undefined) out.compressed = info.compressed;
if (info.reason) out.reason = info.reason;
if (info.origChars !== undefined) out.orig_chars = info.origChars;
if (info.compressedChars !== undefined && info.compressedChars > 0) {
out.compressed_chars = info.compressedChars;
}
if (info.imageCount !== undefined) out.image_count = info.imageCount;
if (info.imageBytes !== undefined) out.image_bytes = info.imageBytes;
if (info.staticChars !== undefined) out.static_chars = info.staticChars;