mirror of
https://github.com/teamchong/pxpipe.git
synced 2026-07-22 02:02:51 +02:00
teamchong
378dd7f6c4
Widen the model gate to /^claude-opus-4-(?:[7-9]|[1-9]\d)(?:-|$)/ (Opus 4.7 and newer; previously 4.6/4.7). Wire isPixelpipeSupportedModel into the proxy boundary in proxy.ts — the proxy previously gated on economics only and ignored the model, so it compressed 4.8 traffic despite the docs claiming a 4.6/4.7 scope. Unsupported models now pass through with reason 'unsupported_model'. Update public-api tests to the 4.7+ spec (320/320 pass). Correct the docs to live measurement: reverse the POSTMORTEM "dead" verdict (pixelpipe is a lossy gist-compressor saving ~68% on real dense Claude Code traffic; the verbatim 0/15 needle finding stands as a caveat, not the verdict), rewrite README Status/Limitations, and add a correction pointer to the eval README. Original POSTMORTEM body preserved below the correction. BREAKING CHANGE: Opus 4.6 and older are no longer supported. Verbatim-risk guard (skip imaging unique IDs/hashes/exact values) still pending.
2.0 KiB
2.0 KiB
| 1 | mode | cond | trial | expected | got | match | dur_s |
|---|---|---|---|---|---|---|---|
| 2 | verbatim | off | 1 | 2fc5de4ab9f4 | 2fc5de4ab9f4 | 1 | 4 |
| 3 | verbatim | off | 2 | 7eed1ae84e54 | 7eed1ae84e54 | 1 | 11 |
| 4 | verbatim | off | 3 | 005cbfb7815b | 005cbfb7815b | 1 | 4 |
| 5 | verbatim | off | 4 | 0f0c4265270d | 0f0c4265270d | 1 | 4 |
| 6 | verbatim | off | 5 | dd7e53d14b96 | dd7e53d14b96 | 1 | 4 |
| 7 | verbatim | off | 6 | 2a4efaa93336 | 2a4efaa93336 | 1 | 4 |
| 8 | verbatim | off | 7 | 4b43a46a8b01 | 4b43a46a8b01 | 1 | 4 |
| 9 | verbatim | off | 8 | 0e1b8d57e3ab | 0e1b8d57e3ab | 1 | 4 |
| 10 | verbatim | off | 9 | 01372af05f10 | 01372af05f10 | 1 | 3 |
| 11 | verbatim | off | 10 | f08f0c31ccdc | f08f0c31ccdc | 1 | 6 |
| 12 | verbatim | off | 11 | 9b29dc23e49a | 9b29dc23e49a | 1 | 4 |
| 13 | verbatim | off | 12 | bad1c1c27c4a | bad1c1c27c4a | 1 | 4 |
| 14 | verbatim | off | 13 | 7f371931fdc4 | 7f371931fdc4 | 1 | 4 |
| 15 | verbatim | off | 14 | d3709779d038 | d3709779d038 | 1 | 6 |
| 16 | verbatim | off | 15 | 9bafa158b5d9 | 9bafa158b5d9 | 1 | 4 |
| 17 | verbatim | on | 1 | e120b7b29ee6 | 0 | 11 | |
| 18 | verbatim | on | 2 | 4037adeb43f4 | 0 | 15 | |
| 19 | verbatim | on | 3 | 521196283337 | 0 | 12 | |
| 20 | verbatim | on | 4 | c28bdcd923d7 | 0 | 12 | |
| 21 | verbatim | on | 5 | 9bfdd600f488 | 0 | 11 | |
| 22 | verbatim | on | 6 | 0455b01cffd6 | 0 | 13 | |
| 23 | verbatim | on | 7 | 5089b2fa1f5e | 0 | 10 | |
| 24 | verbatim | on | 8 | 36aaf8060a06 | 0 | 15 | |
| 25 | verbatim | on | 9 | 9d449f0d4db7 | 0 | 8 | |
| 26 | verbatim | on | 10 | d1db8cc15e95 | 0 | 11 | |
| 27 | verbatim | on | 11 | f08adb293f85 | 0 | 11 | |
| 28 | verbatim | on | 12 | 2ed386759db9 | 0 | 9 | |
| 29 | verbatim | on | 13 | 91dbe0e38a4b | 0 | 13 | |
| 30 | verbatim | on | 14 | 0ac7da1038da | 0 | 14 | |
| 31 | verbatim | on | 15 | 98657c6376e5 | 0 | 21 | |
| 32 | semantic | off | 1 | 30000 | 30000 | 1 | 3 |
| 33 | semantic | off | 2 | 10 | 10 | 1 | 5 |
| 34 | semantic | off | 3 | 2000 | 2000 | 1 | 3 |
| 35 | semantic | off | 4 | 2000 | 2000 | 1 | 4 |
| 36 | semantic | off | 5 | 256 | 256 | 1 | 4 |
| 37 | semantic | off | 6 | 64 | 64 | 1 | 4 |
| 38 | semantic | off | 7 | 10 | 10 | 1 | 3 |
| 39 | semantic | off | 8 | 30 | 30 | 1 | 4 |
| 40 | semantic | off | 9 | 600000 | 600000 | 1 | 4 |
| 41 | semantic | off | 10 | 32 | 32 | 1 | 4 |
| 42 | semantic | off | 11 | 8 | 8 | 1 | 3 |
| 43 | semantic | off | 12 | 60 | 60 | 1 | 5 |
| 44 | semantic | off | 13 | 5000 | 5000 | 1 | 3 |
| 45 | semantic | off | 14 | 10000 | 10000 | 1 | 3 |
| 46 | semantic | off | 15 | 60000 | 60000 | 1 | 4 |
| 47 | semantic | on | 1 | 30000 | 30000 | 1 | 5 |
| 48 | semantic | on | 2 | 10 | 20 | 0 | 5 |
| 49 | semantic | on | 3 | 2000 | 2000 | 1 | 6 |
| 50 | semantic | on | 4 | 2000 | 2000 | 1 | 5 |
| 51 | semantic | on | 5 | 256 | 256 | 1 | 11 |
| 52 | semantic | on | 6 | 64 | 0 | 9 | |
| 53 | semantic | on | 7 | 10 | 0 | 8 | |
| 54 | semantic | on | 8 | 30 | 30 | 1 | 10 |
| 55 | semantic | on | 9 | 600000 | 600000 | 1 | 5 |
| 56 | semantic | on | 10 | 32 | 1 | 0 | 5 |
| 57 | semantic | on | 11 | 8 | 10 | 0 | 4 |
| 58 | semantic | on | 12 | 60 | 0 | 10 | |
| 59 | semantic | on | 13 | 5000 | 0 | 7 | |
| 60 | semantic | on | 14 | 10000 | 1000 | 0 | 4 |
| 61 | semantic | on | 15 | 60000 | 30000 | 0 | 4 |