Repository navigation
Conversation
…isk-mib N)
An entry evicted from --cache-ram was dropped, so a mind whose saved conversation
aged out re-prefilled it whole. With --cache-disk the oldest resident entry is
written to DIR instead (its sequence state and its checkpoints' data); its tokens
and checkpoint positions stay in RAM so a lookup still matches it, and a match
reads it back and removes the file. An entry larger than the whole RAM tier goes
straight to disk instead of displacing every other entry; the disk tier evicts its
own oldest at its limit. States another engine instance left in DIR are removed at
start; this instance's files are removed when the cache is destroyed.
Why: on the M5 (2026-10-27) the RAM tier was 11,961 MiB holding 2.4-6.6 GiB
entries; macOS compressed 13-15 GB of the engine and swapped 11.9 of 13.3 GB, so
the cache the engine believed resident was paying decompression and swap reads,
and 40+ entries were dropped ("removing oldest entry"), one 3,845 MiB state
skipped outright. A small RAM tier that stays uncompressed plus a disk tier
read at SSD speed keeps every resident's conversation restorable.
Logs: "spilled prompt cache entry to disk: N tokens, X MiB in T ms" and
"restored prompt cache entry from disk: ...", the receipts for the live read.
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01LoTjvf5j3Ez13g6k8mRkFo
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Spills prompt-cache entries evicted from --cache-ram to a directory and reads them back on a match. See the commit message for the M5 measurements (2026-10-27). Pairs with continuum card f35cbd9d.
🤖 Generated with Claude Code
https://claude.ai/code/session_01LoTjvf5j3Ez13g6k8mRkFo