Repeated system prompts, project profiles and long context can reuse upstream prefix caching to reduce upstream costs. Plan quota is still metered at the model multiplier; cache hits do not reduce quota deductions.
Automatic prefix cache
How it works
System prompts, profiles and tool definitions are recognised as a stable prefix and cached with no request changes.
Requests distinguish cached and uncached tokens. Usage shows estimated upstream cache costs; these estimates do not represent reductions in plan quota or user payments.
Set TTL and minimum cache length per project or key; switch it off for sensitive projects.
Input
Set TTL and threshold
Processing
Apply on the request side
Result
Disable or clear any time
Availability
Planned
Requirements
Not available yet; no current plan includes this capability.
Invalidation
How it works
When a profile or memory changes the matching cache is invalidated so stale context is never reused.
Input
Detect a context change
Processing
Void the related cache
Result
Rebuild on the next request
Availability
Planned
Requirements
Not available yet; no current plan includes this capability.
Cache dashboard
How it works
Planned: cache hit rates, estimated upstream cost savings and latency trends by day and Key. Savings estimates do not represent reduced plan quota deductions.
Input
Aggregate cache hits
Processing
Estimate upstream cost changes
Result
Compare latency trends
Availability
Planned
Requirements
Not available yet; no current plan includes this capability.
Select a project explicitly or through a supported client workspace to use its profile and memories. Associating a key alone does not select a project.