Ákos Tóth 0418247e7e
feat: add cacheMessageOffset to PromptCachingConfig (#1412)
Add `cacheMessageOffset` field to `PromptCachingConfig`. When set,
shifts the Bedrock message cache point further back from the default
second-to-last position.

- `cacheMessageOffset: 0` (default): no change in behavior
- `cacheMessageOffset: N`: cache point moves N additional messages
toward the start, clamped to bounds

This gives callers control over which portion of the conversation is
covered by the cache prefix — useful for agentic workloads where
mid-conversation compaction may mutate recent messages.

Co-authored-by: Devin <158243242+devin-ai-integration[bot]@users.noreply.github.com>
2026-04-07 16:25:36 -07:00
..
2026-02-18 19:13:02 +00:00

Schemas

This folder contains JSON schemas for various parts of the project.

CEL

The schema for the CEL expressions used in the rules. See the CEL documentation for more details.

Configuration File

The schema for the configuration file (passed with --file to agentgateway).