Jj[ dZddlZddlmZmZmZddedededdfd Zdededefd Z d e dee e ffd Z ddeee efde dedeee effdZ dS)uBAnthropic prompt caching strategy. Single layout: ``system_and_3``. 4 cache_control breakpoints — system prompt + last 3 non-system messages, all at the same TTL (5m or 1h). Reduces input token costs by ~75% on multi-turn conversations within a single session. Pure functions -- no class state, no AIAgent dependency. N)AnyDictListFmsg cache_markernative_anthropicreturnc|dd}|d}|dkr |r||d<dS||dkr|dkr|sdS|dkr|sdS||d<dSt|tr d||d g|d<dSt|tr&|r&|d }t|tr ||d<dSdSdSdS) zFAdd cache_control to a single message, handling all format variations.rolecontenttool cache_controlN assistanttext)typerr)get isinstancestrlistdict)rrrr r lasts :/home/rurouni/.hermes/hermes-agent/agent/prompt_caching.py_apply_cache_markerrs! 7762  Dggi  G v~~*~ ,O'R-- 6>>"2> F ;  '7  F+O'3W| L L I '4  1W1r{ dD ! ! 1$0D ! ! !1111 1 1c|rdS|d}||dkrdSt|tr*t|ot|dtSt|t S)uTrue if a marker on this message is actually honored by the provider. On the native Anthropic layout every message works (top-level markers are relocated by the adapter). On the envelope layout (OpenRouter et al.) only markers inside content parts are honored: empty-content messages (e.g. assistant turns that are pure tool_calls) and empty tool messages would receive a top-level marker the provider ignores — wasting one of the four breakpoints. Skip those so the breakpoints land on messages that count. Tr Nr Fr)rrrboolrr)rrr s r_can_carry_markerr4swtggi  G'R--u'4  ? G}}>GBK!>!>> gs # ##rttlc$ddi}|dkrd|d<|S)zCBuild a cache_control marker dict for the given TTL ('5m' or '1h').r ephemeral1hr )r markers r _build_markerr&Ls#$k2F d{{u Mr5m api_messages cache_ttlc|tj|sSt|}d}dddkrt d||dz }d|z }fdt t D}|| dD]}t ||S) aApply system_and_3 caching strategy to messages for Anthropic models. Places up to 4 cache_control breakpoints: system prompt + last 3 non-system messages, all at the same TTL. Returns: Deep copy of messages with cache_control breakpoints injected. rr systemrcg|]:}|ddk!t|8|;S)r r+r,)rr).0imessagesrs r z1apply_anthropic_cache_control..nsX A;??6 " "h . . hqkr?s+ """""""""""1"1T"1"1"1Z^"1"1"1"1J$4$4$D$$$$0stCH~"##tCH~&### $sCx. ######r