JjdZddlmZddlZddlZddlZddlZddlZddlmZddl m Z ddl m Z m Z mZddlmZejeZdZd ed Zd0dZGddZd1dZd1dZd2dZd3dZdddddd4d(Zd)d*d5d.Zgd/ZdS)6uContext compression — extract the AIAgent methods that drive summarisation. Three concerns live here: * :func:`check_compression_model_feasibility` — startup probe of the configured auxiliary compression model. Warns when the aux context window can't fit the main model's compression threshold; auto-lowers the session threshold when possible; hard-rejects auxes below ``MINIMUM_CONTEXT_LENGTH``. * :func:`replay_compression_warning` — re-emit a stored warning through the gateway ``status_callback`` once it's wired up (the callback is set after :class:`AIAgent` construction). * :func:`compress_context` — the actual compression call. Runs the configured compressor, splits the SQLite session, rotates the session_id, notifies plugin context engines / memory providers, and returns the compressed message list and freshly-built system prompt. * :func:`try_shrink_image_parts_in_messages` — image-too-large recovery helper that re-encodes ``data:image/...;base64,...`` parts at a smaller size so retries can fit under provider ceilings (Anthropic's 5 MB). ``run_agent`` keeps thin wrappers for each so existing call sites (``self._compress_context(...)``) keep working. Tests that exercise these paths see no behavioural change. ) annotationsN)datetime)Path)AnyOptionalTuple)estimate_request_tokens_roughzCompacting contextu🗜️ u: — summarizing earlier conversation so I can continue...agentrreturnstrc ddl}dtjd|jdt |ddt jjddS) aBuild a unique holder id for the lock: pid:tid:agent-instance:uuid. The pid+tid prefix lets ops tell crashed/abandoned holders apart from live ones (expiry-based recovery uses the timestamp, but ``holder`` is what shows up in diagnostics + log lines). The agent instance id and a per-acquire uuid disambiguate two co-resident agents on the same thread (background_review forks run on a worker thread, but on machines where compression itself dispatches to a thread pool we want each acquire to be unique). rNzpid=z:tid=z:agent=xz:nonce=) threadingosgetpid get_identiduuiduuid4hex)r rs D/home/rurouni/.hermes/hermes-agent/agent/conversation_compression.py_compression_lock_holderr7s{ )ry{{ ) )# #%% ) )U)) ) )*,,"2A2& ) )c2eZdZ ddd ZddZddZddZdS)_CompressionLockLeaseRefresherNdbr session_idr holder ttl_secondsfloatrefresh_interval_seconds float | Noner Nonec||_||_||_||_|!t dt d|dz }t dt ||_t dt|j|jz |_ tj |_ tj |jdd|_dS) N?gN@g@g?zcompression-lock-refreshT)targetnamedaemon)_db _session_id_holder _ttl_secondsmaxminr!_refresh_interval_secondsint_max_consecutive_failuresrEvent_stopThread_run_thread)selfrrrr r"s r__init__z'_CompressionLockLeaseRefresher.__init__Ls% ' # +'*3D+:K0L0L'M'M $),S%8P2Q2Q)R)R& *- s4$t'EEFF* * &_&&  '9+    r '_CompressionLockLeaseRefresher'c8|j|SN)r8startr9s rr>z$_CompressionLockLeaseRefresher.startjs  rc|j|jr7t j|jur|jddSdSdS)Nr&)timeout)r5setr8is_alivercurrent_threadjoinr?s rstopz#_CompressionLockLeaseRefresher.stopnsp  < " " +y'?'A'A'U'U L  c  * * * * * + +'U'Urcd}|j|js |j|j|j|j}n4#t$r'}t d|d}Yd}~nd}~wwxYw|rd}|dz }||j kr#t d||jdS|j|jdSdS)Nrr z#compression lock refresh raised: %sFr'zZcompression lock refresh failed %d times in a row; stopping lease refresher for session %s) r5waitr1r+refresh_compression_lockr,r-r. Exceptionloggerdebugr3)r9consecutive_failures refreshedexcs rr7z#_CompressionLockLeaseRefresher._runxs! !*//$"@AA  " H==$L $ 1>  " " " BCHHH!  " '($ A % #t'EEE >($*: )*//$"@AA     s,A BA<<Br=) rrrr rr r r!r"r#r r$)r r;r r$)__name__ __module__ __qualname__r:r>rFr7rrrrKsn26      <++++rrr$cz|jsdS ddlm}m}m}ddlm}m} |d\}}}}}n#t$rd}YnwxYw|d| \}} || sU|d|\} } } | C| rA| | } }d| vr9| d r$| dd d dd }|| sI|r |d krd |d} nd} | |_ | | tddSt!t#|dd}t#|dd}t%|rt'|t sdnt!|pd}|| ||t#|dd|r|d kr|nt#|dd|j}|r'||kr!t+d| d|dd|dd|dzd |jj}||kr|}|}||j_|jj}|r||z |j_|rt5||z dznd}t#|ddpd }t#|ddpd}|r|d kr|nd}|s. dd!lm}||jp|}n#t$r|pd }YnwxYw|r|d"|d n|}| d"|d }d#|d$|dd%|d&|dd'|dd(|dd)|d*} | |_ | | td+| |||dSdS#t*$rt$r&}td,|Yd}~dSd}~wwxYw)-auWarn at session start if the auxiliary compression model's context window is smaller than the main model's compression threshold. When the auxiliary model cannot fit the content that needs summarising, compression will either fail outright (the LLM call errors) or produce a severely truncated summary. Called during ``AIAgent.__init__`` so CLI users see the warning immediately (via ``_vprint``). The gateway sets ``status_callback`` *after* construction, so :func:`replay_compression_warning` re-sends the stored warning through the callback on the first ``run_conversation()`` call. Nr)_resolve_task_provider_model/_try_configured_fallback_for_unavailable_clientget_text_auxiliary_client)MINIMUM_CONTEXT_LENGTHget_model_context_length compression) main_runtime()r'autou/⚠ Configured auxiliary compression provider 'u' is unavailable — context compression will drop middle turns without a summary. Check auxiliary.compression in config.yaml and reauthenticate that provider.u⚠ No auxiliary LLM provider configured — context compression will drop middle turns without a summary. Run `hermes setup` or set OPENROUTER_API_KEY.uLNo auxiliary LLM provider for compression — summaries will be unavailable.base_urlapi_key&_aux_compression_context_length_configprovider)rcrdconfig_context_lengthrfcustom_providerszAuxiliary compression model z has a context window of ,z$ tokens, which is below the minimum zE required by Hermes Agent. Choose a compression model with at least izK context (set auxiliary.compression.model in config.yaml), or set auxiliary.compression.context_length to override the detected value if it is wrong.d2model?)urlparsez (u⚠ Compression model z context is z tokens, but the main model z's compression threshold was z2 tokens. Auto-lowered this session's threshold to u tokens so compression can run. To make this permanent, edit config.yaml — either: 1. Use a larger compression model: auxiliary: compression: model: 2. Lower the compression threshold: compression: threshold: 0.02duAuxiliary compression model %s has %d token context, below the main model's compression threshold of %d tokens — auto-lowered session threshold to %d to keep compression working.z4Compression feasibility check failed (non-fatal): %s)compression_enabledagent.auxiliary_clientrWrXrYagent.model_metadatarZr[rK_current_main_runtimeendswithrsplit_compression_warning _emit_statusrLwarningr getattrcallable isinstance_custom_providers ValueErrorcontext_compressorthreshold_tokenscontext_lengththreshold_percentr2 urllib.parsernhostnamerM)r rWrXrYrZr[_aux_cfg_provider_client aux_model fb_clientfb_modelfb_labelmsg aux_base_url _raw_aux_key aux_api_key aux_context threshold old_threshold new_thresholdmain_ctxsafe_pct _main_model_main_provider_aux_provider_labelrn _main_label _aux_labelrPs r#check_compression_model_feasibilityrs  $t                    #,H,H,W,W ) q!Q # # # "    #55 4466     >>,[,[!-- )Ix$$$-x (??x'8'8'='=?(0Q(?(?(B3B3(G% >> %6&%@%@4)444D *-E &   s # # # NN1    F76:r::;; vy"55 %l33wJ|UXH !H,(:?GNsK(2c9:::BH "%"55<K$UJ;;ArN%):f)D)D"! ' AA555555 ..7G<('!AAA*6*@&'''A"!;33.3333   &??)<???J 8 8 8> 8 8 8 8!- 8 8 !E 8 82?N 8 8*27 8 8  *-E &   s # # # NN,     E # "X       BC          s_L0L ?L?C L EL%I>=L>J LJA-LL:L55L:ct|dd}|r1|jr, |d|dS#t$rYdSwxYwdSdS)uRe-send the compression warning through ``status_callback``. During ``__init__`` the gateway's ``status_callback`` is not yet wired, so ``_emit_status`` only reaches ``_vprint`` (CLI). This method is called once at the start of the first ``run_conversation()`` — by then the gateway has set the callback, so every platform (Telegram, Discord, Slack, etc.) receives the warning. rvN lifecycle)rystatus_callbackrK)r rs rreplay_compression_warningras %/ 6 6C u$   ! !+s 3 3 3 3 3    DD s4 AAmessageslistOptional[list]c`tt|ddrt|SdS)aReturn the correct flush baseline after a compression boundary. Legacy compression rotates to a fresh child session. That child has not seen the compacted transcript through the normal same-turn flush path yet, so callers must clear ``conversation_history`` to ``None`` and let the next persistence call write the whole compacted list. In-place compaction is different: ``archive_and_compact()`` has already soft-archived the previous active rows and inserted ``messages`` as the new active live transcript under the same session id. If the same agent turn continues with ``conversation_history=None``, the identity-based flush path treats those already-persisted compacted dicts as new and appends them a second time, doubling the active context and retriggering compression. A shallow copy is intentional: it captures the current compacted dict identities as history while allowing later same-turn appends to remain new. _last_compaction_in_placeFN)boolryr)r rs r&conversation_history_after_compressionrss2$ GE6 > >??H~~ 4roriginal_messages compressedc:td|DrdSddlm}t|D]Q}t |t r|ddkr1|||dS|ddddS) uPreserve a real user turn when a compressor returns assistant/tool-only context. On repeated compaction the protected head decays to the system prompt only, the middle summary can land as ``role="assistant"``, and a tool-heavy tail can be all assistant/tool — so the compacted transcript can legitimately contain zero user messages. Strict chat templates (LM Studio / llama.cpp Jinja) then fail with "No user query found in messages" (#55677). The restored turn is appended at the END: the guard only runs when ``compressed`` currently ends with an assistant/tool message (any existing user turn — including a todo-snapshot append — short-circuits the ``any()`` check), so appending a user message never creates consecutive same-role messages. ``_fresh_compaction_message_copy`` copies the message and strips the ``_db_persisted`` marker so the rotation/in-place flush still persists the restored row to the new session (#57491). If the pre-compression transcript itself carried no user turn at all (near-impossible — every real conversation opens with a user request — but kept as a defensive backstop), a minimal continuation marker is appended instead so strict templates still see a user message. c3rK|]2}t|to|ddkV3dS)roleuserN)r{dictget).0rs r z3_ensure_compressed_has_user_turn..s@ U U3:c4 >SWWV__%> U U U U U UrNr)_fresh_compaction_message_copyrrzContinue from the compressed conversation context above. This marker exists because the compacted transcript contained no preserved user turn.rcontent)anyagent.context_compressorrreversedr{rrappend)rrrrs r _ensure_compressed_has_user_turnrs, U U* U U UUUGGGGGG)**#t$$ 6(A(A 88==>>> &rdefaultF) approx_tokenstask_id focus_topicforcesystem_messager Optional[int]rr Optional[str]rrTuple[list, str]c +,-.t|ddst|d|_t|}t t|dd}d} t d|jpd||r|dnd|j|| tt|d d +|jpd .d , tt|d d pd } n#ttf$rd } YnwxYwt|dd } d -+q.rnt|, +.,| } nf#t $rY} d ,t|dd .kr6.|_t d.t'| j| d} Yd } ~ nd } ~ wwxYw| s +.}n#t $rd }YnwxYwt d.|d ,t|dd .kr..|_ |dn#t $rYnwxYwt|dd }|s||}||fS,%t3+.,| | -dQ+,-.fd }|jr, |j|n#t $rYnwxYw |j||||}n[#t$r: |j||}n#t>$r |wxYwYnt>$r |wxYwt|jddr t|jdd pd}t|dd |kr ||_ |d|d t|dd }|s||}||f|S#|wxYw t|jdd }|r6t|dd |kr ||_ |d!|d"nlt|jd#d }t|jd$d }|r>||f}t|d%d |kr%||_!|d&|d'|pdd(|j"#}|r|$d)|d*tK|||&||}||_'|j(r |)||r7|j(*|j|tW|_,d} n |-|n#t $rYnwxYw|j(.|j}|j(/|jd+|j}taj12d,d-tgj4j5d d.|_ d/d0l6m7}||jn$#t $r|jtpj9d1<YnwxYw d/d2l:m;}||jn#t $rYnwxYwd|_< |j(=|j|j>ptpj9?d3d4|j|j@|5n#t $r}t d6||||_ d/d0l6m7}||jn$#t $r|jtpj9d1<YnwxYw d/d2l:m;}||jn#t $rYnwxYw |j(A|n#t $rYnwxYwd }d|_<d }~wwxYwd|_< d/d7lBmC}|||jd+8n2#t $r%}t Dd9|Yd }~nd }~wwxYw|ru |j(E|} |j(F|j| n9#tt f$r%}!t Dd:|!Yd }!~!nd }!~!wwxYw|j(G|j|d/|_Hny#t $rl}!t?d;&|s$t d<|jpd=|!nt d>|!Yd }!~!nd }!~!wwxYwt?d;}"t |"p|}#|"p|jpd }$ |#r[t|jd?rF|jK|jpd d+|$t|d@d pd4t|dAd Bn2#t $r%}%t DdC|%Yd }%~%nd }%~%wwxYw |#r,|jr%|jL|jpd |$dd+Dn2#t $r%}&t DdE|&Yd }&~&nd }&~&wwxYw|jjM}'|'dFkr)|jNdG|'dH}(|(|_O| |(t|dId rh |PdJ|j>pd |j|"pd ||jjMdKn2#t $r%}!t DdL|!Yd }!~!nd }!~!wwxYw| |_Qt||pd |jSpd M})|)|j_TdN|j_Ud/|j_Vd|j_W d/dOlXmY}*|*|n#t $rYnwxYwt dP|jpd|t||)d||f|S#|wxYw)RuCompress conversation context and split the session in SQLite. Args: agent: The owning :class:`AIAgent`. messages: Current message history (will be summarised). system_message: Current system prompt; rebuilt after compression. approx_tokens: Pre-compression token estimate, logged for ops. task_id: Tool task scope (used for clearing file-read dedup state). focus_topic: Optional focus string for guided compression — the summariser will prioritise preserving information related to this topic. Inspired by Claude Code's ``/compact ``. force: If True, bypass any active summary-failure cooldown. Set by the manual ``/compress`` slash command so users can retry immediately after an auto-compress abort. Auto-compress callers use the default ``False``. Returns: ``(compressed_messages, new_system_prompt)`` tuple. When compression aborts (aux LLM failed to produce a usable summary), returns the original messages unchanged and the existing system prompt — the session is NOT rotated. Callers should detect the no-op via ``len(returned) == len(input)`` and stop the retry loop. _compression_feasibility_checkedFTcompression_in_placezPcontext compression started: session=%s messages=%d tokens=~%s model=%s focus=%rnoneriunknown _session_dbNr]_compression_lock_ttl_secondsgr@"_compression_lock_refresh_intervalrH _last_compression_lock_error_siducompression lock subsystem unavailable for session=%s (%s: %s) — proceeding without lock. This usually means a stale in-memory module after an update; restart the process (or `hermes update`) to resync.u~compression skipped: another path is compressing session=%s (holder=%s) — returning messages unchanged to avoid session fork"_last_compression_lock_warning_siduw⚠ Skipping concurrent compression — another path is already compressing this session. Will retry after it finishes._cached_system_promptr r$cPrPrP dS#t$r&}td|Yd}~dSd}~wwxYwdSdSdS)z?Release the lock keyed on the OLD session_id (before rotation).Nz#compression lock release failed: %s)rFrelease_compression_lockrKrLrM)_rel_err_lock_db _lock_holder_lock_refresher _lock_sids r _release_lockz'compress_context.._release_lock^s  &  " " "  I ,  N11)\JJJJJ N N N BHMMMMMMMMM N     s7 A'A""A')current_tokensrr)r_last_compress_aborted_last_summary_errorz unknown error!_last_compression_summary_warningu⚠ Compression aborted: uz. No messages were dropped — conversation continues unchanged. Run /compress to retry, or /new to start a fresh session.u ⚠ Compression summary failed: z%. Inserted a fallback context marker._last_aux_model_failure_model_last_aux_model_failure_error_last_aux_fallback_warning_keyu"ℹ Configured compression model 'z ' failed (uS). Recovered using main model — check auxiliary.compression.model in config.yaml.rrr\z %Y%m%d_%H%M%Srr)set_current_session_idHERMES_SESSION_ID)set_session_contextHERMES_SESSION_SOURCEcli)rsourcerl model_configparent_session_idufCompression child session create failed (%s) — rolling back to parent session %s to avoid an orphan.)migrate_goal_to_session)reasonz)Could not migrate goal on compression: %sz,Could not propagate title on compression: %sold_session_idzKCompression rotation aborted and rolled back to the parent session (%s): %srmuKSession DB compression split failed — new session will NOT be indexed: %son_session_startplatform_gateway_session_key)boundary_reasonrrconversation_idz1context engine on_session_start (compression): %s)rresetrz2memory manager on_session_switch (compression): %su⚠️ Session compressed u> times — accuracy may degrade. Consider /new to start fresh.event_callbackzsession:compress)rrrin_placecompression_countz,event_callback error on session:compress: %s) system_prompttoolsra)reset_file_dedupz^context compression done: session=%s messages=%d->%d rough_tokens=~%s awaiting_real_usage=truerQ)ZryrrlenrrLinforrlrwCOMPACTION_STATUSr! TypeErrorr}rtry_acquire_compression_lockrKrrxtyperRget_compression_lock_holderr _emit_warning_build_system_promptrr>_memory_manageron_pre_compressr~compress BaseExceptionrr _todo_storeformat_for_injectionrr_invalidate_system_promptrrcommit_memory_sessionarchive_and_compactrB_flushed_db_message_ids_flush_messages_to_session_dbget_session_title end_sessionrnowstrftimerrrgateway.session_contextrrenvironhermes_loggingr_session_db_createdcreate_sessionrr_session_init_model_configreopen_sessionhermes_cli.goalsrrMget_next_title_in_lineageset_session_titleupdate_system_prompt_last_flushed_db_idxlocalshasattrron_session_switchr log_prefixrvrrr rlast_compression_rough_tokenslast_prompt_tokenslast_completion_tokens%awaiting_real_usage_after_compressiontools.file_toolsr)/r rrrrrr_pre_msg_countrcompacted_in_place _lock_ttl_lock_refresh_interval_lock_acquired _lock_errexisting _existing_sprr_err summary_error_aux_fail_model _aux_fail_err_aux_key todo_snapshotnew_system_prompt old_titlerrr_cs_errr _goal_err new_titlee_old_sid _is_boundary_boundary_parent_ce_err_me_err_cc_cc_msg_compressed_estrrrrrs/ @@@@rcompress_contextr=s+P 5tI7 "NNNNNN " * #?? JJ    NNU8     LuBDIIYVV;D8''- !D"5*A4HHL J$99.II \) )  #<&  egg NNNNNNNNN    ! 1 1( ; ; ; ;    D -66xP]kvD6EE  1::8Ta:bbJJ    MOOO   J    u')A5II 535JDQQdUdDuA4HHDPP:>7##PPPP #5*A4HHL J$99.II \) MOOOOMMOOOOv 8:OQUVV  uA4HHMYY:G7##:}:::&e&>@_aeffO#E$<>]_cddM +];5"BDIIXUU;CE8''L_LL)<_LLL )>>@@  J   v-HH I I I(:>>> '')))!66~FF&7#  ^ u] u ++H555B\&%99%:JJWWW 58EEE1*.&& ;;HEEEE$!& 1 C CEDT U UI%11%2BMRRR%*%5N*2,..*A*A/*R*R'k'kUYU_UaUaUefhghfhUi'k'kE$KRRRRRR..u/?@@@@$KKK:?:J #6777KFFFFFF++E,<====$05E--)88','7#(>#cRZ^^D[]b5c5c"'+).)I.< 9%%%%T#^ ,:(OVVVVVV2253CDDDD(OOO>C>NBJ':;;;O!JJJJJJ//0@AAAA(!!! D!!!-<<^LLLL(!!! D!)-591K%L15E- ]LLLLLL//@PYfggggg$]]] %PR[\\\\\\\\]!\\(-(9(S(ST](^(^I!-??@PR[\\\\ *I6\\\"LL)WYZ[[[[[[[[\!66u7GIZ[[[-.** u u u 88<< 0119(9NN2383C3JsA NN#prsttt u$88<< 011H~~1 #=u'7=2 W (@BT U U (99$*$1#3$UJ==F$+E3I4$P$P : W W W LLLg V V V V V V V V W X  5 %77$*&6( 8  X X X LLMw W W W W W W W W X&8 !88#GGGGG *1E &   w ' ' ' 5*D 1 1 P P$$%7 % 4""'"2&.n" ().)A)S :: P P P KQOOOOOOOO P+=' 8 +1r+%    BQ >68 3:; 7IM F   9 9 9 9 9 9  W % % % %    D   l   &J " "   ,,   s C$$C:9C:&D?? F" AFF"(F>> G  G  H!! H.-H.J00 J=<J=K L8+LL8LL8#L8A8O O!%D5n:Ab&*V?b& V  b& V  Bb&%X<;b&<Yb&Yb&!Y87b&8 Zb&Z b&A[$#b&$ ^0.#^+\)(^+)] ^+ ]  ^+]%$^+% ]2/^+1]22^+6^^+ ^^+^ ^++^00 b&;_b& `_?:b&?`b& :ab&a;a61b&6a;;*b&%n:& d0A"dn:dAn:Af;:n:; g*g% n:%g**n:..hn: i 'in:i  An:4kn: lk;6n:;lAn:m('n:( m52n:4m55:n:: oi@) max_dimension api_messagesr>r2cT|sdS ddlmn3#t$r&}td|Yd}~dSd}~wwxYwdd}d}d d d!fd }d"d}d#d}|D]}}t |t s|d} t | tsD| D]5} t | t s| d} | dkra| d} || } || pd\}}|r't | t r|| ||dz }n|r|dz }| dvr| d}t |t r9|d d} || \}}|r ||d <|dz }|r|dz }t |tr#||\}}|r || d<|dz }.|r|dz }7|rt d|dz |r!td|dz dS|dkS)$uRe-encode all native image parts at a smaller size to recover from image-too-large errors (Anthropic 5 MB, unknown other providers). Mutates ``api_messages`` in place. Returns True if any image part was actually replaced, False if there were no image parts to shrink or Pillow couldn't help (caller should surface the original error). Strategy: look for ``image_url`` / ``input_image`` parts carrying a ``data:image/...;base64,...`` payload, plus Anthropic-native ``{"type": "image", "source": {"type": "base64", ...}}`` blocks. For each one whose encoded size exceeds 4 MB (a safe target that slides under Anthropic's 5 MB ceiling with header overhead) or whose longest side exceeds ``max_dimension``, write the base64 to a tempfile, call ``vision_tools._resize_image_for_vision`` to produce a smaller data URL, and substitute it in place. Non-data-URL images (http/https URLs) are not touched — the provider fetches those itself and the size limit is different. Fr)_resize_image_for_visionu6image-shrink recovery: vision_tools unavailable — %sNi@data_urlr r Optional[tuple]c^ ddl}ddl}|d\}}}|r|dsdSddlm}||||5}|j cdddS#1swxYwYdS#t$rYdSwxYw)zReturn ``(width, height)`` of a base64 data URL, or None on failure. Soft-depends on Pillow; returns None (caller falls back to a bytes-only check) if Pillow is missing or the payload is corrupt. rNridata:)Image) base64io partition startswithPILrFopenBytesIO b64decodesizerK)rB_b64_dim_io_dimheader_drdata_d _PILImage_imgs r_decode_pixelsz:try_shrink_image_parts_in_messages.._decode_pixelss"  % % % % "*"4"4S"9"9 Ha !4!4W!=!= t . . . . . .0B0B60J0J K KLL !PTy ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! ! !   44 s;8BAB=B BBBBB B,+B,urltuplect|tr|dsdSt|k}|rdnd}|s(|}|dSt |krdSd}d} |d\}}}d}|drZ|tddd d d }|d r|}d dl} | |} d dddddd |d} tj d| d} | | | t| j|} t| jdnN#t$$rYnBwxYw# t| jdw#t$$rYwwxYwxYw| sdS|dkrHt| t|krdS| }|t |krdS| dfS| }|t |kr| dfSdSt| t|krdS| dfS#t$$r+}t&d|d|dufcYd}~Sd}~wwxYw)uReturn ``(resized_url, unshrinkable)`` for a data URL. ``resized_url`` is a smaller/dimension-correct data URL, or None when no rewrite was applied. ``unshrinkable`` is True only when the image exceeded a constraint (byte-size or dimensions) and the resize failed to satisfy *that same* constraint — so the caller knows retrying is pointless even if a different image in the request shrank. rE)NFbytesNT dimensionri image/jpeg;r'rimage/z.pngz.gifz.webpz.jpgz.bmp)z image/pngz image/gifz image/webpr\z image/jpgz image/bmphermes_shrink_F)prefixsuffixdelete) mime_typemax_base64_bytesr>) missing_ok)NTu.image-shrink recovery: re-encode failed — %s)r{r rJrr/rIsplitstriprGrNrtempfileNamedTemporaryFilewritecloserr)unlinkrKrLrx)rW needs_shrink triggered_bydimsheaderrdatamime mime_part_b64rawratmpresizednew_dimsrPrVrAr> target_bytess r_shrink_data_urlz._shrink_data_urls#s## 3>>'+B+B ;3xx,. ".8wwD  '">#&&D|"{4yyM))"{L&LD 2!mmC00OFAtD  )) %"3w<<==177Q??BHHJJ ''11%$D ! ! ! !..&&C#&$6c$ -'uC  # 22NN"%1"/ NN))T):::: DNN))T):::: D "!zw&&w<<3s88++%:*>'22'CMMM,I,I%:~%&~g..H#x==M11"E>)!z7||s3xx''!zE> ! 2 2 2 NNKS Q Q QT11 1 1 1 1 1 1 2s2CJ* A G(F>=J*> G J* G  J*H (G98H 9 HH HH  J*&J*8 J*J*#J* J*&J** K4 KKKrrrcht|tr|ddkrdS|d}t|tr|sdSt|dpd}|dsd}d|d|S) NrrGrq media_typer\r^rEz;base64,)r{rrr rgrJ)rrqr|s r_source_to_data_urlz?try_shrink_image_parts_in_messages.._source_to_data_url{s&$'' 6::f+=+=+I+I4zz&!!$$$ D 4L11A\BBHHJJ $$X.. &%J1z114111rrr$c8|d\}}}d}|drZ|tddddd}|dr|}d|d <||d <||d <dS) Nrir\rEr]r'rr^rGrr|rq)rIrJrrfrg)rrBrprrqr| candidates r_write_data_url_to_sourcezEtry_shrink_image_parts_in_messages.._write_data_url_to_sources",,S114!   W % % 's7||}}-33C;;A>DDFFI##H-- '& !v)|vrrrimager]r'> image_url input_imagerzGimage-shrink recovery: re-encoded %d image part(s) to fit under %.0f MBiuimage-shrink recovery: %d oversized image part(s) could not be shrunk under %.0f MB — not retrying (would re-send rejected payload))rBr r rC)rWr r rX)rrr r)rrrBr r r$) tools.vision_toolsrArKrLrxr{rrrr r)r?r>rP changed_countunshrinkable_oversizedrzr}rrrpartptyperrWrw unshrinkable image_valuerVrArys ` @@@r"try_shrink_image_parts_in_messagesrsm0 u??????? OQTUUUuuuuu#L M $g2g2g2g2g2g2g2g2g2R 2 2 2 2    '0'0#t$$  '')$$'4((  ! 0! 0DdD)) HHV$$E(++))&11(8(8(C(C%0z&$770--fg>>>!Q&MM!0*a/*888((;//K+t,, 0!ooeR00(8(8(=(=%0)0K&!Q&MM!0*a/*K-- 0(8(8(E(E%0(/D%!Q&MM!0*a/*C! 0F  U <;7      U "LK$@   u 1 s A<A)rCOMPACTION_STATUS_MARKERrrr=r)r rr r )r rr r$)r rrrr r)rrrrr r$)r rrrrr rrrr rrrrr r)r?rr>r2r r)__doc__ __future__rloggingrrhrrrpathlibrtypingrrrrrr getLoggerrRrLrrrrrrrrr=r__all__rUrrrs8#"""""  ''''''''''>>>>>>  8 $ $0c'ccc (LLLLLLLL^D D D D N$.&&&&\$(!%XXXXXX|||||||~   r