Jja\dZddlmZddlZddlZddlZddlmZddlm Z m Z m Z m Z ddl mZddlmZddlmZmZejeZd$dZd%dZeGddZ d&d'd#ZdS)(uPer-turn setup for ``run_conversation`` (the turn prologue). ``run_conversation`` opened with ~470 lines of straight-line setup before the tool-calling loop ever started: stdio guarding, runtime-main wiring, retry-counter resets, user-message sanitization, todo/nudge-counter hydration, system-prompt restore-or-build, crash-resilience persistence, preflight context compression, the ``pre_llm_call`` plugin hook, and external-memory prefetch. All of that is *prologue* — it runs once per turn, has no back-references into the loop, and produces a fixed set of values the loop then consumes. ``TurnContext`` captures those produced values; ``build_turn_context`` performs the setup work and returns one. ``run_conversation`` is left to unpack the context and run the loop, shrinking the orchestrator by the full prologue. The builder still mutates ``agent`` heavily (counters, thread id, cached prompt, session DB) exactly as the inline code did — those side effects are the point. The ``TurnContext`` it returns carries only the *locals* the loop reads back. Behavior is identical to the original inline prologue; this is a pure move-and-name refactor with no semantic change. ) annotationsN) dataclass)AnyDictListOptional)&conversation_history_after_compression)IterationBudget)estimate_messages_tokens_roughestimate_request_tokens_roughorig_lenintnew_len orig_tokens new_tokensreturnboolc0||krdS|dko||dzkS)uFReturn ``True`` if a compression pass materially reduced the request. Compression can succeed by summarising message contents — reducing the estimated request token count — without reducing the message row count. Treating row count as the sole progress signal false-positives on size-only wins and surfaces a misleading "Cannot compress further" failure even when post-compression tokens are well below the model context window. See issue #39548 for an observed case: 220 → 220 messages, ~288k → ~183k tokens on a 1M-context model still triggered auto-reset. The token reduction must be *material* (>5%) to count as progress — the same floor the overflow-handler retry path uses (conversation_loop.py, #39550) — so a sub-5% wobble doesn't keep the multi-pass loop spinning. Trgffffff?)r rrrs 8/home/rurouni/.hermes/hermes-agent/agent/turn_context.py_compression_made_progressr)s-$t ? >zK$,>>>messagesList[Dict[str, Any]]protect_first_nprotect_last_nthreshold_tokensc^t|||zdzkrdSt||kS)uCheap gate for the (expensive) full preflight token estimate. Returns ``True`` when either: (a) message count exceeds the protected ranges (the historical gate), or (b) a cheap char-based estimate already crosses the configured threshold — the few-but-huge case from issue #27405 that the count-only gate would silently skip (a handful of very large messages never trips the count condition, so compression was never attempted and the turn hit a hard context-overflow error). Branch (b) uses ``estimate_messages_tokens_rough`` (the shared char-based estimator) so a single large base64 image isn't mistaken for ~250K tokens. It intentionally undercounts vs. the full request estimate — it omits the system prompt and tool schemas — because it is only a *hint* deciding whether to pay for the authoritative ``estimate_request_tokens_rough``, which (together with ``should_compress``) makes the real decision. T)lenr )rrrrs r_should_run_preflight_estimater!@s8. 8}}7!;;;t )( 3 37G GGrceZdZUdZded<ded<ded<ded <d ed <ded <ded <ded<dZded<dZded<dZded<dS) TurnContextzCValues produced by the turn prologue and consumed by the turn loop.str user_messageroriginal_user_messagerrOptional[List[Dict[str, Any]]]conversation_history Optional[str]active_system_prompteffective_task_idturn_idrcurrent_turn_user_idxFrshould_review_memoryplugin_user_contextext_prefetch_cacheN)__name__ __module__ __qualname____doc____annotations__r.r0r1rrrr#r#\sMM""""8888''''LLL!&&&&&!!!!!       rr#r%r$system_messager)r(r'task_idpersist_user_messagepersist_user_timestampOptional[float]c|  ddlm}|t|ddpdt|ddpdt|ddpdt|ddpdt|ddpd n#t$rYnwxYw| |j| t|d d | t|d d sddlm}m}|r ||dn,#t$rt ddYnwxYwt|tr | |}t|tr | |}||_ d|_||_||_|ptt#j}||_|jpdd|dt#jjdd}||_d|_d|_d|_d|_d|_d|_d|_d |_d|_d |_d |_ d|_!|j"#d|_$t|j%dd}tM|r |d|_'|j(dkr; |)r|*dn#t$rYnwxYw|j+r|,d|_+t[|j.|_/| |}ta|dkr |dddzn|}|1dd}t2d|jpd|j3|j4pd |j5pd ta|pg||rtm|ng}|r.|j78s|9||rV|j:dkrKtwd!|D}|dkr,||_:|j<dkr|j=dkr||j<z|_=|xj:d"z c_:d|_>t|d#d}||?t|d$d}||?||n|}d }|j<dkr9d%|j@vr0|j%r)|xj=d"z c_=|j=|j<kr d}d|_=d&|d'}|A|ta|d"z }||_|jBsC| |}|Cd(|dd)ta|d)krdndd*|jD |||||jD} |E |F||n4#t$r'tGd+|jpddYnwxYw|jHrPt||jJjK|jJjL|jJjMrt|| pd|jOpd,}!|jJ}"t|"d-d.}#|#|!}$|$s|"jP}%|%dkr |!|%kr|!|"_Pt|"d/d0}&|$r/t2d1|!d2|"jMd2|"jQd2ny|&rFt2d3t|&Sd4d5|jpdn1|"T|!rt2d6|!d2|"jMd2|j3|"jUd2|*d7|!d2d8|"jMd2d9td:D]}'ta|}(|!})|W|||!|;\}} t|| pd|jOpd,}!t|(ta||)|!snKt||}d|_d|_d|_d |_d |_ |"T|!snd}* dddpdt|d?dpd@ },g}- ddAl]m^}.m_}/|.}0n#t$rd}/d}0YnwxYw|,D]}1d}2t|1tr+|1SdBrt|1dB}2n-t|1tr|1ar|1}2nq|/H |/|2|jdC|0D}2n2#t$r%}3tGdE|3Yd}3~3nd}3~3wwxYw|-A|2|-rdFb|-}*n2#t$r%}4tGdG|4Yd}4~4nd}4~4wwxYwi|_ct|_ed|_fd|_gtjijj|_k|ld |jk|jmr+|ld|jkd |_nnd|_od |_n|jprK t|tr|nd}5|jpq|j:|5n#t$rYnwxYwd}6|jprG t|tr|nd}7|jpr|7pd}6n#t$rYnwxYwt||||| |||||*|6H S)IaRun the once-per-turn setup and return the loop's input context. The callables/helpers the original prologue referenced from the ``conversation_loop`` module are passed in explicitly to keep this module free of an import cycle with ``agent.conversation_loop``. r)set_runtime_mainproviderr/modelbase_urlapi_keyapi_mode)r@rArB_memory_write_originassistant_tool_skip_mcp_refreshF)has_registered_mcp_toolsrefresh_agent_mcp_toolsT) quiet_modez&between-turns MCP tool refresh skipped)exc_infoNsession:reset_consolidation_failuresanthropic_messagesu~🔌 Detected stale connections from a previous provider issue — cleaned up automatically. Proceeding with fresh connection.Pz...  zPconversation turn: session=%s model=%s provider=%s platform=%s history=%d msg=%rnoneunknownc3LK|]}|ddkdV dS)roleuserrN)get).0ms r z%build_turn_context..s?  quuV}}/F/FA/F/F/F/F  rr_stream_context_scrubber_stream_think_scrubbermemoryrV)rUcontentu💬 Starting conversation: '<'z:Early turn-start session persistence failed for session=%s) system_prompttools$should_defer_preflight_to_real_usagecdS)NFr)_tokenss rz$build_turn_context..gsEr'get_active_compression_failure_cooldowncdSNrrrrrfz$build_turn_context..tsDrzpSkipping preflight compression: rough estimate ~%s >= %s, but last real provider prompt was %s after compression,z`Skipping preflight compression: same-session cooldown active (~%s seconds remaining, session %s)remaining_secondsgzDPreflight compression: ~%s tokens >= %s threshold (model %s, ctx %s)u📦 Preflight compression: ~z tokens >= z# threshold. This may take a moment.) approx_tokensr8) invoke_hook pre_llm_callplatform_user_id) session_idr8r,r%r( is_first_turnr?rp sender_id)get_spill_configspill_if_oversizedcontextz plugin hook)rrsourceconfigzhook context spill failed: %sz zpre_llm_call hook failed: %s) r%r&rr(r*r+r,r-r.r0r1)tagent.auxiliary_clientr=getattr Exceptionrr_restore_primary_runtimetools.mcp_toolrFrGloggerdebug isinstancer$_stream_callback_persist_user_message_idx_persist_user_message_override_persist_user_message_timestampuuiduuid4_current_task_idhex_current_turn_id_current_api_request_id_invalid_tool_retries_invalid_json_retries_empty_content_retries_incomplete_scratchpad_retries_codex_incomplete_retries_thinking_prefill_retries_post_tool_empty_retried_last_content_with_tools$_last_content_tools_all_housekeeping_mute_post_response_unicode_sanitization_passes_tool_guardrailsreset_for_turn_tool_guardrail_halt_decision _memory_storecallable_vision_supportedrB_cleanup_dead_connections _emit_status_compression_warning_replay_compression_warningr max_iterationsiteration_budgetr replaceinfor?r>rplist _todo_store has_items_hydrate_todo_store_user_turn_countsum_memory_nudge_interval_turns_since_memory_is_user_initiated_turnresetvalid_tool_namesappendrH _safe_print_cached_system_prompt_ensure_db_session_persist_sessionwarningcompression_enabledr!context_compressorrrrr rblast_prompt_tokenslast_real_prompt_tokensrrWshould_compresscontext_lengthrange_compress_contextrr hermes_cli.pluginsrnrtools.hook_output_spillrurvdictstripjoin_turn_failed_file_mutationsset_turn_file_mutation_paths_verification_stop_nudges_pre_verify_nudges threadingcurrent_threadident_execution_thread_id_set_interrupt_interrupt_requested _interrupt_thread_signal_pending_interrupt_message_memory_manager on_turn_start prefetch_allr#)8agentr%r7r(r8stream_callbackr9r:restore_or_build_system_promptinstall_safe_stdiosanitize_surrogatessummarize_user_message_for_logset_session_contextset_current_write_originrar=rFrGr+r, _reset_consol _preview_text _msg_previewrprior_user_turnsscrubberthink_scrubberr&r.user_msgr-_print_previewr*_preflight_tokens _compressor_defer_preflight_preflight_deferred_last_compression_cooldown_pass _orig_len _orig_tokensr0 _invoke_hook _pre_results _ctx_parts _spill_cfg_spill_if_oversized_spill_config_cachedr_piece _spill_excexc _turn_msgr1_querys8 rbuild_turn_contextrws2  ;;;;;; E:r * * 0b E7B ' ' -2UJ339rE9b117RUJ339r            ()))WU,BDTUUVVV ""$$$Nu1599 @ X X X X X X X X'')) @''$???? NNN = MMMMMN,$$9**<88 &,,I223GHH-E&*E#+?E(,BE)43tz||#4#4.E!.Y[[1B[[TZ\\EUVXWXVXEY[[G$E$&E!#$E"#E#$E +,E(&'E#&'E#%*E"%)E"16E. %E)*E& ))+++*.E'E/1OQUVVM  "E ~--- ..00 """     D  !* ))+++%)"-U-ABBE32<@@M36}3E3E3J3JM#2#&..P]L''c22L KKZ "FEK1L9 #)S)=)C%D%D .BIt()))rH8E$5$?$?$A$A8 !!"6777\ 6! ; ;  +      a  %5E "+a//E4MQR4R4R,RSSS 6    x)=>>>>     H   &         X%C  0  /  1 &&X : .4"+%    . "  2 ! !   /./@AA" C2Ezz/%771B .!   5 L! ! ! !  9  KKI$((/336::     #1  KK6)--.A3GGHH *F       ( (): ; ;*  KKV$((/33 -11       *0AM**!2B***    q  MM 0 161H1Hn;f,=b>>A8f,7e  f, e;e61f,6e;;0f,, g6gg9k kk"5l l%$l%) r rrrrrrrrr) rrrrrrrrrrri)r%r$r7r)r(r'r8r)r9r)r:r;rr#)r5 __future__rloggingrr dataclassesrtypingrrrragent.conversation_compressionr agent.iteration_budgetr agent.model_metadatar r getLoggerr2rrr!r#rrrrrsg,#""""" !!!!!!,,,,,,,,,,,,QQQQQQ222222  8 $ $????.HHHH8 !!!!!!! !D/3```````r