(GjAdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl m Z m Z ddlmZddlmZmZmZddlmZddlmZddlmZejeZeejd Zere ej!ej"Z#d ee$gdfdzd dfd Z%d ee$gdfdzfd Z&de'de$d dfdZ(d efdZ)dej*de$d dfdZ+ d%de,e$de$dzd ej*fdZ-ded e'fdZ.dede'd dfdZ/de$d e0e1e2fdzfdZ3GddeZ4Gdd Z5d!e$d e$fd"Z6Gd#d$e Z7dS)&aCBase class for all Hermes execution environment backends. Unified spawn-per-call model: every command spawns a fresh ``bash -c`` process. A session snapshot (env vars, functions, aliases) is captured once at init and re-sourced before each command. CWD persists via in-band stdout markers (remote) or a temp file (local). N)ABCabstractmethod)Path)IOCallableProtocol)get_hermes_home)windows_hide_flags)is_interruptedHERMES_DEBUG_INTERRUPTcbreturnc|t_dS)z>Register a callback that _wait_for_process fires periodically.N)_activity_callback_localcallback)r s =/home/rurouni/.hermes/hermes-agent/tools/environments/base.pyset_activity_callbackr/s(*%%%c.ttddS)Nr)getattrrrr_get_activity_callbackr4s +Z > >>rstatelabelctj}|dd}||dz |krdS||d< t}|r+t ||dz }||d|ddSdS#t $rYdSwxYw)a_Fire the activity callback at most once every ``state['interval']`` seconds. *state* must contain ``last_touch`` (monotonic timestamp) and ``start`` (monotonic timestamp of the operation start). An optional ``interval`` key overrides the default 10 s cadence. Swallows all exceptions so callers don't need their own try/except. intervalg$@ last_touchNstartz (z s elapsed))time monotonicgetrint Exception)rrnowrr elapseds rtouch_activity_if_duer&8s .  CyyT**H U<  8++E, # % %  0#g.//G B%..7... / / / / / 0 0      s9A>> B  B ctjd}|rt|}ntdz }|dd|S)zReturn the host-side root for all sandbox storage (Docker workspaces, Singularity overlays/SIF cache, etc.). Configurable via TERMINAL_SANDBOX_DIR. Defaults to {HERMES_HOME}/sandboxes/. TERMINAL_SANDBOX_DIR sandboxesTparentsexist_ok)osgetenvrr mkdir)customps rget_sandbox_dirr2RsT Y- . .F , LL    +GGD4G((( Hrprocdatacffd}tj|ddS)uWrite *data* to proc.stdin on a daemon thread to avoid pipe-buffer deadlocks. On Windows, text-mode stdin (``text=True`` / ``encoding="utf-8"``) translates ``\n`` → ``\r\n`` as the data flows through the pipe — which corrupts every write_file / patch call because the bytes that land on disk include injected carriage returns. The file IS created, but every subsequent byte-count / content compare against the caller's ``\n``-only string fails. Workaround: write through ``proc.stdin.buffer`` (the underlying byte buffer), encoding to UTF-8 ourselves. That bypasses Python's newline translation entirely on every platform. No behaviour change on POSIX — the byte sequence is identical to what text-mode would produce there. c ttrdn}tjdj}|||dS#ttf$rYdSwxYw)Nutf-8buffer) isinstancestrencoderstdinwritecloseBrokenPipeErrorOSError)rawtargetr4r3s r_writez_pipe_stdin.._writews  +5T3*?*?I$++g&&&TCTZ4:>>F LL    LLNNNNN)    DD sA0A55B  B TrBdaemonN) threadingThreadr)r3r4rCs`` r _pipe_stdinrHfsL"      F40006688888rcmd stdin_datac |dttj|ftjtj| tjn tjdd|}|t|||S)aSpawn a subprocess with standard stdout/stderr/stdin setup. If *stdin_data* is provided, writes it asynchronously via :func:`_pipe_stdin`. Backends with special Popen needs (e.g. local's ``preexec_fn``) can bypass this and call :func:`_pipe_stdin` directly. creationflagsNT)stdoutstderrr<text) setdefaultr subprocessPopenPIPESTDOUTDEVNULLrH)rIrJkwargsr3s r _popen_bashrWs o'9';';<<<     !+!7jooZ=O        DD*%%% Krpathc|r9 tj|dS#t$rYnwxYwiS)z:Load a JSON file as a dict, returning ``{}`` on any error.r7encoding)existsjsonloads read_textr#)rXs r_load_json_storer`sZ {{}} :dnngn>>?? ?    D  Is'> A  A c|jdd|tj|dddS)z.Write *data* as pretty-printed JSON to *path*.Tr*)indentr7rZN)parentr/ write_textr]dumps)rXr4s r_save_json_storergsHKdT222OODJtA...OAAAAAr host_pathc t|}|j|jfS#t$rYdSwxYw)zIReturn ``(mtime, size)`` for cache comparison, or ``None`` if unreadable.N)rstatst_mtimest_sizer@)rhsts r_file_mtime_keyrnsO )__ ! ! # # RZ(( tts .1 ??ceZdZdZdedzfdZd dZd dedzdefdZe de e dzfdZ e dedzfd Z dS) ProcessHandlezDuck type that every backend's _run_bash() must return. subprocess.Popen satisfies this natively. SDK backends (Modal, Daytona) return _ThreadedProcessHandle which adapts their blocking calls. rNcdSNrselfs rpollzProcessHandle.pollrcdSrrrrss rkillzProcessHandle.killrvrtimeoutcdSrrrrtrys rwaitzProcessHandle.waitrvrcdSrrrrss rrMzProcessHandle.stdout(+rcdSrrrrss r returncodezProcessHandle.returncoder~rrNrr)__name__ __module__ __qualname____doc__r"rurxfloatr|propertyrr:rMrrrrrprps &cDj%%%%< (output_str, exit_code)`` in a background thread and exposes a ProcessHandle-compatible interface. An optional ``cancel_fn`` is invoked on ``kill()`` for backend-specific cancellation (e.g. Modal sandbox.terminate, Daytona sandbox.stop). Nexec_fn cancel_fnc8|_tj_d_d_t j\}}t j|ddd_ |_ fd}tj |d}| dS)Nrr7replace)r[errorsc \}}|_ tjj|ddn#t $rYnwxYwn%#t $r}|_d_Yd}~nd}~wwxYw tjjn#t $rYnwxYwj dS# tjjn#t $rYnwxYwj wxYw)Nr7rr) _returncoder-r= _write_fdr;r@r#_errorr>_doneset)output exit_codeexcrrts r_workerz0_ThreadedProcessHandle.__init__.._workersO !$+GII! #, HT^V]]79]-U-UVVVVD % % %! #$       %HT^,,,,D      HT^,,,,D     sA/AA AAAAC A;#A61C6A;;C?B B&%B&D C D  C-*D ,C--D TrD) _cancel_fnrFEventrrrr-pipefdopen_stdoutrrGr)rtrrread_fdwrite_fdrts`` r__init__z_ThreadedProcessHandle.__init__s $_&& '+(, GIIy# RRR ! ! ! ! ! ! !&  GD 9 9 9  rc|jSrr)rrss rrMz_ThreadedProcessHandle.stdouts |rrc|jSrr)rrss rrz!_ThreadedProcessHandle.returncodes rcF|jr|jndSrr)ris_setrrss rruz_ThreadedProcessHandle.polls##':#4#4#6#6@tD@rcd|jr( |dS#t$rYdSwxYwdSrr)rr#rss rrxz_ThreadedProcessHandle.killsS ?  !!!!!      s  --rycF|j||jS)Nry)rr|rr{s rr|z_ThreadedProcessHandle.waits! (((rrr)rrrrrtupler:r"rrrMrrurxrr|rrrrrs04##"eCHo-.#BH%,####JX C$J   X AcDjAAAA  EDL C      rr session_idcd|dS)N __HERMES_CWD___r)rs r _cwd_markerrs ): ) ) ))rceZdZUdZdZeed<dZeed<defdZ d)d ed ed e fd Z d ddddede d ededzde f dZedZdZed edefdZded edefdZedededefdZd*de d ede fdZde fdZde fdZde fdZd+d Z d,ddd"d#ded ed edzdedzd$e de f d%Zd&Zd'Zdedeeedzffd(ZdS)-BaseEnvironmentaCommon interface and unified execution flow for all Hermes backends. Subclasses implement ``_run_bash()`` and ``cleanup()``. The base class provides ``execute()`` with session snapshot sourcing, CWD tracking, interrupt handling, and timeout enforcement. r _stdin_mode_snapshot_timeoutrcdS)a,Return the backend temp directory used for session artifacts. Most sandboxed backends use ``/tmp`` inside the target environment. LocalEnvironment overrides this on platforms like Termux where ``/tmp`` may be missing and ``TMPDIR`` is the portable writable location. z/tmprrss r get_temp_dirzBaseEnvironment.get_temp_dir0s vrNcwdryenvcX||_||_|pi|_tjjdd|_|dpd}|d|jd|_ |d|jd|_ t|j|_ d|_ dS)N /z /hermes-snap-z.shz /hermes-cwd-z.txtF) rryruuiduuid4hex _session_idrrstrip_snapshot_path _cwd_filer_snapshot_ready)rtrryrtemp_dirs rrzBaseEnvironment.__init__9s 9":<<+CRC0$$&&--c229c!)MM8HMMM$HH$2BHHH&t'788$rFxloginryrJ cmd_stringrrJcJtt|jd)zSpawn a bash process to run *cmd_string*. Returns a ProcessHandle (subprocess.Popen or _ThreadedProcessHandle). Must be overridden by every backend. z must implement _run_bash())NotImplementedErrortyper)rtrrryrJs r _run_bashzBaseEnvironment._run_bashIs$"T$ZZ%8"U"U"UVVVrcdS)z z __hermes_fns=$(declare -F | awk '{print $3}' | grep -vE '^_[^_]') || true [ -n "$__hermes_fns" ] && declare -f $__hermes_fns >> z! 2>/dev/null || true alias -p >> z# echo 'shopt -s expand_aliases' >> z echo 'set +e' >> z echo 'set +u' >> z mv -f  z || rm -f z builtin cd -- z 2>/dev/null || true pwd -P > z 2>/dev/null || true printf '\n%sz\n' "$(pwd -P)" T)rryrrrz)snapshot bootstrap failed with exit code z-Session snapshot created (session=%s, cwd=%s)uLinit_session failed (session=%s): %s — falling back to bash -l per commandFN)_quote_cwd_for_cdrshlexquoterrrrr_wait_for_processr"r! RuntimeErrorr _update_cwdloggerinforr#warning) rt _quoted_cwd _quoted_snap_quoted_cwd_file _snap_tmp bootstrapr3resultrs r init_sessionzBaseEnvironment.init_sessionas ,,TX66 {4#677  ;t~66$K 3g =>>K  U9 U U U U %! U U"2;# U U$!*% U U&!*' U U,- U U,".- U U,:C- U U.)/ U U0)1 U U2*3 U U2/3.>3 U U U 8 )>>)4AW>XXD++D$:P+QQF6::l++0q11Q66"Z <@X@XZZ$(D   V $ $ $ KK?        ) ) ) NN6      $)D  )s!CE++ F(5(F##F(c|dkr|S|dkrdS|drdtj|ddStj|S)z7Quote a ``cd`` target while preserving ``~`` expansion.~z~/z$HOMEz$HOME/rbN) startswithrr)rs rrz!BaseEnvironment._quote_cwd_for_cdsd #::J $;;7 >>$   32EKABB0022 2{3rcommandc |dd}tj|j}tj|j}tj|jdzdz}g}|jr|d|d||}|d|d|d |d|d |jr"|d |d |d |d|d |d|d|d|jd|jd|dd |S)zwBuild the full bash script that sources snapshot, cd's, runs command, re-dumps env vars, and emits CWD markers.'z'\''rrzsource z >/dev/null 2>&1 || truezbuiltin cd -- z || exit 126zeval 'z__hermes_ec=$?z{ export -p > z && mv -f rz; } 2>/dev/null || rm -f z 2>/dev/null || truez pwd -P > z printf '\nrz\n' "$(pwd -P)"zexit $__hermes_ec ) rrrrrrappendrrjoin) rtrrescapedrrrparts quoted_cwds r _wrap_commandzBaseEnvironment._wrap_commands//#w// {4#677  ;t~66K 3g =>>K     LL@,@@@    ++C00  >j>>>???  (g((())) %&&&    LLH)HHyHH<HH(1HHH     G!1GGGHHH  R$* R Rd.> R R R     ()))yyrcbdtjjdd}|d|d|d|S)z;Append stdin_data as a shell heredoc to the command string. HERMES_STDIN_Nrz << 'z' r)rrr)rrJ delimiters r_embed_stdin_heredocz$BaseEnvironment._embed_stdin_heredocsGt d%|| | t j|dz jdjdS)&uPoll-based wait with interrupt checking and stdout draining. Shared across all backends — not overridden. Fires the ``activity_callback`` (if set on this instance) every 10s while the process is running so the gateway's inactivity timeout doesn't kill long-running commands. Also wraps the poll loop in a ``try/finally`` that guarantees we call ``self._kill_process(proc)`` if we exit via ``KeyboardInterrupt`` or ``SystemExit``. Without this, the local backend (which spawns subprocesses with ``os.setsid`` into their own process group) leaves an orphan with ``PPID=1`` when python is shut down mid-tool — the ``sleep 300``-survives-30-min bug Physikal and I both hit. r7rrc  |D]e}|t|tr)|Ct |fn#t $rYnwxYw dd}|r|dSdS#t $rYdSwxYw# dd}|r|ww#t $rYwwxYwxYw)NrTfinal)r9bytesrdecoder:r#)streampiecetaildecoder output_chunkss r_drain_iterablez:BaseEnvironment._wait_for_process.._drain_iterableKsb #99E} !%//9%,,W^^E-B-BCCCC%,,SZZ8888 9    ">>#T>::D3%,,T2222233 DD ">>#T>::D3%,,T22223 Ds`A(A,+C, A96C8A99C=.B// B=<B=D.C20D2 C?<D>C??DcP j}|dSt|dd} t|r |nd}n#t$rd}YnwxYwt |t r|dkr |dSt jdkr t j|d}|sn) |An#ttf$rYnwxYw dd}|r |nU#t$rYnIwxYw# dd}|r |ww#t$rYwwxYwxYwdSd} tj |gggd\}}}n#ttf$rYnwxYw|r\ t j|d}n#ttf$rYnSwxYw|snL |d}n  |d z }|d krn dd}|r |dSdS#t$rYdSwxYw# dd}|r |ww#t$rYwwxYwxYw) NfilenorntTrrg?r)rMrcallabler#r9r"r-namereadrr ValueErrorr@selectru) rrfdchunkridle_after_exitready_rrrr3s r_drainz1BaseEnvironment._wait_for_process.._draines[F~VXt44F !)&!1!1;VVXXXt    b#&& "q&&'''w$D "D 1 1$"!%,,W^^E-B-BCCC D""G,D&~~c~>>7)00666$ &~~c~>>7)0066667$O "&,mRD"b#&F&F q!!&0""$&GB$5$5EE *G4"""!E"$"!%,,W^^E-B-BCCC*+0(1,*a//!)"2">>#T>::D3%,,T2222233 DD ">>#T>::D3%,,T22223 Ds; A  A AC D CD CD !.D DD E"".EE" EE"EE"*I#,F I# FI#FI##F98I#9G  I# G  AI# .I I I #J%%.JJ% J"J%!J""J%TrD)rrpidNrFzg[interrupt-debug] _wait_for_process ENTER tid=%s pid=%s timeout=%ss activity_cb=%s initial_interrupt=%srMISSINGg{Gzt?rut[interrupt-debug] _wait_for_process INTERRUPT DETECTED tid=%s pid=%s iter=%d elapsed=%.1fs — killing process grouprrbrz [Command interrupted])rrzM[interrupt-debug] _wait_for_process TIMEOUT tid=%s pid=%s iter=%d timeout=%ssz [Command timed out after zs]|zterminal command runningg>@zo[interrupt-debug] _wait_for_process HEARTBEAT tid=%s pid=%s iter=%d elapsed=%.0fs interrupt=%s activity_cb=%s%sz (LOST during run)g?g?u[interrupt-debug] _wait_for_process EXCEPTION_EXIT tid=%s pid=%s iter=%d elapsed=%.1fs — killing subprocess group before re-raisezd[interrupt-debug] _wait_for_process EXIT (natural) tid=%s pid=%s iter=%d elapsed=%.1fs returncode=%s)codecsgetincrementaldecoderrFrGrrr current_threadidentrr_DEBUG_INTERRUPTrrr ru _kill_processrlstripr&sleepminKeyboardInterrupt SystemExitr#rMr>r)rtr3ryr drain_threaddeadline_now_activity_state_tid_pid _iter_count_last_heartbeat_last_interrupt_state _cb_was_none _poll_sleeppartial timeout_msg _cb_now_nonerrrs ` @@@rrz!BaseEnvironment._wait_for_processsU $& 48&.w77yIII      4F F F F F F F F P!'vdCCC >##g-~  '))/tUD))  %-//47   KKBdG)8y     V K))++%q !## ' \ $ T^5E5EX_H`5` &&t,,, %%a%000"$''-"8"8;T"T&)>##h..' @ $ W &&t,,, %%a%000 ggm44G"K"K"K"KK##2'K"7"7(//11&) &o7QRRR $ 0(8(8?(Jd(R(R#9#;#;t#CLKK8dK((?7+CC&((%1@y0<Y\Y,,WY   '+n&6&6O#/L ;'''$$"%kC&7"="=K))++%@":.      g$ N$$w'??   ""4(((!!!!,,,,     ) 2 !$$$  K          D    KKDdK  ?7#;;    ''-00PPPsRB.L:0BL:C)L::AO  +N76O 7 OO OO #O== P  P cl |dS#tttf$rYdSwxYw)zDTerminate a process. Subclasses may override for process-group kill.N)rxProcessLookupErrorPermissionErrorr@)rtr3s rrzBaseEnvironment._kill_process6sA  IIKKKKK"OW=    DD s 33rc0||dS)zDExtract CWD from command output. Override for local file-based read.N)_extract_cwd_from_output)rtrs rrzBaseEnvironment._update_cwdAs %%f-----rcB|dd}|j}||}|dkrdStd|dz }||||}|dks||krdS||t |z|}|r||_|dd|}|dkr|}|d|t |z} | dkr| dznt |} |d||| dz|d<dS) zParse the __HERMES_CWD_{session}__ marker from stdout output. Updates self.cwd and strips the marker from result["output"]. Used by remote backends (Docker, SSH, Modal, Daytona, Singularity). rrNrrrr)r!rrfindmaxlenstriprfind) rtrrmarkerlast search_startfirstcwd_path line_startline_ends rr5z(BaseEnvironment._extract_cwd_from_outputEs: Hb))!||F## 2:: F1dTk**  V\488 B;;%4-- F%#f++-45;;==  DH \\$511   J;;tTCKK%788#+r>>8a<Hook called before each command execution. Remote backends (SSH, Modal, Daytona) override this to trigger their FileSyncManager. Bind-mount backends (Docker, Singularity) and Local don't need file sync — the host filesystem is directly visible inside the container/process. Nrrss r_before_executezBaseEnvironment._before_executeks  rrT)ryrJrewrite_compound_backgroundrFc|||\}}|rddlm}||}|p|j} |p|j} ||||z} n||} n|} | r#|jdkr||| }d} ||| } |j } | | | | | }| || }| ||S)z=Execute a command, return {"output": str, "returncode": int}.r)_rewrite_compound_backgroundNheredocrr) rE_prepare_commandtools.terminal_toolrHryrrrrrrrr)rtrrryrJrF exec_command sudo_stdinrHeffective_timeout effective_cwdeffective_stdinwrappedrr3rs rexecutezBaseEnvironment.executeysG #'#8#8#A#A j ' F H H H H H H77 EEL#3t|tx   !j&<(:5OO  #(OO(O  #t/9<<44\?SSL"O$$\=AA((~~ 5*;  ''6G'HH     rc.|dS)z.Alias for cleanup (compat with older callers).N)rrss rstopzBaseEnvironment.stops rcR |dS#t$rYdSwxYwrr)rr#rss r__del__zBaseEnvironment.__del__s:  LLNNNNN    DD s  &&c$ddlm}||S)z6Transform sudo commands if SUDO_PASSWORD is available.r)_transform_sudo_command)rKrX)rtrrXs rrJz BaseEnvironment._prepare_commands%??????&&w///rrr)rr)r) rrrrrr:__annotations__rr"rdictrboolrprrrr staticmethodrrrrrrr5rErRrTrVrrJrrrrr"s,K sc % %C %# %D % % % %(!% W W W W W  W $J W  W W W W  ^ ])])])F s s   \ @ S@ s@ s@ @ @ @ LHcHsHsHHH\HUQUQmUQcUQDUQUQUQUQn-.$.... Ct C C C CL    ". #!%,0..... t . $J .&*. ....h 00c3:o0F000000rrrr)8rrr]loggingr-r rrQrFrrabcrrpathlibrtypingrrrhermes_constantsr hermes_cli._subprocess_compatr tools.interruptr getLoggerrrr[r.rsetLevelINFOlocalrr:rrrZr&r2rRrHlistrWr`rgrrr"rnrprrrrrrris   ########)))))))))),,,,,,<<<<<<******  8 $ $ 4  ":;;<<"  OOGL!!!+9?,,+hud{3d:+t++++ ?# 5 <????        4       (9j&9c9d9999F.2 c #d .4DB4BtBBBBB suUCZ'84'?,,,,,H,,,$B B B B B B B B T*C*C****Y 0Y 0Y 0Y 0Y 0cY 0Y 0Y 0Y 0Y 0r