JjɉnUdZddlmZddlZddlZddlZddlZddlZddlZddl m Z m Z m Z ddl mZmZmZddlZddlmZmZmZddlmZddlmZejeZd Zd Zdad e d <d a!da"de d<d a#dXdZ$dYdZ%dZdZ&dZdZ'd[dZ(d[dZ)d\dZ*d]dZ+d[dZ,d^d"Z-d_d%Z.d`d&Z/d`d'Z0dad(Z1dbd*Z2dcd-Z3iZ4d.e d/<ej5Z6ddd1Z7ded2Z8dfdgd4Z9dhd6Z:didjd7Z;didkd<ZZ=dldnd@Z>dldkdAZ?didodBZ@dpdDZA dqdrdGZBdidsdIZCdidtdKZDdidudMZEdidvdNZFdidwdPZGdidvdQZHdidvdRZI dxdydUZJdxdzdWZKdS){uCamofox browser backend — local anti-detection browser via REST API. Camofox-browser is a self-hosted Node.js server wrapping Camoufox (Firefox fork with C++ fingerprint spoofing). It exposes a REST API that maps 1:1 to our browser tool interface: accessibility snapshots with element refs, click/type/scroll by ref, screenshots, etc. When ``CAMOFOX_URL`` is set (e.g. ``http://localhost:9377``), the browser tools route through this module instead of the ``agent-browser`` CLI. Setup:: # Option 1: npm git clone https://github.com/jo-inc/camofox-browser && cd camofox-browser npm install && npm start # downloads Camoufox (~300MB) on first run # Option 2: Docker docker run -p 9377:9377 -e CAMOFOX_PORT=9377 jo-inc/camofox-browser Then set ``CAMOFOX_URL=http://localhost:9377`` in ``~/.hermes/.env``. For Docker Camofox, optionally set ``CAMOFOX_REWRITE_LOOPBACK_URLS=true`` so page URLs like ``http://127.0.0.1:3000`` are opened inside the container as ``http://host.docker.internal:3000``. ) annotationsN)AnyDictOptional) SplitResulturlsplit urlunsplit)cfg_get load_configread_raw_config)get_camofox_identity) tool_errori8 Optional[str]_vnc_urlF Optional[int]_cached_cmd_timeoutreturnintctrtSdat} t}t |dd}|t t |d}n2#t$r%}t d|Yd}~nd}~wwxYw|a|S)aReturn ``browser.command_timeout`` from config, falling back to 30s. Mirrors :func:`tools.browser_tool._get_command_timeout` so both the local browser path and the Camofox path honour the same config knob. Result is cached after the first call. Tbrowsercommand_timeoutNz*Could not read browser.command_timeout: %s) _cmd_timeout_resolvedr_DEFAULT_TIMEOUTr r maxr Exceptionloggerdebug)resultcfgvalexcs ;/home/rurouni/.hermes/hermes-agent/tools/browser_camofox.py_get_command_timeoutr%;s#""  FHc9&788 ?S1%%F HHH A3GGGGGGGGH  Ms>A B"BBDict[str, str]cftjdd}|rdd|iSiS)z8Return Authorization header when CAMOFOX_API_KEY is set.CAMOFOX_API_KEY AuthorizationzBearer )osgetenvstrip)keys r$ _auth_headersr/Ss> )%r * * 0 0 2 2C 2311 IstrcRtjdddS)z:Return the configured Camofox server URL, or empty string. CAMOFOX_URLr)/)r+r,rstripr0r$get_camofox_urlr7[s" 9]B ' ' . .s 3 33r0c  ddlm}|di}t|tr7t |ddpdSn#t$rYnwxYwdS)a.Persistent ``browser.cdp_url`` from config.yaml, or empty string. Read here (instead of importing ``browser_tool._get_cdp_override`` to avoid a circular import) so Camofox can yield to a config-based CDP override the same way it already yields to the ``BROWSER_CDP_URL`` env override. r)r rcdp_urlr))hermes_cli.configr get isinstancedictr1r-r)r browser_cfgs r$_config_cdp_urlr?`s 555555%o''++Ir:: k4 ( ( E{y"55;<<BBDD D E      2sA/A33 B?BboolctjddrdStrdSt t S)uTrue when Camofox backend is configured and no CDP override is active. A CDP override takes priority over Camofox so the browser tools operate on the real CDP browser (and a CDP backend is treated as non-local for SSRF checks) instead of being silently routed to Camofox. The override may come from the ``BROWSER_CDP_URL`` env var (set by ``/browser connect``) OR a persistent ``browser.cdp_url`` in config.yaml — both are honored, matching ``browser_tool._get_cdp_override()``'s precedence. (Previously only the env var suppressed Camofox, so ``CAMOFOX_URL`` + a config CDP override still routed navigation through Camofox.) BROWSER_CDP_URLr)F)r+r,r-r?r@r7r6r0r$is_camofox_moderCrsQ y"B''--//uu !! " ""r0ct}|sdS tj|dd}|jdkrts |}|d}t |tr2d|cxkrdkr%nn"d d lm }||}|j pd }d |d |a n#ttf$rYnwxYwda|jdkS#t$rYdSwxYw)z'Verify the Camofox server is reachable.Fz/healthrtimeoutvncPortir)urlparse localhostzhttp://:T)r7requestsr; status_code_vnc_url_checkedjsonr<r urllib.parserJhostnamer ValueErrorKeyErrorr)urlrespdatavnc_portrJparsedhosts r$check_camofox_availabler[sA   C u|sOOOQ777  s " "+; " yy{{88I..h,,;h1G1G1G1G%1G1G1G1G1G555555%Xc]]F!?9kD:::::H)    # 3&& uus6+CA0B10C1CCCC C#"C#c:tsttS)z>Return the VNC URL if the Camofox server exposes one, or None.)rOr[rr6r0r$ get_vnc_urlr]s "!!! Or0Dict[str, Any]c  tdidi}n4#t$r'}td|icYd}~Sd}~wwxYwt |t r|niS)z>Return the ``browser.camofox`` config block, or an empty dict.rcamofoxz7camofox config check failed, defaulting to disabled: %sN)r r;rrwarningr<r=) camofox_cfgr#s r$_get_camofox_configrcs!mm'' 266::9bII PRUVVV %[$77 ?;;R?s69 A*A%A*%A*c^ttdS)alReturn whether Hermes-managed persistence is enabled for Camofox. When enabled, sessions use a stable profile-scoped userId so the Camofox server can map it to a persistent browser profile directory. When disabled (default), each session gets a random userId (ephemeral). Controlled by ``browser.camofox.managed_persistence`` in config.yaml. managed_persistence)r@rcr;r6r0r$_managed_persistence_enabledrfs( #%%))*?@@ A AAr0task_idrbOptional[Dict[str, str]]ctjddp5t|dpd}|sdStjddpDt|dpdpd|pddd }||d S) zReturn an externally configured Camofox identity, if one is set. Integrations that own the visible Camofox browser can set a shared user ID so Hermes operates in the same browser profile instead of creating a separate private session. CAMOFOX_USER_IDr)user_idNCAMOFOX_SESSION_KEY session_keytask_default)rkrmr+r,r-r1r;)rgrbrkrms r$_camofox_identity_overriderrsi)2..4466g#kooi>X>X>^\^:_:_:e:e:g:gG t ',,2244 1 {}--3 4 4 : : < < 1 0G(y#2#. 0 0 { ; ;;r0nameOptional[bool]ctj|d}|sdS|dvrdS|dvrdStd||dS)Nr)>1onyestrueT>0noofffalseFz"Ignoring invalid boolean env %s=%r)r+r,r-lowerrr)rsraws r$ _env_flagrsv )D"   # # % % + + - -C t (((t )))u LL5tSAAA 4r0cltd}||St|dS)z@Return whether Hermes should recover an existing Camofox tab ID.CAMOFOX_ADOPT_EXISTING_TABNadopt_existing_tabrr@r;rb env_values r$_adopt_existing_tab_enabledrs7677I   455 6 66r0cltd}||St|dS)aLReturn whether loopback navigation URLs should be rewritten for Docker. ``CAMOFOX_URL`` itself often points at a host-published Docker port such as ``http://127.0.0.1:9377``. That is correct for Hermes talking to the Camofox control API, but a page URL like ``http://127.0.0.1:3000`` is opened by the browser *inside* the Docker container. In that context loopback points at the container, not the host running the web app. The rewrite is opt-in because non-Docker Camofox installs run the browser on the host, where loopback URLs are already correct. CAMOFOX_REWRITE_LOOPBACK_URLSNrewrite_loopback_urlsrrs r$_loopback_rewrite_enabledrs99::I   788 9 99r0ctjddp7t|dpdpdS)z=Return the host alias used when rewriting loopback page URLs.CAMOFOX_LOOPBACK_HOST_ALIASr)loopback_host_aliaszhost.docker.internalrq)rbs r$_loopback_rewrite_hostrs[ /44::<< " {455; < < B B D D " !r0rRc|sdS|d}|dvrdS ddl}||jS#t $rYdSwxYw)z:Return True for localhost/127.0.0.0/8/::1-style hostnames.Fz[]>localhost.localdomainrKTrN)r-r~ ipaddress ip_address is_loopbackrS)rRrZrs r$_is_loopback_hostnamers u >>   ! !$ ' ' - - / /D 555t##D))55 uusA## A10A1rU$tuple[str, Optional[Dict[str, str]]]c Ht}t|s|dfS t|}n#t$r|dfcYSwxYw|jdvst |js|dfSt|}|s|dfSd}|jr |j}|j r |d|j z }|dz }d|vr| dsd|dn|}|j r d|j nd}tt|j||||j|j|j}||jpd|||dfS) zRewrite loopback page URLs for Docker-hosted Camofox, if configured. Returns ``(rewritten_url, metadata)``. ``metadata`` is present only when a rewrite happened so the tool result can disclose the change to the model. N>httphttpsr)rL@[])fromto original_url rewritten_url)rcrrrSschemerrRrusernamepassword startswithportr rpathqueryfragment)rUrbrYaliasuserinfo host_part port_part rewrittens r$!_rewrite_loopback_url_for_camofoxr s &''K $[ 1 1Dy# Dy}---5J6?5[5[-Dy "; / /E DyH ? ? . -FO-- -HC #u U5E5Ec5J5J E PUI%+[8!FK!!!bIFMh#F #F9#F#F U[UacicrssI %2"  s3AAzDict[str, Dict[str, Any]] _sessionssessionc |ds|ds|Sts|S tdd|diddg}nH#t$r;}td |d||cYd }~Sd }~wwxYwt |tr|s|S|d fd |D}|p d |D}|r|dnd }t |tr|dnd }t |tr6|r4||d<td||d|S)a0Attach process-local state to an already-open managed Camofox tab. Some integrations own the visible Camofox tab outside Hermes. Gateway restarts can leave this module's in-memory session cache empty even though Camofox still has that tab, so rehydrate tab_id before creating a new tab. tab_idr/tabsuserIdrkr)paramsrFtabsz&Camofox tab adoption failed for %s: %sNrmcpg|]2}t|tr|dk0|3S) listItemId)r<r=r;).0tabrms r$ z'_adopt_existing_tab..TsN  c4 &)WW\%:%:k%I%I %I%I%Ir0c<g|]}t|t|Sr6)r<r=)rrs r$rz'_adopt_existing_tab..Ys'"P"P"P3*S$:O:O"P3"P"P"Pr0tabIdz&Adopted existing Camofox tab %s for %s) r;r7_getrrrr<listr=r1)rrr# matching_tabs candidateslatestrrms @r$_adopt_existing_tabr=s{{8GKK0D$E$E   GXwy/A$BANNNRRSY[]^^  =w{{9?U?UWZ[[[ dD ! !++m,,KM P"P"P$"P"P"PJ) 3Z^^tF$.vt$<$< FVZZ $F&#_6_" =vw{{S\G]G]^^^ Ns.A.. B380B.(B3.B3cn|pd}t5|tvr&tt|cdddSt}t ||}|r"|dd|ddt |d}nt |dr1t|}|dd|ddt |d}n4dtj j dd dd |dd d d d}|t|<t|cdddS#1swxYwYdS) zGet or create a camofox session for the given task. When managed persistence is enabled, uses a deterministic userId derived from the Hermes profile so the Camofox server can map it to the same persistent browser profile across restarts. roNrkrmT)rkrrmmanagedrrehermes_ rnrpF) _sessions_lockrrrcrrrr@r;r uuiduuid4hex)rgrbidentity_overrideridentitys r$ _get_sessionrcs"G  , , i  &y'9:: , , , , , , , ,*++ 6w LL  ,Y70?&A+&N&N GG+//"788 9 9 +G44H#I.' 6&A+&N&N GG=TZ\\%5crc%:<<5wss|55 &+ G% '"7++A , , , , , , , , , , , , , , , , , ,s#D*C!D**D.1D. about:blankcZt|}|dr|St}tj|d|d|d|dt t }||}|d|d<|S)z rravnc_urlz]Browser is visible via VNC. Share this link with the user so they can watch the browser live.vnc_hint /snapshotrrsnapshotr)SNAPSHOT_SUMMARIZE_THRESHOLD_truncate_snapshot refsCount element_countzNavigation failed: FrzCannot connect to Camofox at z. Is the server running? Start with: npm start (in camofox-browser dir) or: docker run -p 9377:9377 -e CAMOFOX_PORT=9377 jo-inc/camofox-browserrerror)rrrrrM HTTPErrorresponserNrrar;r]rtools.browser_toolrrlenrrPdumpsrConnectionErrorr7r1) rUrg browser_url rewrite_inforrWer vnc snap_data snapshot_textrrs r$camofox_navigater sL1$Ec$J$J! \w''x  !';77G{33DD 9WX.999&y1+FF %   :)aj.D.K.KNN0) )-GH%)';??G"&{;;DDDDDD 88E;//XXgr**    &)F? #$0F= !B'BB-9$-?BB 9 mm   #F9 T :   5*555 ')"45I&MM*b99M        =!!$@@@ 2 2= A A !.F: &/mmK&C&CF? # #    D z&!!!  DDD333UCCCCCCCCC  #   z__5F5F___       111#a&&%0000000001s?G&%A('G&(C7AC G&CA.G&A=GG& G G&GG&&I:5HI:9I: I:I5/I:5I:actioncddlm}m}||pdsdS||d|d}|sdStjdd|d |d d d S) uReturn a blocked payload when the current Camofox page is private/internal. Mirrors the eval-path guard added for ``_camofox_eval`` (browser_tool.py): Camofox snapshot / vision / image-extraction all read current page state, so on a non-local backend they can leak the content of an intranet/metadata page the terminal itself can't reach. The gate matches ``browser_snapshot`` / ``browser_vision`` — only active when the SSRF guard applies (non-local backend, not a local sidecar, ``allow_private_urls`` unset). Fail-open on probe failure, matching the sibling guards. Imports are deferred to call time because ``browser_tool`` imports this module; importing it at module load would create a circular import. r)!_camofox_current_page_private_url_eval_ssrf_guard_activeroNrrkFz9Blocked: page URL targets a private or internal address (z). Refusing to z# on this page in this browser mode.r) ensure_ascii)rrrrPr)rrgr rr blocked_urls r$_camofox_private_page_blockr=s # "7#7i 8 8t33GH4EwyGYZZK t :   ,2      r0full user_taskc$ t|}|dstddSt||d}|r|Std|ddd|d i }|d d }|d d}ddlm}m} m} t||kr|r | ||}n | |}tj d||dS#t$r(} tt| dcYd} ~ Sd} ~ wwxYw)z-Get accessibility tree snapshot from Camofox.r0No browser session. Call browser_navigate first.Frzread a page snapshotrrrrkrrr)rr)r_extract_relevant_contentrT)rrrN)rrrrr;rrrrrrPrrr1) rrgrrblockedrWr refs_countrrrrs r$camofox_snapshotr_s$1w''x  aPZ_``` `-gw@VWW  N 1WX& 1 1 1gi01    88J++XXk1--           x==7 7 7 844XyII--h77z '     111#a&&%0000000001s('CCBC D'D D Drefc t|}|dstddSt||d}|r|S|d}t d|dd|d |d }t jd ||d d dS#t$r(}tt|dcYd}~Sd}~wwxYw)z$Click an element by ref via Camofox.rrFrclickrrz/clickrk)rrTrUr))rclickedrUN) rrrlstriprrPrr;rr1)rrgrr clean_refrWrs r$ camofox_clickr!s1w''x  aPZ_``` `-gwHH  NJJsOO  .WX& . . .y)) < <  z 88E2&&     111#a&&%0000000001s('B#B#A#B## C-C CCtextc t|}|dstddSt||d}|r|S|d}t d|dd|d ||d d d lm}m}|d d|ipid}d||d} || |} tj | S#t$r8} d dlm}t|t| |dcYd} ~ Sd} ~ wwxYw)z-Type text into an element by ref via Camofox.rrFrtyperrz/typerk)rrr"r)%redact_browser_typed_text_for_displayredact_tool_args_for_display browser_typer"T)rtypedelement)r%N) rrrrr agent.displayr%r&rPrrr1) rr"rgrrr r%r& display_textrrs r$ camofox_typer,s$^w''x  aPZ_``` `-gwGG  NJJsOO  -WX& - - -y))T J J           54^fd^TTZXZ\bc  "   984HHz(### ^^^GGGGGG??AMMW\]]]]]]]]]^s('B<B<A-C93C>9C> directionc2 t|}|dstddStd|dd|d|dtjd |d S#t $r(}tt |dcYd }~Sd }~wwxYw) zScroll the page via Camofox.rrFrrz/scrollrk)rr-T)rscrolledN)rrrrPrrr1)r-rgrrs r$camofox_scrollr0s 1w''x  aPZ_``` ` /WX& / / /y) B B   zd BBCCC 111#a&&%0000000001s"'A$9A$$ B.B BBcX t|}|dstddStd|ddd|di}tjd |d d d S#t $r(}tt|dcYd }~Sd }~wwxYw)zNavigate back via Camofox.rrFrrz/backrrkTrUr))rrUN)rrrrPrr;rr1)rgrrWrs r$ camofox_backr2s 1w''x  aPZ_``` ` -WX& - - - wy) *  zd488E23F3FGGHHH 111#a&&%0000000001s#'A7A A77 B)B$B)$B)r.c\ t|}|dstddSt||d}|r|Std|dd|d|d t jd |d S#t $r(}tt|dcYd }~Sd }~wwxYw) z!Press a keyboard key via Camofox.rrFrpressrz/pressrk)rr.T)rpressedN)rrrrrPrrr1)r.rgrrrs r$ camofox_pressr6s1w''x  aPZ_``` `-gwHH  N .WX& . . .y)# 6 6   zds;;<<< 111#a&&%0000000001s''A9A99A99 B+B& B+&B+c* t|}|stjdddStd|dtjdddS#t$r/}tjddt |dcYd}~Sd}~wwxYw)z&Close the browser session via Camofox.T)rclosedz /sessions/rk)rr8raN)rrPrrrr1)rgrrs r$ camofox_closer9s P(( A:$$??@@ @ -+ - -   zdd;;<<< PPPzdds1vvNNOOOOOOOOPs"'A.A B#$B B Bc t|}|dstddSt||d}|r|Sddl}t d|dd d |d i }|d d}g}|d}t|D]\}} | } | dr| d| } | r| dnd} d} |dzt|krH| d||dz}|r| d} | s| r| | | dtjd|t|dS#t $r(}tt#|dcYd}~Sd}~wwxYw)zGet images on the current page via Camofox. Extracts image information from the accessibility tree snapshot, since Camofox does not expose a dedicated /images endpoint. rrFrzextract page imagesrNrrrrkrrr) )z- img zimg zimg\s+"([^"]*)"rIz /url:\s*(\S+))srcaltT)rimagescount)rrrrerr;split enumerater-rsearchgrouprappendrPrrr1)rgrrr@rWrr>linesilinestripped alt_matchr=r< url_matchrs r$camofox_get_imagesrLs) *1w''x  aPZ_``` `-gw@UVV  N  1WX& 1 1 1gi01   88J++ t$$ '' < C;?3J 3AE87J 8 FJ F!J 'A'HJ H J H  A?J K*K K Kclearc 8tjdggddddS)uGet console output — limited support in Camofox. Camofox does not expose browser console logs via its REST API. Returns an empty result with a note. Trz|Console log capture is not available with the Camofox backend. Use browser_snapshot or browser_vision to inspect page state.)rconsole_messages js_errorstotal_messages total_errorsnote)rPr)r{rgs r$camofox_consolers7 :P   r0)rr)rr&)rr1)rr@)rr)rr^)rgrrbr^rrh)rsr1rrt)rbr^rr@)rbr^rr1)rRrrr@)rUr1rr)rr^rr^)rgrrr^)r)rgrrUr1rr^)rgrrr)N)rgrrr@)rr1rr=rFrrr=)NN)rr1rr=rFrrr=)rr1rr=rFrrr)rUr1rgrrr1)rr^rgrr r1rr)FNN)rr@rgrrrrr1)rr1rgrrr1)rr1r"r1rgrrr1)r-r1rgrrr1)rgrrr1)r.r1rgrrr1)FN)rMr1rNr@rgrrr1)r{r@rgrrr1)L__doc__ __future__rrirPloggingr+ threadingrtypingrrrrQrrr rMr:r r r tools.browser_camofox_stater tools.registryr getLogger__name__rr_SNAPSHOT_MAX_CHARSr__annotations__rOrrr%r/r7r?rCr[r]rcrfrrrrrrrrrLockrrrrrrrrrrr rrr!r,r0r2r6r9rLrzrr6r0r$rs2#"""""   &&&&&&&&&&::::::::::CCCCCCCCCC<<<<<<%%%%%%  8 $ $ &*))))04444 $####&2@@@@ B B B B<<<<&    7777::::$    &&&&Z(* ))))!!####L(,(,(,(,V,,,,,*N1N1N1N1N1bDCG04'1'1'1'1'1T111116&^&^&^&^&^R 1 1 1 1 1 1 1 1 1 1 11111( P P P P P0101010101f49,0^1^1^1^1^1Br0