h78j"dZddlZddlZddlmZddlZddlmZmZm Z ddl m Z m Z ddl mZmZgdZejeZd Zd ZGd d Z dd edzdefdZdS)a9Distributed cache DHT module. This module provides a P2P cache DHT for sharing search results across multiple ddgs instances using Kademlia DHT. Usage: from ddgs.dht import DhtClient # Direct mode (runs Trio in-process) client = DhtClient() await client.start() # REST API mode (connects to ddgs api service) client = DhtClient(api_url="http://localhost:4479") # Get cached results results = await client.get_cached("python tutorial") # Store results await client.cache("python tutorial", results) await client.stop() N)Any) DEFAULT_TTLMAX_CACHE_SIZE ResultCache)DEFAULT_MAX_HOP_CONNECTIONS Libp2pClient)compute_query_hashnormalize_query)rrr DhtClientr rr r zhttp://localhost:4479g?c leZdZdZddeedddededed ed edzd df d Z d efd Z deded e e ee fdzfdZ ddeded e e ee fdzfdZ ddede e ee fded dfdZddeded dfdZddZed efdZed efdZed efdZdS)r aNClient for the distributed cache DHT. Provides transparent access to cached results from other peers while falling back to direct search engine queries when needed. Supports two modes: - Direct mode (api_url=None): Runs libp2p/Trio in-process - REST mode (api_url set): Connects to ddgs api service via HTTP TrN) enable_dht listen_port cache_ttlmax_hop_connectionsapi_urlrrrrrreturnc||_||_|r | |ptnd|_d|_|||jrd|_d|_dSt||||_t|_dS)NF)r bootstrapr) rrDEFAULT_API_URLr_started_dht_cacher r)selfrrrrrs Y/home/rurouni/.hermes/hermes-agent/venv/lib/python3.11/site-packages/ddgs/dht/__init__.py__init__zDhtClient.__init__?s%"7AcgFY2?_c   & ' < (DIDKKK$'$$7DI &--DKKKcjK|jrdS|jr!td|jns|jrR|jKt j|jjd{V}td||jj ntdd|_|jS)z`Start the DHT client. Returns: True if DHT connection successful. Tz&DHT client started (REST API mode): %sNz)DHT client started: connected=%s, port=%dz!DHT client started (DHT disabled)) rrloggerinforrasyncio to_threadstartport)r connecteds rr#zDhtClient.startZs = 4 < = KK@$, O O O O _ =!6%/ @@@@@@@@I KK;      KK; < < < }rquerycategorycKt|} tjt4d{V}||jd||dd{V}|jdkr |}|dx}r/t d||cdddd{VSn2#t$r%}t d |Yd}~nd}~wwxYwdddd{Vn#1d{VswxYwYn3#t$r&}t d ||Yd}~nd}~wwxYwdS) zGet cached results from API.timeoutN /dht/cacher&r'paramsresultszCache hit (DHT API): %sz Failed to parse API response: %rzDHT API get failed for %s: %r) r primp AsyncClient CACHE_TIMEOUTgetr status_codejsonrdebug Exception) rr&r' normalizedclientrespdatar0exs r _get_from_apizDhtClient._get_from_apits$U++  J(??? M M M M M M M6#ZZ|///%*AA(#s**M/3yy{{&*hhy&9&997+"LL)BJOOO#* M M M M M M M M M M M M M M+%MMM %GLLLLLLLLM M M M M M M M M M M M M M M M M M M M M M M M M M M M J J J LL8*b I I I I I I I I Jtsk D4D(AC/DD C2 C-(D-C22D5D DDDD E #EE textcfK|js|d{Vt||}t|}|jr|||d{VS|jdS|j|}|rt d||S|j |j j rv|j |}|r@t d||j |||||j |S|j|dS)zGet cached results for a query. Checks local cache first, then DHT DHT (or REST API). Args: query: The search query. category: The search category. Returns: Cached results or None. NzCache hit (local): %szCache hit (DHT): %s)rr#r r rr>rr4rr7r is_runningsetr add_negative)rr&r' query_hashr9 local_results dht_resultss r get_cachedzDhtClient.get_cachedsD"} **,,       'x88 $U++ < =++E8<<<<<<<< < ; 4  33  ! LL0* = = = 9 TY%9 )-- 33K # 2J???  J+t~^^^"" K $ $Z 0 0 0trr0c&K|js|d{Vt||}t|}|jr t jt4d{V}||jd|||dd{V}|j dvrt d|dddd{Vn#1d{VswxYwYn3#t$r&}t d||Yd}~nd}~wwxYwdS|j dS|j |||||j|jJ|jjr@|j|||jt d |dSdSdS) zCache search results locally and on DHT. Args: query: The search query. results: The search results. category: The search category. Nr)r+)r&r0r')r6)r/zCached to DHT API: %szDHT API cache failed for %s: %rzCached to DHT: %s)rr#r r rr1r2r3postr5rr7r8rrBrrrA) rr&r0r'rDr9r:r;r=s rcachezDhtClient.caches} **,,       'x88 $U++ <  P ,]CCCJJJJJJJv!'<333',hWW"-""D':55 % BOOOOOOOO P F ;  F  J'4>RRR 9 TY%9 IMM*gt~ > > > LL,j 9 9 9 9 9 ! s= C+AC 9C CCCC D 'DD cKt||}|jr tjt4d{V}||jd||dd{Vdddd{Vn#1d{VswxYwYn2#t $r%}td|Yd}~nd}~wwxYwdS|j dS|j |dS)zInvalidate cached results for a query. Args: query: The search query. category: The search category. r)Nr+r,r-zDHT API invalidate failed: %r) r rr1r2r3deleter8rr7r)rr&r'rDr:r=s r invalidatezDhtClient.invalidates(x88 <  B ,]CCCv --<333).HEE(  B B B rGrKrNrPpropertyrSrVrYrrr r 4s: $#>"(((( (  ( ! (t( ((((6T4T#s(^@TW[@[0++++ d38n  $ ++++b (:(:(:d38n%(: (:  (:(:(:(:T''c'S'd''''4rms(0 ;;;;;;;;;;DDDDDDDD66666666     8 $ $) ````````H 4Zr