$j&;!dZddlZddlZddlZddlmZddlmZmZddlm Z m Z e rddl m Z ddl mZd d lmZejeZd e d eee fdzfd Z d5dddddededeededeedzdedddeedzd eee ffdZ d6dddeded d!d"edeedzdeddd#edzd$ed%ed&edzd'edzd eee ffd(Z d7dddeded d!d"edeedzdeddd-ed.ed/eedzd0ed&edzd'edzd eee ffd1Zddded2eed3ed eee ff d4ZdS)8a Tool implementations for the reflect agent. Implements hierarchical retrieval: 1. search_mental_models - User-curated stored reflect responses (highest quality) 2. search_observations - Consolidated knowledge with freshness 3. recall - Raw facts as ground truth N)replace)datetimetimezone) TYPE_CHECKINGAny) Connection)RequestContext) MemoryEngine retain_paramsreturnct|tr, tj|}n#tj$rYdSwxYwt|t sdS|d}t|t r|ndS)z=Return document metadata stored under retain_params.metadata.Nmetadata) isinstancestrjsonloadsJSONDecodeErrordictget)r rs j/home/rurouni/.hermes/hermes-agent/venv/lib/python3.11/site-packages/hindsight_api/engine/reflect/tools.py%_document_metadata_from_retain_paramsrs-%%  J}55MM#   44  mT * *t  ,,H!(D11 ;88t;s ,??any memory_enginer connrbank_idqueryquery_embedding max_resultstags tags_match tag_groupsz list | None exclude_idsc ZKddlm} ddlm} m} d} |t ||g}d}|r/| |||\}}}| d|z } |||r-| ||\}}}| d|z } ||| r#| d|d z } || |d z }|jd | d d | dg|Rd{V}g}|D]}|d}|r'|j | tj }| |||d{V}|rdnd}|t |d|d|d|dpgt|dd|r|nd||d|t!||dS)a3 Search user-curated mental models by semantic similarity. Mental models are high-quality, manually created summaries about specific topics. They should be searched FIRST as they represent the most reliable synthesized knowledge. Args: conn: Database connection bank_id: Bank identifier query: Search query (for logging/tracing) query_embedding: Pre-computed embedding for semantic search max_results: Maximum number of mental models to return tags: Optional tags to filter mental models tags_match: How to match tags - "any" (OR), "all" (AND) exclude_ids: Optional list of mental model IDs to exclude (e.g., when refreshing a mental model) Returns: Dict with matching mental models including content and freshness info r fq_table)build_tag_groups_where_clausebuild_tags_where_clause) param_offsetmatch z AND id != ALL($z ::text[])z SELECT id, name, content, tags, created_at, last_refreshed_at, trigger, 1 - (embedding <=> $2::vector) as relevance FROM mental_modelsz6 WHERE bank_id = $1 AND embedding IS NOT NULL zD ORDER BY embedding <=> $2::vector LIMIT $3 Nlast_refreshed_at)tzinfoz1new in-scope memories ingested since last refreshidnamecontentr" relevance)r4r5r6r"r7 updated_atis_stalestaleness_reason)rcountr1)rr( search.tagsr)r*rextendappendfetchr3rrutccompute_mental_model_is_staleround isoformatlen)rrrrr r!r"r#r$r%r(r)r*filtersparams next_param tag_clause tag_params groups_clause groups_paramsrowsr1rowr2r9r:s rtool_search_mental_modelsrN)s>)(((((TTTTTTTTG #o"6"6 DFJ "-D-DTXbjt-u-u-u* J #z### j!!!%3P3PQ[]g3h3h0 }j&}&&& m$$$;j;;;; k"""a  h'' 7>            DM   34  O!2!9!A 1 9 9 9 N N 'DDT7TWXXXXXXXXRZdNN`d#d)nnF y>F )r"3{#3Q77?PZ/99;;;VZ$$4   ]##&  request_contextr max_tokenslast_consolidated_atpending_consolidationsource_facts_max_tokens created_aftercreated_beforec fK| dk} i}| r | dkr| |d<t|d}|jd||dg|d||||| | | ddd |d {V}| dk}| dkrd }n | d krd }nd}|t|jd|jDd|jpiD||dS)a Search consolidated observations using recall. Observations are auto-generated from memories. Returns freshness info so the agent knows if it should also verify with recall(). Args: memory_engine: Memory engine instance bank_id: Bank identifier query: Search query request_context: Request context for authentication max_tokens: Maximum tokens for results (default 5000) tags: Optional tags to filter observations tags_match: How to match tags - "any" (OR), "all" (AND) last_consolidated_at: When consolidation last ran (for staleness check) pending_consolidation: Number of memories waiting to be consolidated source_facts_max_tokens: Token budget for source facts (-1 = disabled, 0+ = enabled with limit) Returns: Dict with matching observations including freshness info and source memories rQrmax_source_facts_tokensTinternal observationFr0)rr fact_typerS enable_tracerRr"r#r$include_source_factsrWrX_connection_budget_quietN up_to_date slightly_stalestalec6g|]}|S model_dump.0ms r z,tool_search_observations..s @@@A@@@rOc>i|]\}}||Srhrirlkvs r z,tool_search_observations..s&[[[tq!ALLNN[[[rO)rr; observations source_factsr9 freshnessrh)r recall_asyncrDresultsruitems)rrrrRrSr"r#r$rTrUrVrWrXr` recall_kwargs internal_ctxresultr9rvs rtool_search_observationsr}sRH3b8$&MK 7! ; ;3J /0 ?T:::L-=- /$ 1#% F$%q(H!!  # #$  V^$$@@@@@[[8K8Qr7X7X7Z7Z[[[   rOr0Tconnection_budgetmax_chunk_tokens fact_typesinclude_chunksc Kd| pddgD}t|d}|||||d||||| | |d| | d{V}|d |jDd |jpiDd S) a  Search memories using TEMPR retrieval. This is the ground truth - raw facts and experiences. Use when mental models/observations don't exist, are stale, or need verification. Args: memory_engine: Memory engine instance bank_id: Bank identifier query: Search query request_context: Request context for authentication max_tokens: Maximum tokens for results (default 2048) tags: Filter by tags (includes untagged memories) tags_match: How to match tags - "any" (OR), "all" (AND), or "exact" connection_budget: Max DB connections for this recall (default 1 for internal ops) max_chunk_tokens: Maximum tokens for raw source chunk text (default 1000) fact_types: Optional filter for fact types to retrieve. Defaults to ["experience", "world"]. include_chunks: Whether to fetch raw chunk text alongside facts (default True). Returns: Dict with list of matching memories including raw chunk text (when include_chunks) cg|]}|dv| S))world experiencerh)rlfts rrnztool_recall..s$nnnrPRVmPmPmPmPmPmrOrrTr[F)rrr^rSr_rRr"r#r$rWrXrarbrrNc6g|]}|Srhrirks rrnztool_recall..s <<<Q\\^^<<i|]\}}||Srhrirps rrsztool_recall..s&OOOA1allnnOOOrO)rmemorieschunks)rrwrxrry)rrrrRrSr"r#r$rrrrrWrXrecall_fact_typer{r|s r tool_recallrsNonj&K\74Knnn?T:::L --"$ #%,%).F&<.Os555S#d)S555rOc.g|]}|d |dSchunk_idrhrks rrnztool_expand..Rs%BBB1AjMB:BBBrOzT SELECT chunk_id, chunk_text, chunk_index, document_id FROM rz2 WHERE chunk_id = ANY($1) c i|] }|d| Srrhrs rrsztool_expand..as<<ztool_expand..cs'"X"X"XqGW"X1]#3"X"X"XrOrrzF SELECT id, original_text, retain_params FROM documentsz= WHERE id = ANY($1) AND bank_id = $2 c i|] }|d| Srrhrs rrsztool_expand..xs222c3t9c222rO) memory_idrzMemory not found: r4textr^context)r4rtyper)rmemory chunk_text chunk_index)r4rindexrchunk original_textr )r4 full_textrr )rxr;)rr(r>uuidUUID ValueErrorr?setaddlistziprrrrD)rrrrr( valid_uuidserrorsmidr memory_map chunk_idsdoc_ids_from_chunksdoc_ids_direct chunk_maprrmdoc_map all_doc_idsdocsrxmem_uuidritemrdocs r tool_expandr"s$)((((( IGHH$&KF== =   ty~~ . . . . = = =rs  ''''''''%%%%%%%%-""""""******,,,,,,  8 $ $ < <c3hRVAV < < < <*! $$(bb!b bb  b %[ b  b s)d bbbcT!b #s(^bbbbT! $,0!"#%%)&*OO!O O O& O  O s)d  OOO#T/OO!Od?OtOO #s(^OOOOn! $ #'%)&*??!? ? ?& ?  ? s)d  ?????S D ??d??tO? #s(^????DL7 L7 L7S L7  L7  #s(^ L7L7L7L7L7L7rO