]j dZddlmZmZmZddlmZmZddlm Z ddl m Z m Z m Z mZdded eed eeeffd Zdd e ded eed efd ZdS)z. Scraping functionality for Firecrawl v2 API. )OptionalDictAny) ScrapeOptionsDocument)normalize_document_input) HttpClienthandle_response_errorprepare_scrape_optionsvalidate_scrape_optionsNurloptionsreturnc|r|stdd|i}|7t|}|&t|}|r|||S)z Prepare a scrape request payload for v2 API. Args: url: URL to scrape options: ScrapeOptions (snake_case) to convert and include Returns: Request payload dictionary with camelCase fields zURL cannot be emptyr)strip ValueErrorr r update)rr request_data validatedoptss c/home/rurouni/.hermes/hermes-agent/venv/lib/python3.11/site-packages/firecrawl/v2/methods/scrape.py_prepare_scrape_requestr s 0ciikk0.///$)399;;#7L+G44  ))44D *##D))) clientcvt||}|d|}|jst|d|}|ds#t |dd|di}t|}tdi|S)aJ Scrape a single URL and return the document. The v2 API returns: { success: boolean, data: Document } We surface just the Document to callers. Args: client: HTTP client instance url: URL to scrape options: Scraping options (snake_case) Returns: Document z /v2/scrapescrapesuccesserrorzUnknown error occurreddata) rpostokr jsonget Exceptionr r)rrrpayloadresponsebody document_data normalizeds rrr$s&c733G{{<11H ;2h111 ==??D 88I  E*BCCDDDHHVR((M)-88J  ! !j ! !!r)N)__doc__typingrrrtypesrrutils.normalizer utilsr r r r strrrr!rrr2s'&&&&&&&&&++++++++666666ffffffffffffx /FRVWZ\_W_R`2"":"C"(=2I"U]""""""r