_j SrSSKJrJrJrJr SSKJrJr S\ S\ 4Sjr S\S\4S jr S\S\ 4S jr S rS S \S\ S\\ \4S\\S\ 4 SjjrS\\ \4S\ 4SjrS!S \S\\ \4S\\S\S\4 SjjrS\S\ 4SjrS S\S\\ \ 44SjjrS\S\\\ \44SjrS\S\\ \44SjrS\S\\ \44SjrS\S\\ \44SjrS\S\\ \44SjrS\\S\\4SjrS\\S\\\ \44Sjrg )"z3 Shared validation functions for Firecrawl v2 API. )OptionalDictAnyList) ScrapeOptions ScrapeFormats format_strreturnc0SSSS.nURX5$)z Convert format string from snake_case to camelCase. Args: format_str: Format string in snake_case Returns: Format string in camelCase rawHtmlchangeTrackingzscreenshot@fullPage)raw_htmlchange_trackingscreenshot_full_page)get)r format_mappings R/home/rurouni/.local/lib/python3.13/site-packages/firecrawl/v2/utils/validation.py_convert_format_stringr s'+ 5N   j 55schemac^^U(a[U[5(dU$[5mS[S[4UU4SjjmT"U5$)z Normalize a schema for OpenAI compatibility by handling recursive references. Args: schema: Schema to normalize Returns: Normalized schema objr c*>[U[5(d0[U[5(aUVs/sH nT "U5PM sn$U$[U5nUT ;aU$T R U5 [U5nSU;aT R U5 U$SU;aUR S5n0nUR5H0upg[U[5(aSU;a T "U5XV'M,XuU'M2 0nUR5HupgT "U5X'M 0UESU0En T R U5 U $URS5S:XaSU;aURS5SLaUS URS5S:XanSU;ahSU;ab[US[5(aG[US[5(a/USV s/sHn XS;dM U PM n n U (aXS'OUS OUS [UR55Huupg[U[5(aSU;a T "U5X6'M,[U[5(dMCUVs/sH"n[U[5(aT "U5OUPM$ snX6'Mw T R U5 U$s snfs sn fs snf) N$ref$defstypeobject propertiesadditionalPropertiesTrequired) isinstancedictlistidadddiscardpopitemsr)ritemobj_id normalizeddefsprocessed_restkeyvaluenormalized_defsresultfieldvalid_requirednormalize_objectvisiteds rr55normalize_schema_for_openai..normalize_object*s#t$$#t$$;>?34(.3??JC W J F#Y  Z  OOF #  j >>'*DN(..0 eT**vU/B*:5*AN'*/3' 1 !O"jjl '7'>$+BAAF OOF #M NN6 "h . J & NN1 2d :12 NN6 "h . * $ J &:j1488:l3T::5? 5K"E5KE"'l+C"C#(5K"E!-;z*":.z*z//12JC%&&6+>"25"9 E4((jo"pjobfZd=S=S#3D#9Y]#]jo"p  3 w@V"E#qsJ6 J J )J)r"r#setr)rr5r6s @@rnormalize_schema_for_openair9sF FD11 eG>c>c>>@ F ##rc^^U(a[U[5(dg[5mS[S[4UU4SjjmT"U5(+$)z Validate schema for OpenAI compatibility. Args: schema: Schema to validate Returns: True if schema is valid, False otherwise Trr c>[U[5(dg[U5nUT;agTRU5 SU;aTR U5 gUR S5S:Xa2SU;a,SU;a&UR S5SLaTR U5 gUR 5Hn[U[5(a(SU;a"T"U5(aTR U5 gM@[U[5(dMWUHCn[U[5(dMSU;dM"T"U5(dM1TR U5 g M TR U5 g) NFrrrrpatternPropertiesr T)r"r#r%r&r'rvaluesr$)rr+r0r*has_invalid_structurer6s rr>9validate_schema_for_openai..has_invalid_structure|s%#t$$C W  F S= OOF # GGFOx '  # s * GG* +t 3 OOF #ZZ\E%&&6+>(//OOF+0E4((!D!$--&2D066#OOF3#' " " r)r"r#r8rbool)rr>r6s @@rvalidate_schema_for_openairAmsG FD11eG!3!4!!F%V, ,,raSchema contains invalid structure for OpenAI: object type with no 'properties' defined but 'additionalProperties: true' (schema-less dictionary not supported by OpenAI). Please define specific properties for your object. Note: Recursive schemas using '$ref' are supported.Nrtarget_def_namer-r6cdU(a[U[[45(dgUc [5nSSKnUR US[ S9nXS;agURU5 [U[5(aSU;a[US[ 5(awUSRS5n[U5S:aTUSS :XaKUS S :XaBUS nXq:XaURU5 gXr;a [X'XU5URU5 $UR5H'n[XX#5(dM URU5 g OB[U[5(a-UH'n [XX#5(dM URU5 g URU5 g!URU5 f=f) aU Check if an object contains a recursive reference to a specific definition. Args: obj: Object to check target_def_name: Name of the definition to check for recursion defs: Dictionary of definitions visited: Set of visited object keys to detect cycles Returns: True if recursive reference is found, False otherwise FNrT) sort_keysdefaultr/#r) r"r#r$r8jsondumpsstrr&splitlenr'_contains_recursive_refr=) rrBr-r6rKobj_keyref_pathdef_namer0r*s rrPrPs jtTl33%jjcj:G KK! c4 }CK!=!=v;,,S1x=A%(1+*<!PWAW'|H2#   '6t~^ef  *54QQ  &T " "*4$PP      s1"A2F'F "F2F,F5FFF/clU(dgUR5Hup[X!U5(dM g g)z Check if $defs contain circular references. Args: defs: Dictionary of definitions to check Returns: True if circular references are found, False otherwise FT)r)rP)r-rS def_values r_check_for_circular_defsrVs2 #zz| "9 = = , rdepthc U(a![U[[45(aUS:aU$Uc [5n[ U5nXB;aU$UR U5 [U[5(aSU;a[US[ 5(a~USRS5n[U5S:aHUSS:Xa?USS:Xa6US nXa;a,[[X5XUS-5URU5 $UURU5 $0nUR5HupUS:XaM [XX#S-5Xx'M UURU5 $[U[5(a1UV s/sHn [XX#S-5PM sn URU5 $URU5 U$s sn f!URU5 f=f) a$ Resolve $ref references in a JSON schema object. Args: obj: Object to resolve references in defs: Dictionary of definitions visited: Set to track visited objects and prevent infinite recursion depth: Current recursion depth Returns: Object with resolved references rrFrGrrHrIrrJ) r"r#r$r8r%r&rMrNrO resolve_refsr'r)) rr-r6rWr+rRrSresolvedr/r0r*s rrZrZs jtTl33urz % WF   KK c4 }CK!=!=v;,,S1x=A%(1+*<!PWAW'|H'+D,@$QVYZQZ[  H!iik '> ,U'19 M *  T " "MPQSTLWai@SQ  #  J R s1B F3:F3 5F3F3-F.F3.F33GcU(a[U[5(dgSSKnURU5nSU;=(d SU;=(d SU;n[ UR S5=(d UR S55nU=(d U$) z Detect if a schema contains recursive references. Args: schema: Schema to analyze Returns: True if schema has recursive patterns, False otherwise FrN"$ref"#/$defs/z#/definitions/r definitions)r"r#rKrLr@r)rrK schema_stringhas_refshas_defss rdetect_recursive_schemarc#s| FD11JJv&MM! *m# *M) FJJw'D6::m+DEH  xrcNU(dSSS.$[U5(aSSS.$SSS.$)z Select appropriate model based on schema complexity. Args: schema: Schema to analyze Returns: Dict with modelName and reason z gpt-4o-mini no_schema) modelNamereasonzgpt-4orecursive_schema_detected simple_schema)rc)rs rselect_model_for_schemarj<s4 *kBBv&&%1LMM&/ BBrc2[US5(a*[UR5(aUR5$[US5(ak[UR5(aQ[ UR SS5n[U5(aUR R5$UR5$[US5(a*[UR 5(aUR 5$[US5(ak[UR5(aQ[ UR SS5n[U5(aUR R 5$UR5$[U[5(aU$S$![a N%f=f)z} Normalize a schema object which may be a dict, Pydantic BaseModel subclass, or a Pydantic model instance into a plain dict. model_json_schema model_dumpNrr#) hasattrcallablerlrmgetattr __class__rr# Exceptionr")rmjsschs r_normalize_schemaruOs@  6. / /HV=U=U4V4V++- - 6< ( (Xf6G6G-H-H&**,?FC}}''99;;$$& & 68 $ $&--)@)@==? " 66 " "x '<'<&**Hd;C}}''..00;;=  --6747    s0:F A+F )F 9:F 4A+F F FF format_objcX[U[5(d [S5eURS5S:wa [S5eURS5n[U5nUGb)[ U5nUGb[U[5(aURS05nSSKnUR U5nURS5=(d S U;=(d S U;nU(aV[X45nUR U5n S U ;=(d S U ;n U (d Un[U[5(a SU;aUS O*[X45n[U[5(a SU;aUS [U5n [U 5(d[[5eXS'U$![a N,89J,Q)%&7>>7N_C_ 1' : (CCT'U $-.FGG !<==#;x %%%s%AF 3)F FF F)(F)c@[U[5(d [S5e[URS5[5(aUSR 5(d [S5eSU;a [S5eURS5nUbUS;a [S5eU$) z Validate and prepare query format object. Args: format_obj: Format object that should be query type Returns: Validated query format dict Raises: ValueError: If query format is missing required 'prompt' field >query format must be an object with 'type' and 'prompt' fieldspromptz1query format requires a non-empty 'prompt' string directQuotez1query format uses 'mode' instead of 'directQuote'mode)freeformrz5query format mode must be 'freeform' or 'directQuote'r"r#ryrrMstrip)rvrs r_validate_query_formatrs j$ ' 'YZZ jnnX. 4 4Jx>& !D D(CCPQQ rc[U[5(d [S5e[URS5[5(aUSR 5(d [S5eU$)z,Validate and prepare question format object.Cquestion format must be an object with 'type' and 'question' fieldsquestionz6question format requires a non-empty 'question' stringrrvs r_validate_question_formatrsV j$ ' '^__ jnnZ0# 6 6j>T>Z>Z>\>\QRR rc[U[5(d [S5e[URS5[5(aUSR 5(d [S5eU$)z.Validate and prepare highlights format object.Bhighlights format must be an object with 'type' and 'query' fieldsqueryz5highlights format requires a non-empty 'query' stringrrs r_validate_highlights_formatrsV j$ ' ']^^ jnnW-s 3 3:g;N;T;T;V;VPQQ roptionscUcgURbURS::a [S5eURbURS:a [S5eU$)z Validate and normalize scrape options. Args: options: Scraping options to validate Returns: Validated options or None Raises: ValueError: If options are invalid NrzTimeout must be positivezwait_for must be non-negative)timeoutrywait_for)rs rvalidate_scrape_optionsrs["w!';344#(8(81(<899 Nrc Ucg[U5nUcgSSSSSSSSS.nURSS9nUR5HupEXC;dM XSU'M 0nSSS S S S S SSSSS. nUR5HupX;dM URU5Xi'M! UR5G HupU cM U S:Xa'[ U 5R 5=(d SUS'M8U S:XGa]/n [ USS5n [U [5(Ga5U R(Ga3U RGH"n[U[5(a`US:Xa [S5eUS:Xa [S5eUS:Xa [S5eUS:Xa [S5eU R[U55 My[U[5(Ga`URS5(a[URS55OSnUS:Xa$[0UESS0E5nU RU5 MUS:XaU R[!U55 GMUS:XaU R[#U55 GM1US:XaU R[%U55 GMTUS:Xaj0UESS0EnSU;aURS5US 'URS!5n['US"5(aURSS9US!'U RU5 GMSU;aU=(d USUS'U RU5 GM['US5(GaUR(S:Xa+U R[UR555 GM<UR(S:Xa*U R[!URSS955 GMvUR(S:Xa*U R[#URSS955 GMUR(S:Xa*U R[%URSS955 GMU R[UR(55 GMU RU5 GM% U R*(aU RS#5 U R,(aU RS$5 U R.(aU RS%5 U R0(aU RS&5 U R2(aU RS'5 U R4(aU RS5 U R6(aU RS(5 GO[U [85(GaU GHn[U[5(a`US:Xa [S5eUS:Xa [S5eUS:Xa [S5eUS:Xa [S5eU R[U55 My[U[5(Ga`URS5(a[URS55OSnUS:Xa$[0UESS0E5nU RU5 MUS:XaU R[!U55 GMUS:XaU R[#U55 GM1US:XaU R[%U55 GMTUS:Xaj0UESS0EnSU;aURS5US 'URS!5n['US"5(aURSS9US!'U RU5 GMSU;aU=(d USUS'U RU5 GM['US5(GaUR(S:Xa+U R[UR555 GM<UR(S:Xa*U R[!URSS955 GMvUR(S:Xa*U R[#URSS955 GMUR(S:XaSS0n[ USS5bUR:US '[ US)S5bUR<US)'[ US!S5nUb%['US"5(aURSS9OUUS!'U RU5 GMGUR(S:Xa*U R[%URSS955 GMU R[UR(55 GMU RU5 GM OU HnU RU5 M U (aXS'GMGMU S*:Xa/nU Hn[U[5(aA0nUR5HunnUS:XaUUS 'MUUU'M URU5 MYURSS9n0nUR5HunnUS:XaUUS 'MUUU'M URU5 M UUS*'G MYU S+:Xa/nU Hn[U[5(aURU5 M+[U[5(a8[U5nS,U;aURS,5US-'URU5 MxURSS9nS,U;aURS,5US-'URU5 M UUS+'G M!U S.:Xa1[U [5(aXS.'G MCU RSS9US.'G MXU S/:Xak[U [5(a)U S0U RS1U RS2S55S3.nO%U R@[ U S1[ U S2S55S3.nUUS/'G MXU 'G M U$![>a GNVf=f)4z Prepare ScrapeOptions for API submission with manual snake_case to camelCase conversion. Args: options: ScrapeOptions to prepare Returns: Dictionary ready for API submission or None if options is None NTFi)only_main_contentmobileskip_tls_verificationremove_base64_images fast_mode block_adsmax_agestore_in_cache) exclude_none includeTags excludeTagsonlyMainContentwaitForskipTlsVerificationremoveBase64ImagesfastModeuseMockblockAds storeInCachemaxAge) include_tags exclude_tagsrrrrruse_mockrrr integrationformatsrKrxrrrr highlightsrr screenshot full_pagefullPageviewportrmmarkdownhtmlr summarylinksrqualityactionsparsers max_pagesmaxPageslocationprofilename save_changes saveChanges)rr)!rrmr)r(rMrrpr"r rryappendrr#rrrrrrnrrrrrrrrr$rr TypeErrorr)rvalidated_optionsdefault_values options_datar3 default_value scrape_datafield_mappings snake_case camel_caser/r0converted_formatsoriginal_formatsfmtfmt_typevalidated_jsonr,vpconverted_actionsactionconverted_action action_key action_value action_dataconverted_parsersparser parser_data profile_datas rprepare_scrape_optionsrs 08 "!% $ N%//T/BL!/ 4 4 6  $"/ !7K&%.!6 4( N#1"6"6"8  %&2&6&6z&BK ##9 #((*   m#.1%j.>.>.@.HD M*i/1!$+7It#D . >>'///#3#;#;C)#s33#&&=*45+A%A#&'>*45u*v$v#&*#4*45z*{${#&,#6*45y*z$z 1 8 89OPS9T U!+C!6!6VYV]V]^dVeVe+A#''&/+Rko#+v#55JKbcKbSY[aKb5cN$5$<$<^$L%-%;$5$<$<=VWZ=[$\%-%=$5$<$<=XY\=]$^%-%8$5$<$<=STW=X$Y%-%=1NC1N1NJ'2j'@AKP[A\ :(>)3 )CB'.r<'@'@AC\`Aa :(>$5$<$6M#f+F $5$<$'77)001AB 0$77/%c3//"f}&01{&| |"g~&01q&r r"j0&01v&w w"l2&01u&v v-445KC5PQ'T22RURYRYZ`RaRa'=cggfo'NgkH'611FG^#G^vW]G^1_ 1 8 8 H!)Z!7 1 8 89RSV9W X!)\!9 1 8 89TUX9Y Z!)W!4 1 8 89OPS9T U!)\!9-J-JV\-J #.*#<=G^^K=XJz$:%/^^J%?#*2|#<#<=?]]X\]=]Jz$: 1 8 8 D#)S=2:2Ic&kCK 1 8 8 =$S&11"xx61 1 8 89Ns~~O_9` a!$Z!7 1 8 89RSVSaSaosSaSt9u v!$\!9 1 8 89TUXUcUcquUcUv9w x!$\!9.4l-C #*3 T#B#N=@]]Jz$:#*3 4#@#LahikmyazazR]]X\]=]ACJz$: 1 8 8 D!$W!4 1 8 89OPSP^P^lpP^Pq9r s 1 8 89OPSPXPX9Y Z-44S9q 0v#(C-44S9$) %-> *% !$&!#F!&$//+-(8> 4J )[8?K 0 .>D.>.QK + !eT** %f ',yy=Z^A_'`$L !& '.ungeUbdhFi'j$L*6 I&$)C g+j G%sm99 nn)N)Nr)__doc__typingrrrrtypesrr rMrr9r@rArzr8rPrVintrZrcrjrurrrrrrrrrs-,06s6s6$O$O$O$d2-s2-t2-lm00s0$sCx.0[cdg[h0tx0f4S>d(0c0c3h0(3-0WZ0cf0f C D 2CCC4S>C&8c8htCH~&>8BCcCd38nCLstCH~:#$sCx.CDcNXm%<-AX6RH]$;RcSVh@XRr