_jfSSKJr SSKJr SSKJr SSKrSSKJr SSK J r J r J r J r JrJrJr SSKJrJrJr SS KJr SS KJrJr SS KJrJr S S KJrJrJ r J!r!J"r"J#r# SSK$J%r%J&r& SSK'J(r(J)r) SSK*J+r+J,r, SSK-J.r. SSK/J0r0 SSK1J2r2 SSK3J4r4 SSK5J6r6 SSK7J8r8 SS/r9"SS\5r:"SS\5r;"SS5r<"SS5r="SS 5r>"S!S"5r?g)#) annotations)Optional)LiteralN)_legacy_response)BodyOmitQueryHeadersNotGivenomit not_given) path_templatemaybe_transformasync_maybe_transform)cached_property)SyncAPIResourceAsyncAPIResource)to_streamed_response_wrapper"async_to_streamed_response_wrapper) OutputItemsAsyncOutputItemsOutputItemsWithRawResponseAsyncOutputItemsWithRawResponse OutputItemsWithStreamingResponse%AsyncOutputItemsWithStreamingResponse)SyncCursorPageAsyncCursorPage)run_list_paramsrun_create_params)AsyncPaginatormake_request_options)Metadata)RunListResponse)RunCancelResponse)RunCreateResponse)RunDeleteResponse)RunRetrieveResponseRuns AsyncRunsc n\rSrSrSr\SSj5r\SSj5r\SSj5r\ \ SSS\ S.SSjjr SSS\ S .SS jjr \ \ \ \ SSS\ S .SS jjr SSS\ S .SS jjrSSS\ S .SSjjrSrg)r*%,Manage and run evals in the OpenAI platform.c,[UR5$r.)r_clientselfs U/home/rurouni/.local/lib/python3.13/site-packages/openai/resources/evals/runs/runs.py output_itemsRuns.output_items(s4<<((c[U5$z This property can be used as a prefix for any HTTP method call to return the raw response object instead of the parsed content. For more information, see https://www.github.com/openai/openai-python#accessing-raw-response-data-eg-headers )RunsWithRawResponser2s r4with_raw_responseRuns.with_raw_response-s#4((r7c[U5$z An alternative to `.with_raw_response` that doesn't eagerly read the response body. For more information, see https://www.github.com/openai/openai-python#with_streaming_response )RunsWithStreamingResponser2s r4with_streaming_responseRuns.with_streaming_response7s)..r7Nmetadataname extra_headers extra_query extra_bodytimeoutc U(d[SU<35eUR[SUS9[UUUS.[R 5[ UUUUSS0S9[S9$)  Kicks off a new run for a given evaluation, specifying the data source, and what model configuration to use to test. The datasource will be validated against the schema specified in the config of the evaluation. Args: data_source: Details about the run's data source. metadata: Set of 16 key-value pairs that can be attached to an object. This can be useful for storing additional information about the object in a structured format, and querying for objects via API or the dashboard. Keys are strings with a maximum length of 64 characters. Values are strings with a maximum length of 512 characters. name: The name of the run. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds 6Expected a non-empty value for `eval_id` but received /evals/{eval_id}/runseval_id data_sourcerCrD bearer_authTrErFrGrHsecuritybodyoptionscast_to) ValueError_postrrr!RunCreateParamsr#r' r3rNrPrCrDrErFrGrHs r4create Runs.create@sNUV]U`ab bzz 17 C #. (  "11 )+'%'. &#  r7rErFrGrHc U(d[SU<35eU(d[SU<35eUR[SX!S9[UUUUSS0S9[S9$)  Get an evaluation run by ID. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rK5Expected a non-empty value for `run_id` but received /evals/{eval_id}/runs/{run_id}rNrun_idrQTrRrVrWrX_getrr#r)r3rdrNrErFrGrHs r4retrieve Runs.retrieve}sv0UV]U`ab bTU[T^_` `yy :G [(+'%'. (  r7afterlimitorderstatusrErFrGrHcU(d[SU<35eUR[SUS9[[[ UUUU [ UUUUS.[R5SS0S9[S9$ a Get a list of runs for an evaluation. Args: after: Identifier for the last run from the previous pagination request. limit: Number of runs to retrieve. order: Sort order for runs by timestamp. Use `asc` for ascending order or `desc` for descending order. Defaults to `asc`. status: Filter runs by status. One of `queued` | `in_progress` | `failed` | `completed` | `canceled`. extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rKrLrM)rlrmrnrorQT)rErFrGrHqueryrS)pagerVmodel) rX _get_api_listrrr%r#rr RunListParams r3rNrlrmrnrorErFrGrHs r4list Runs.listsJUV]U`ab b!! 17 C0(+'%%!&!&!&"(  $11(. "'"  r7c U(d[SU<35eU(d[SU<35eUR[SX!S9[UUUUSS0S9[S9$)  Delete an eval run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rKrarbrcrQTrRrerX_deleterr#r(rhs r4delete Runs.deletesv0UV]U`ab bTU[T^_` `|| :G [(+'%'. &  r7c U(d[SU<35eU(d[SU<35eUR[SX!S9[UUUUSS0S9[S9$)  Cancel an ongoing evaluation run. Args: extra_headers: Send extra headers extra_query: Add additional query parameters to the request extra_body: Add additional JSON properties to the request timeout: Override the client-level default timeout for this request, in seconds rKrarbrcrQTrRrerXrYrr#r&rhs r4cancel Runs.cancel sv0UV]U`ab bTU[T^_` `zz :G [(+'%'. &  r7)returnr)rr:)rr?rNstrrPzrun_create_params.DataSourcerCzOptional[Metadata] | OmitrD str | OmitrEHeaders | NonerF Query | NonerG Body | NonerH'float | httpx.Timeout | None | NotGivenrr'rdrrNrrErrFrrGrrHrrr))rNrrlrrm int | OmitrnLiteral['asc', 'desc'] | OmitroJLiteral['queued', 'in_progress', 'completed', 'canceled', 'failed'] | OmitrErrFrrGrrHrrzSyncCursorPage[RunListResponse]rdrrNrrErrFrrGrrHrrr(rdrrNrrErrFrrGrrHrrr&__name__ __module__ __qualname____firstlineno____doc__rr5r;r@r rr\rirxr~r__static_attributes__rr7r4r*r*%sD6))))///3)-$("&;D; ; 2 ; , ;  ; &; ";  ; 9;  ; H)-$("&;D& &  & && "&  & 9&  & X! /3]a)-$("&;D; ;  ;  ; - ; [; &; ";  ; 9;  ); H)-$("&;D& &  & && "&  & 9&  & ^)-$("&;D& &  & && "&  & 9&  & & r7c n\rSrSrSr\SSj5r\SSj5r\SSj5r\ \ SSS\ S.SSjjr SSS\ S .SS jjr \ \ \ \ SSS\ S .SS jjr SSS\ S .SS jjrSSS\ S .SSjjrSrg)r+i3r.c,[UR5$r0)rr1r2s r4r5AsyncRuns.output_items6s  --r7c[U5$r9)AsyncRunsWithRawResponser2s r4r;AsyncRuns.with_raw_response;s(--r7c[U5$r>)AsyncRunsWithStreamingResponser2s r4r@!AsyncRuns.with_streaming_responseEs.d33r7NrBc # U(d[SU<35eUR[SUS9[UUUS.[R 5IShvN [ UUUUSS0S9[S 9IShvN $N!N7f) rJrKrLrMrONrQTrRrT)rXrYrrr!rZr#r'r[s r4r\AsyncRuns.createNsNUV]U`ab bZZ 17 C,#. (  "11 )+'%'. &#     s$A A4A0 A4+A2,A42A4r^c # U(d[SU<35eU(d[SU<35eUR[SX!S9[UUUUSS0S9[S9IS hvN $N7f) r`rKrarbrcrQTrRreNrfrhs r4riAsyncRuns.retrieves0UV]U`ab bTU[T^_` `YY :G [(+'%'. (    AA#A!A#rkcU(d[SU<35eUR[SUS9[[[ UUUU [ UUUUS.[R5SS0S9[S9$rq) rXrurrr%r#rr rvrws r4rxAsyncRuns.listsJUV]U`ab b!! 17 C 1(+'%%!&!&!&"(  $11(. "'"  r7c # U(d[SU<35eU(d[SU<35eUR[SX!S9[UUUUSS0S9[S9IS hvN $N7f) r{rKrarbrcrQTrRreNr|rhs r4r~AsyncRuns.deletes0UV]U`ab bTU[T^_` `\\ :G [(+'%'. &"    rc # U(d[SU<35eU(d[SU<35eUR[SX!S9[UUUUSS0S9[S9IS hvN $N7f) rrKrarbrcrQTrRreNrrhs r4rAsyncRuns.cancels0UV]U`ab bTU[T^_` `ZZ :G [(+'%'. &    rr)rr)rr)rrrr)rNrrlrrmrrnrrorrErrFrrGrrHrrzAAsyncPaginator[RunListResponse, AsyncCursorPage[RunListResponse]]rrrrr7r4r+r+3sE6....44/3)-$("&;D; ; 2 ; , ;  ; &; ";  ; 9;  ; H)-$("&;D& &  & && "&  & 9&  & X! /3]a)-$("&;D; ;  ;  ; - ; [; &; ";  ; 9;  K; H)-$("&;D& &  & && "&  & 9&  & ^)-$("&;D& &  & && "&  & 9&  & & r7c2\rSrSrSSjr\SSj5rSrg)r:iAcXl[R"UR5Ul[R"UR5Ul[R"UR 5Ul[R"UR 5Ul[R"UR5UlgN)_runsrto_raw_response_wrapperr\rirxr~rr3runss r4__init__RunsWithRawResponse.__init__Bs &>> KK  )@@ MM  %<< II  '>> KK  '>> KK  r7c@[URR5$r0)rrr5r2s r4r5 RunsWithRawResponse.output_itemsUs*$***A*ABBr7rrr\r~rxriNrr*rNone)rrrrrrrrr5rrr7r4r:r:As &CCr7r:c2\rSrSrSSjr\SSj5rSrg)ri[cXl[R"UR5Ul[R"UR5Ul[R"UR 5Ul[R"UR 5Ul[R"UR5Ulgr)rrasync_to_raw_response_wrapperr\rirxr~rrs r4r!AsyncRunsWithRawResponse.__init__\s &DD KK  )FF MM  %BB II  'DD KK  'DD KK  r7c@[URR5$r0)rrr5r2s r4r5%AsyncRunsWithRawResponse.output_itemsos/tzz/F/FGGr7rNrr+rr)rrrrr7r4rr[s &HHr7rc2\rSrSrSSjr\SSj5rSrg)r?iucXl[UR5Ul[UR5Ul[UR5Ul[UR 5Ul[UR 5Ulgr)rrr\rirxr~rrs r4r"RunsWithStreamingResponse.__init__vsn 2 KK  5 MM  1 II  3 KK  3 KK  r7c@[URR5$r0)rrr5r2s r4r5&RunsWithStreamingResponse.output_itemss0 0G0GHHr7rNr)rrrrr7r4r?r?us &IIr7r?c2\rSrSrSSjr\SSj5rSrg)ricXl[UR5Ul[UR5Ul[UR5Ul[UR 5Ul[UR 5Ulgr)rrr\rirxr~rrs r4r'AsyncRunsWithStreamingResponse.__init__sn 8 KK  ; MM  7 II  9 KK  9 KK  r7c@[URR5$r0)rrr5r2s r4r5+AsyncRunsWithStreamingResponse.output_itemss5TZZ5L5LMMr7rNr)rrrrr7r4rrs &NNr7r)@ __future__rtypingrtyping_extensionsrhttpxr_typesrr r r r r r_utilsrrr_compatr _resourcerr _responserrr5rrrrrr paginationrr types.evalsr r! _base_clientr"r#types.shared_params.metadatar$types.evals.run_list_responser%types.evals.run_cancel_responser&types.evals.run_create_responser'types.evals.run_delete_responser(!types.evals.run_retrieve_responser)__all__r*r+r:rr?rrr7r4rs#% !LLLLL';Z;>A5=AAAE ; K ?K \K  K \CC4HH4II4NNr7