CjSSKrSSKrSSKJr SSKJr SSKJr SSKJ r J r SSK J r J r "SS\R5r"S S \5r"S S 5rg) N)Optional) BaseModel) print_verbose) DualCache RedisCache)DEFAULT_IN_MEMORY_TTLDEFAULT_POLLING_INTERVALc\rSrSrSr\rSrg)SchedulerCacheKeys zscheduler:queueN)__name__ __module__ __qualname____firstlineno__queuerdefault_in_memory_ttl__static_attributes__r c/home/rurouni/.local/share/pipx/venvs/strix-agent/lib/python3.13/site-packages/litellm/scheduler.pyr r s Err c4\rSrSr%\\S'\\S'\\S'Srg)FlowItempriority request_id model_namer N)rrrrint__annotations__strrr rrrrsMOOrrc\rSrSr%\\S'SS\\S\\4Sjjr S\ 4Sjr S \ S \ S \ S \4S jrS\ S \ S S4SjrS \ S \ S \ S \4SjrSrS \ S \ 4SjrS\ S \ S S4SjrSrg) SchedulercacheNpolling_interval redis_cachec/UlSnUb[RRn[ X#S9UlU=(d [ Ulg)zO polling_interval: float or null - frequency of polling queue. Default is 3ms. N)r%r)rr rvaluerr#r r$)selfr$r%rs r__init__Scheduler.__init__sK 15  "$6$L$L$R$R !#    8 8 rrequestc# URURS9IShvN n[R"X!RUR 45 UR X!RS9IShvN gNRN7f)Nrrr) get_queuerheapqheappushrr save_queue)r(r+rs r add_requestScheduler.add_request0senn0B0BnCC u//1C1CDEooE6H6HoIII D Js"A6A2A A6,A4-A64A6idrhealth_deploymentsreturnc# URUS9IShvN nU(d[SRU55e[S[ U535 [ U5S:XaZ[SUSU35 USSU:Xa<[ R "U5 URXBS 9IShvN [S U35 g g g NN7f) z Return if request can be processed. Returns: - True: * If healthy deployments are available * OR If request at the top of queue - False: * If no healthy deployments available * AND request not at the top of queue r-N-Incorrectly setup. Queue is invalid. Queue={}zlen(health_deployments): rzqueue: z , seeking id=r.z Popped id: TF)r/ Exceptionformatrlenr0heappopr2r(r5rr6rs rpollScheduler.poll:snn n;;?FFuM  1#6H2I1JKL ! "a ' GE7-t< =Qx{b  e$ooEoIII B401/<"Js"CB<BC&B>'C>Crc# URUS9IShvN nUVs/sHoDSU:wdM UPM nn[R"U5 URXRS9IShvN [ SUSU35 gN_s snfN7f)zz Remove a specific request from the priority queue for a model. Used when a request times out while waiting in the queue. r-Nr:r.zRemoved request_id: z from queue for model: )r/r0heapifyr2r)r(rrritemfiltered_queues rremove_requestScheduler.remove_request_s{ nn n;;+0J54Gz4I$5J n%ooNoJJJ":,.Ej\ R <JJs0A>A5A> A7A7*A>A<A>7A>c# URUS9IShvN nU(d[SRU55eUSSU:XaggN37f)zKReturn if the id is at the top of the queue. Don't pop the value from heap.r-Nr9rr:TF)r/r;r<r?s rpeekScheduler.peeklsSnn n;;?FFuM  8A;" rcsB !9My }}r