tPj jUdZddlmZmZmZddlmZerddlmZedZ dZ ee e dfe d<iZ eeee effe d<d j#d eee DZee d <d d j#e d edd j#de DdZee d<defdZdede ddfdZddZy)aFPod-local queue of shadow-eval funnel increments, drained by the spend-update job. The shadow-eval success hook counts the sampled-traffic outcomes that never produce an attempt row (a lost sampling dice roll, an unjudgeable request shape, a concurrency shed), so a job's results can state what share of its eligible traffic the judged rows represent. Counters are advisory coverage stats: a pod dying loses at most one flush interval, and a failed flush drops its batch because a repeated increment is worse than an undercount (same call as the auto-router session rollup flush). ) TYPE_CHECKINGFinalLiteral)verbose_proxy_logger) PrismaClient) not_sampled unjudgeableshedwithheld. FUNNEL_STAGES_pendingz, c#,K|] }d|dzyw)$N).0ns h/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/db/shadow_eval_funnel.py rs'W!AE7 'Ws_FUNNEL_PLACEHOLDERSz1 INSERT INTO "LiteLLM_ShadowEvalFunnel" (job_id, z) VALUES ($1, z)) ON CONFLICT (job_id) DO UPDATE SET c#0K|]}|d|d|yw)z = "LiteLLM_ShadowEvalFunnel".z + EXCLUDED.Nr)rstages rrrs#mV[%6ug\%Qms _UPSERT_FUNNEL_SQLreturncJtdtjDS)zQueue census for the drain triggers: entries not yet flushed, so a funnel-only batch still wakes the spend job that would otherwise skip an empty-queue run.c3NK|]}t|jywN)sumvalues)rcounterss rrz4pending_shadow_eval_funnel_events..%sH(s8??$%Hs#%)rr r rr!pending_shadow_eval_funnel_eventsr#"s Hhoo6GH HHr"job_idrNcztj|tjtd}||xxdz cc<y)zCount one skipped request for one job leg; synchronous so the hook's read-modify- write cannot interleave with the flush's snapshot on the shared event loop.rN)r setdefaultdictfromkeysr )r$rr!s rrecord_shadow_eval_funnel_eventr*(s/))&$-- q2QRH UOqOr"cbKtsytt}tj|jD]=\} |jj t |gfdtDd{?y7#t$r"}tjd||Yd}~id}~wwxYww)Nc3(K|] }| ywrr)rrr!s rrz+flush_shadow_eval_funnel..9s=e(5/=szKSpend tracking - shadow eval funnel flush failed for job %s, %s dropped: %s) r r(clearitemsdb execute_rawrr Exceptionrerror) prisma_clientbatchr$ flush_errr!s @rflush_shadow_eval_funnelr6/s >E NN!KKM  .-""..">}=       & &]    sBAB/2B7A?8B<B/?B B, B'"B/'B,,B/)r3rrN)__doc__typingrrrlitellm._loggingrlitellm.proxy.utilsrShadowEvalFunnelStager tuple__annotations__r r(strintjoinrangelenrrr#r*r6rr"rrCs1010 PQ:l uU0#567l8:$sD.344 5:"ii'WU3}CU=V'WWeW!115=1I0JK ! "# YYm_lmmno EI3I C8MRVr"