uPjd DUdZddlmZddlmZmZmZddlmZddl m Z m Z erddl m Z e ddd e d dd  Zeed <GddeZd dededzdedzfdZdddedeedffdZdddedeeefdzfdZdddeededzfdZdddeededzfdZy)!aeThe counterfactual a complexity router's savings are measured against. The router's own tier ladder names the model the traffic would have run on without a router: a deployment has to pick one model that can carry the hardest request it will see, so the baseline is the priciest model in the hardest configured tier. A cheap tier is a choice the router made, not a ceiling it was bounded by. Candidates are ranked once against a fixed reference request, not against each request that runs. Ranking per request means reading the request, and every input shape it can take; a per-router default must not carry that surface. Baselines are always provider-qualified, because they travel to the spend writer as a bare string with no provider beside them; an operator who writes ``deepseek-r1`` meaning Azure would otherwise be priced against whoever else owns that name. )Iterable) TYPE_CHECKINGFinal NamedTuple)verbose_router_logger)PromptTokensDetailsWrapperUsage)Routeri NiiRi8J) cached_tokenscache_creation_tokens text_tokens) prompt_tokenscompletion_tokens total_tokensprompt_tokens_details_REFERENCE_REQUESTc0eZdZUdZeed<dZedzed<y)Baselinea|The counterfactual deployment: what it is called, and which deployment it was. ``model`` is what the operator would recognise, and the string the spend writer prices the counterfactual under. ``deployment_id`` only ranks: a deployment can be charged something other than its model's public rate, and `Router.get_deployment_model_info` is what merges the two. modelN deployment_id)__name__ __module__ __qualname____doc__str__annotations__rm/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/router_strategy/savings_baseline.pyrr#s J $M3:$rrNrcustom_llm_providerreturncddl}ddlm}|||}||d|j|dS |j ||\}}}}|d|S#t $r!}t jd||Yd}~yd}~wwxYw)a$``provider/model``, or ``None`` when the pair names no known provider. A deployment may name its vendor in the model prefix or in a separate ``custom_llm_provider``, and the bare name alone is not enough to price: it can resolve to a different vendor's rates, or to nothing at all. A github_copilot or chatgpt candidate is qualified by string alone: resolving either provider runs its OAuth device flow, and for a declared pair the resolver's answer is the declaration itself, so asking it buys nothing but the block. rN) declared_authenticating_provider/)rr z2savings baseline: cannot resolve candidate %s (%s))litellm1litellm.litellm_core_utils.get_llm_provider_logicr# removeprefixget_llm_provider Exceptionrdebug) rr r%r#declaredresolvedprovider_es rcanonical_modelr00sb6u>QRH1U//8*A?@AA#*#;#;%]p#;#q (AqZq ## ##$XZ_abcsA A9A44A9routerr group_name.cjj|}|st|x}r t|fSdSdtdtdzffd t fd|DS)a7The candidates a tier entry actually calls, each with its own pricing key. `litellm_params.model` is not always a model: on Azure it is the deployment name, absent from the cost map, and `model_info.base_model` names the real one. Wildcard and aliased deployments behave the same, and router.py resolves pricing through that same base_model chain. A name matching no deployment is a tier pointing straight at a provider model rather than at a configured group, and prices under its own name because there is no deployment to override it. rindexr!Ncj|}|jd}t|tsy|jd}t|tr|jdnd}|xs$|jdxs|jd}|rt ||jdnd}|yt|tr|jdnd}t ||rt |SdS)Nlitellm_params model_info base_modelrr id) model_listget isinstancedictr0rr) r4 deploymentparamsinfobaser qualifiedrr1s r candidatez_models_in..candidateWs"--e4 "'78&$' nn\20:40Fdhh|,DNvzz,7N6::g;NX]?5&**=R2STcg  1;D$1Gtxx~T  3}#5QQDQQrc38K|]}|xywNr).0r4crCs r z_models_in..es Ou51A,AA+NOs) model_name_to_deployment_indicesr;r0rinttuple)r1r2indicesrBrGrCs` @@r _models_inrMIsn<<@@LG 7Fz7R*R)*R#%[Y[[ R RD R OO OOrrCcddlm}|jjd\}}} |j |j xsd|j}|y||xs |jt ||\}}||z} | dkr!tjd |jy| |fS#t$r+} tjd|j| Yd} ~ yd} ~ wwxYw) a0``(cost_of_the_reference_request, candidate)``, or ``None`` when unpriceable. "Most expensive" is a property of a request, not of a rate: a deployment dearer per output token can be cheaper per cached token, so comparing a chosen pair of rates orders cache-heavy traffic backwards. Costing one reference request through the same engine the savings use leaves cache rates, tiered tables and every other billing dimension to that engine. A candidate that prices to nothing there cannot stand in for what the traffic would have cost. r)generic_cost_per_tokenr$N)rusager r7z2savings baseline: no pricing for candidate %s (%s)gz0savings baseline: candidate %s prices to nothing) .litellm.litellm_core_utils.llm_cost_calc.utilsrOr partitionget_deployment_model_inforrr)rr*) r1rCrOr-r. model_namer@ prompt_costcompletion_costr/costs r_pricedrYhsV'oo77<Ha 66y7N7N7TRTV_VeVef <'=/ $ ( ( $ _/D s{##$VXaXgXgh )  ##$XZcZiZiklms,B$!B$$ C-!CC candidatesc|tfd|D}|stjdyt|dS)zEThe candidate that would have cost the most on the reference request.c3@K|]}t|xywrE)rY)rFrCrr1s rrHz"_most_expensive..s#i QZA[<[A;h!iszBsavings baseline: no priceable candidates; savings driver disabledN)rKrr*max)r1rZpricedr]s` @r_most_expensiveras6iZiiF ##$hi v;q>r group_namesc tfd|DS#t$r }tjd|Yd}~yd}~wwxYw)aThe derived baseline for a router whose hardest tier offers ``group_names``. Holds no cache of its own; each pricing pass walks the pool, so the caller is expected to bound how often it runs. The complexity router caches the result with a TTL, which keeps a deployment added or removed at runtime able to change the baseline while keeping this walk off the per-request hot path. Never raises. This is read on the routing path to decorate a request that is about to be served, and a dashboard's counterfactual is not worth failing a live request over; an unresolvable baseline zeroes the savings driver instead. c3DK|]}t|D]}|ywrE)rM)rFnamerGr1s rrHz#resolve_baseline..s&'dd:V\^bKc'da'd'ds z@savings baseline: could not resolve, savings will read zero (%s)N)rar)rwarning)r1rbr/s` rresolve_baselinergs@v'dk'dee %%&hjkls A<ArE)rcollections.abcrtypingrrrlitellm._loggingrlitellm.types.utilsrr litellm.routerr rrrrr0rKrMfloatrYrargrrrrns %332A%"46aftuv E %z %$3$S4Z$3QU:$2PxPSPU8S=5IP>HeE8O6Lt6SBH(82DTXXHSMhQUor