tPj(` 0UdZddlmZddlmZddlmZddlmZm Z m Z ddl m Z ddl Z ddlmZdd lmZdd lmZmZmZmZdd lmZdd lmZmZmZeZeed <eddGddZde de!ee e"fdfde#dzfdZ$dee e"fdee e"fdedzfdZ%de dedzfdZ&de defdZ'dZ(ejSddge eg e efd!efd"Z*ejWddge eg e efd#e,e e#fd!efd$Z-ejSd%dge eg e efd!efd&Z.ejWd%dge eg e efd'e,e e#e,e e#fzfd!efd(Z/Gd)d*e Z0Gd+d,e Z1ejSd-d.e efe1/de1fd0Z2ejWd-d.e efe1/d1e0de1fd2Z3ejid3dge ege/e efd1ed!edefd4Z5y)5a COST TRACKING SETTINGS MANAGEMENT Endpoints for managing cost discount and margin configuration GET /config/cost_discount_config - Get current cost discount configuration PATCH /config/cost_discount_config - Update cost discount configuration GET /config/cost_margin_config - Get current cost margin configuration PATCH /config/cost_margin_config - Update cost margin configuration POST /cost/estimate - Estimate cost for a given model and token counts )Mapping) dataclass)Final) APIRouterDepends HTTPException) BaseModelN)verbose_proxy_logger)completion_cost)CommonProxyErrorsCostEstimateRequestCostEstimateResponseUserAPIKeyAuth)user_api_key_auth) CostPerTokenLlmProvidersSet ModelInforouterT)frozenslotsc8eZdZUeed<edzed<edzed<y)ResolvedCostModelmodelNprovidercustom_cost_per_token)__name__ __module__ __qualname__str__annotations__r~/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/management_endpoints/cost_tracking_settings.pyrr#s JDj'$..r"rkeysources.returncDfd|D}d|D}t|dS)Nc3@K|]}|jywN)get).0sourcer$s r# z$_configured_price..+s;VZZ_;sc3`K|]&}t|ttfst|(ywr)) isinstanceintfloat)r+values r#r-z$_configured_price..,s"Zu*USRWL:YeElZs..)next)r$r%valuesnumerics` r#_configured_pricer6*s$;7;FZZG  r"litellm_params model_infocn||f}td|}td|}||yt|xsd|xsdS)a0 Pull per-token pricing configured on a deployment so on-prem / self-hosted models (absent from the public cost map) still estimate a real cost. Pricing may live on ``litellm_params`` or ``model_info``; ``litellm_params`` wins, matching the router's cost-map registration precedence. input_cost_per_tokenoutput_cost_per_tokenN)r:r;)r6r)r7r8r% input_price output_prices r#_extract_custom_pricingr?0sS%j1G*+A7KK+,CWML|3 (/C*1c r"rcN tj|S#t$rYywxYw)Nr)litellmget_model_info ExceptionrAs r#_lookup_model_inforEFs*%%E22 s  $$cddlm}| |j|}|rt|dkDr|d}|j di}|j di}|j d}| t |nd}t ||}|j dxs|j d} | r-tjd || tt | ||S|j d } | r-tjd || tt | ||St|ddS#t$r!} tjd || Yd} ~ 2d} ~ wwxYw) ac Resolve a model name (which may be a router alias/model_group) to the underlying litellm model name, provider, and any deployment-configured pricing used for cost lookup. Args: model: The model name from the request (could be a router alias like 'e-model-router' or an actual model name like 'azure_ai/gpt-4') r) llm_routerN) model_namer7r8custom_llm_provider base_modelz2Resolved model '%s' to base_model '%s' from routerrz'Resolved model '%s' to '%s' from routerz,Could not resolve model '%s' from router: %s) litellm.proxy.proxy_serverrGget_model_listlenr*rr?r debugrrD) rrG deploymentsfirst_deploymentr7r8rIrrrJresolved_modeles r#_resolve_model_for_cost_lookuprSMs`6 a!+!:!:e!:!LKs;/!3*5a. (8(<(<=Mr(R$4$8$8r$J -;-?-?@U-V#>Q>]#&9":cg/F~Wa/b%%/NN<$@$dNDVDVWcDd (../cejlvw,S_hH]^^(6(:(:7(C!(../XZ_aop,S-@(Labb UD$ //  a & &'UW\^_ ` ` asC D"?D"" E +EE c,|sy||z||z||z||zfS)z Calculate costs for a given number of requests. Returns tuple of (total_cost, input_cost, output_cost, margin_cost) or all None if num_requests is None/0. )NNNNr! num_requestscost_per_request input_cost output_cost margin_costs r#_calculate_period_costsr[xs4 %<'\!l"l"  r"z/config/cost_discount_config Cost Tracking)tags dependenciesuser_api_key_dictcRKddlm}m}|'tddtj j i |jd{}|jdi}|jdi}d |iS7,#t$r$}tjd |d iicYd}~Sd}~wwxYww) zo Get current cost discount configuration. Returns the cost_discount_config from litellm_settings. r prisma_client proxy_configNerror status_codedetaillitellm_settingscost_discount_configr4z'Error fetching cost discount config: %s rKrbrcrr db_not_connected_errorr2 get_configr*rDr re)r_rbrcconfigrirjrRs r#get_cost_discount_configrosG.EEKKL  *5577#)**-?"D&6&:&:;QSU&V.// 8 ""#LaP"~F2B'A7A5 +A74B'5A77 B$BB$B'B$$B'rjc.Kddlm}m}m}|'t ddt j ji|durt dddig}|D]}|tvs |j||r"t d dd d j|d i|jD]J\}}t|ttfst d d |dd|cxkrdkr9nt d d |d |jd{}d|vri|d<||dd<|j!|d{|t"_t'j(d|dd|dS7V7-#t*$r-} t'j,d| t ddd| id} ~ wwxYww)a$ Update cost discount configuration. Updates the cost_discount_config in litellm_settings. Discounts should be between 0 and 1 (e.g., 0.05 = 5% discount). Example: ```json { "vertex_ai": 0.05, "gemini": 0.05, "openai": 0.01 } ``` rrbrcstore_model_in_dbNrdrerfTCSet `'STORE_MODEL_IN_DB='True'` in your env to enable this feature.Invalid provider(s): , z`. Must be valid LiteLLM providers. See https://docs.litellm.ai/docs/providers for the full list.z Discount for  must be a numberz% must be between 0 and 1 (0% to 100%)rirj new_configz Updated cost_discount_config: %sz0Cost discount configuration updated successfullysuccessmessagestatusr4z'Error updating cost discount config: %sz'Failed to update cost discount config: )rKrbrcrsrr rlr2rappendjoinitemsr/r0r1rm save_configrBrjr inforDre) rjr_rbrcrsinvalid_providersrdiscountrnrRs r#update_cost_discount_configrs0 .EEKKL  $bc  "(/ ? *  $ $X ./0;L1M0NOop  388:((S%L1C-zQb8cd dX""&xj0UV   *5577 V +)+F% &>R!"#9:&&&&999(<$!!"DFZ[J*  #8 :  ""#LaPFqcJK   s[AFA?FF.EE*E,E-*EFEE F%(F  FFz/config/cost_margin_configcRKddlm}m}|'tddtj j i |jd{}|jdi}|jdi}d |iS7,#t$r$}tjd |d iicYd}~Sd}~wwxYww) zk Get current cost margin configuration. Returns the cost_margin_config from litellm_settings. rraNrdrerfricost_margin_configr4z%Error fetching cost margin config: %srk)r_rbrcrnrirrRs r#get_cost_margin_configr sG.EEKKL  *5577#)**-?"D$4$8$89Mr$R,-- 8 ""#JAN"~rprcKddlm}m}m}|'t ddt j ji|durt dddig}|D]"}|d k7s |tvs|j|$|r"t d dd d j|d i|jD]\}}t|ttfrd|cxkrdkr)nt d d|dt|trd|vrJ|d}t|ttfst d d|dd|cxkrdksnt d d|dd|vrB|d} t| ttfst d d|d| dkrt d d|d|rt d d|dt d d|d |j!d{} d| vri| d<|| dd<|j#| d{|t$_t)j*d|dd|d S7V7-#t,$r-} t)j.d!| t ddd"| id} ~ wwxYww)#aR Update cost margin configuration. Updates the cost_margin_config in litellm_settings. Margins can be: - Percentage: {"openai": 0.10} = 10% margin - Fixed amount: {"openai": {"fixed_amount": 0.001}} = $0.001 per request - Combined: {"vertex_ai": {"percentage": 0.08, "fixed_amount": 0.0005}} - Global: {"global": 0.05} = 5% global margin on all providers Example: ```json { "global": 0.05, "openai": 0.10, "anthropic": {"fixed_amount": 0.001}, "vertex_ai": {"percentage": 0.08, "fixed_amount": 0.0005} } ``` rrrNrdrerfTrtglobalrurvrwzl. Must be valid LiteLLM providers or 'global'. See https://docs.litellm.ai/docs/providers for the full list. zMargin percentage for z' must be between 0 and 10 (0% to 1000%) percentagerx fixed_amountzFixed margin amount for z must be non-negativezMargin config for zA cannot be empty. Must include 'percentage' and/or 'fixed_amount'z Margin for zN must be a number (percentage) or dict with 'percentage' and/or 'fixed_amount'rirrzzUpdated cost_margin_config: %sz.Cost margin configuration updated successfullyr|r}z%Error updating cost margin config: %sz%Failed to update cost margin config: )rKrbrcrsrr rlr2rrrrr/r0r1dictrmrrBrr rrDre) rr_rbrcrsrr margin_valuerrrnrRs r#update_cost_margin_configr0s: .EEKKL  $bc  "&/ x HO$C  $ $X ./0;L1M0NO{|  #5":":"<+, lS%L 1++# #3H:=de d +|+),7 !*sEl;'$'!7zARSZ-2-'$'!7zAhi-+N; !,e ='$'!9(CTU !#'$'!9(CXY # #/z9z{  $XJ.|} Q+Z *5577 V +)+F% & *AAGG  $^   #..00 V +)+F% &RYRaRa!"#NO&&&&999>NAO**<=UXJCQ++M3?WZKKY++,A3G_bK*>:JJTJ` /E FfjLVLb0G!HhlCMCYZ^^,>?_cO  ) ) 5 &&'=>   ) ) 5 &&'>?  5D4OUf 11)    33)     mm )) ++ %99   '==   *   * !, !,  * , , " .  0! "0# $2% &4' (%) u  ? N^_m^nnrstruv   s+B*J-IF J J"I??JJ)6__doc__collections.abcr dataclassesrtypingrfastapirrrpydanticr rBlitellm._loggingr litellm.cost_calculatorr litellm.proxy._typesr r rr$litellm.proxy.auth.user_api_key_authrrrrrrr rrtupleobjectr1r6r?rErSr[r*ropatchrrrrrrrrpostrr!r"r#rsj $!5513 CHH  $d#//$/ 3wsF{/CS/H)IeVZl CK(6=c6k6JD,ci$&6(0#(02C(0V  "  +,-  )00A(B%  <"  +,-)00A(BZ sEz*Z %Z  Z z  +,-  )00A(B%  <  +,-)00A(BC S%$sEz*:"::;C %C  C L)7 +,..   h=Xh  h7 +,..  + '+  +  + \  +,-'  )00A(BX X%XX  Xr"