tPj:w!UddlZddlZddlmZddlmZddlmZmZmZm Z ddl Z ddl m Z ddl mZddlmZddlmZmZdd lmZdd lmZdd lmZdd lmZmZmZdd lmZddl m!Z!m"Z"ddl#m$Z$ddl%m&Z&m'Z'ddl(m)Z)m*Z*ddl+m,Z,ddl-m.Z.m/Z/m0Z0ddl1m2Z2erddl+m3Z3e4e.jjjle.jnjle.jpjle.jrjlhZ:ee4e;ede?de?ddfdZ@deAdeBfdZCdeAdeBfd ZD d7d!e;dzd"e;dzd#e;dzd$e;dzd%e;dzdeBf d&ZEde?de?dzfd'ZFd(e/dzde?deGe;dzfd)ZH d8d*d+d,ed!e;dzd"e;dzd$e;dzd#e;dzd-e;dzde?de jezdzd.ed/ed0eJd1e?dzd2eGe;dzd3ee;dzddf d4ZKd1e?dzddfd5ZLd1e?dzddfd6ZMy)9N)Sequence)datetime) TYPE_CHECKINGAnyFinalcast)verbose_proxy_logger)+BACKGROUND_INTERACTION_COST_POLLING_ENABLED) CustomLogger)!_get_parent_otel_span_from_kwargs get_litellm_metadata_from_kwargs)StandardLoggingPayloadSetup)guardrail_information_cost)UserAPIKeyAuth)get_key_objectget_team_objectlog_db_metrics) RouteChecks)debitable_model_access_groupsget_llm_router)LiteLLMProxyRequestSetup)$should_suppress_spend_log_tracebacksspend_log_error)*_sanitize_error_information_for_spend_logsget_request_model_access_groups)ProxyUpdateSpend) CallTypesStandardLoggingPayload&StandardLoggingPayloadErrorInformation)!get_end_user_id_for_cost_tracking) ProxyLogging"_UNATTRIBUTED_TRACKABLE_CALL_TYPES_CAPTURED_IDENTITY_CALL_TYPESc eZdZdZ ddededededzfdZe dde je zdzfd Z edd ed ed efd ZedZy)_ProxyDBLoggercHK|j||||d{y7wN)_PROXY_track_cost_callback)selfkwargs response_obj start_timeend_times r/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/hooks/proxy_track_cost_callback.pyasync_log_success_eventz&_ProxyDBLogger.async_log_success_eventHs!--flJPXYYYs " "N request_dataoriginal_exceptionuser_api_key_dict traceback_strc K t|jd{|j }tjdus.|-tj|stj|sydd l m }ttj | }|j"|d <d |d <t%j&||}t)r|j+ddt-t.t1|}||d<tj3|d{}|j5ddxsi} | j7||j5d} t9| trd| vr| j5d} | | | d<d|vri|d<|j5di} | j5dixsi} | j5dr| j5d| d<|j5dxs| j5dxsi|dd<| |dd<d|vr(| j5dxs|j5dd|d<d|vr(| j5dxs|j5dd|d<|j5d}|Q|j5dst;|dij5d|d<|j5dt;|dd|d<t=j>}|t;|dd}||}t9|j5d t@jBr(tEtG|j5d!xsd"d"nd"}|tI| j5dz}|jJjM|j"||jN|jP|jR|||t=j>|jT# d{y7#t$rytjd t |jd{7|jd|jd<n$#t$rtjdYnwxYwY2wxYw7B7w)$Nbudget_reservationz>  5 5 75 @(,,=A[E^E^erEs @ $ L L_p q %6$=$= .!' (8NN1'  0 1  " "; 5" 2 67I J *< %&(OOP  *6)9)9*d)K)Qr  +)5)9)9:L)M . 58@QQ$;$?$?@h$iN)N\!"JK < /-/L) *)5)9)9:JB)O+B+F+FzSU+V+\Z\! % ( ( 0(A(E(Ef(M f %   3 4 q8O8S8STj8k qoq %&'=>6G %&z2 , &$;$?$?$H$iLL\L\]dfhLiL ! 42I2M2M%33=!!"7< . /'3&6&67L&M  +##$=>:ABVXlnp:q:u:u-; 67 23;3:;OQcei3j /0%LLN  +&';\4PI$$-!,**+BCW]]S l&&7>3? E  *?A[  ! !"J KB *  66FF#++1%--)55%-- 2(\\^$++G  y g  * *+i j =QbQuQuvvv$77CHL%88E $..c  ` V sQOOOC4QQJ3Q Q QOQ2P- P P-,Q-Q Q QQQQQQrUc Kddlm}m}m}t j d t j d|j dd|j ddt|}|j dixsi} t| } t|} | j d r[| j d sJtj| t|j d tv d{} t|| t| } t!tdz| j d d} t!tdz| j dd}t!tdz| j dd}t!tdz| j dd}| j dd}|j dd}||j ddn|j dd}t#|| }t%t'|||j dndt)}|| j d d}|j dddurd}t j d|| t j d|| || |j d }t+|| || |rmt-|||| | |||||||| ||d{t/j0||| | |||| |j2j5||| ||!d{y| /t7| "d{yt9|rQt:r!t=|rt j d#yt7| "d{t j d$yt7| "d{|K|j d%r|j d d&vr't j>d'|j d d(y|j ddus|j ddur6d|vr1| |d)xsd*}nd+}|j d%}tAd,|d-|d.yyy7N77?7*77#t@$r}d/|d0tCjD}|j d%d1}t|} |j dij d2i}|j dij d3i}|j d d1}|d4|d5| d6|d7|d8|d9 z }t/j0|jG||:tId;t||<Yd}~yd}~wwxYww)=Nr)increment_spend_countersr9 update_cachez!INSIDE _PROXY_track_cost_callbackz3kwargs stream: %s + complete streaming response: %sstreamcomplete_streaming_response)r*rCr:user_api_key_user_id call_type)r@resolve_missing_key_identity)r*r@r?user_api_key_team_iduser_api_key_org_iduser_api_key_aliasuser_api_end_user_max_budgetrJrN) sl_objectr@model_id) attributedserved_model_idrouter cache_hitFTrOz+Cache Hit: response_cost %s, for user_id %sz7user_api_key %s, user_id %s, team_id %s, end_user_id %sr:rRrTrSr)r9rr:rRrSrTrVr*rUr,r-rNr6 request_tagsmodel_access_groups)rQrRrSrNrTparent_otel_spanrD)rQ key_aliasrSrN max_budgetr5zCost tracking deferred for in-progress background interaction; the budget reservation stays open until the poll task logs the final usagezeReleased the budget reservation for an interaction create with no usage that no poll task will settlerF)_aresponses_websocket _arealtimezECost tracking - skipping, no standard_logging_object for call_type=%sunknown response_cost_failure_debug_infozCresponse_cost_failure_debug_info is None in standard_logging_objectz!standard_logging_object not foundzCost tracking failed for model=z. Debug info - zG Add custom pricing - https://docs.litellm.ai/docs/proxy/custom_pricingz"Error in tracking cost callback - z Traceback:rGrAr@z- Args to _PROXY_track_cost_callback model: z chosen_metadata: z litellm_metadata: z old_metadata: z call_type:  ) error_message failing_modelz$Error in tracking cost callback - %s)exc)%r_rr9rr debugrfr r r r%restrr#_write_spend_metadata_to_kwargs%_get_budget_reservation_from_metadatar#_get_request_tags_for_cost_trackingrrr_should_track_cost_callback#_update_database_and_spend_countersasyncio create_taskslack_alerting_instancecustomer_spend_alertrW!_is_unbilled_interaction_responser $_is_unbilled_in_progress_interactionwarningrXr= format_excfailed_tracking_alertr)r)r*rUr,r-rr9rrrCrSr@r6rRrTrVrend_user_max_budgetrrNrDrr:r cost_tracking_failure_debug_inforFe error_msgrA old_metadatas r.r(z)_ProxyDBLogger._PROXY_track_cost_callbacks  ""#FG_ S & &E 8T* 8$?  'Hv&V $*JJ/?$D$JN!B>!RK7vFH||N+HLLAW4X!/!V!V%14VZZ 5L1MUr1r"W"0vQ(MW_(` !#*hll;QSW.XYG!#*hll;QSW.XYG tX\\:OQU-VWF#C$J =QSW0XYI)16TVZ)[ >DjjIbdh>iI8A8M ot4SYS]S]^mosSt >#!D*G:6B=F=R j 9X\%'*  (&.ll>4&H ::k51T9$'M(../\^kmtu$**M  )/ ;(? .!-## +' >*;1I%1 '$/ '%%,?#-!)&3+=%),?(''$".$+(3*7$+-=!% ,CCXX*"+$/&3#6 Y(35I[\\\45HIBGk+H-22i5I[\\\(..81EWXXX $ 7+vzz+/FJq/q(00_ ; :::h't3JJx(D05RV\5\ ,%&HIed9 <_8"JJw/E#9%@PQqPrs{|6]0A4m^@]] Y6 S9A Q QQ UQ QQ U 1Q UQ !Q"Q ;U<Q Q  AQ UAQ 8U;Q >Q Q Q Q Q T>C T94U9T>>Ur@rreturncK|jd}|s|Sddlm}m}m}|r|jd t ||||d{}|jd|j |d<|jd|j|d<|jd|j|d<|jd |j|d <|jd}|rF|jd 5 t|||| d{}|j|j|d <|S|S7#t$rtjd |Y~wxYw7J#t$rtjd |Y|SwxYww)a Enriches failure spend log metadata by looking up the key object (and team object) from cache/DB when key fields are missing. This handles two scenarios: 1. Auth errors (401): UserAPIKeyAuth is created with only api_key set, all other fields are null. We look up the full key object to fill in alias, user_id, team_id, etc. 2. Post-auth failures (provider errors, rate limits): key fields are populated but team_alias is missing because LiteLLM_VerificationTokenView SQL view doesn't include it. We look up the team object to fill in team_alias. Scenario 1 reads the key's identity as it stands right now, so it is only correct for a log emitted within the request it describes. Callers that log after a delay, against an identity captured earlier, pass resolve_missing_key_identity=False and keep their own user_id, team_id and org_id. r:r) prisma_clientr9user_api_key_cacherN) hashed_tokenrrr9rrrz>Failed to enrich failure metadata with key info for api_key=%suser_api_key_team_alias)rTrrr9z@Failed to enrich failure metadata with team_alias for team_id=%s)rfr_rr9rrrrRrTrVrXr rr team_alias) r@r api_key_hashrr9rkey_objrTteam_objs r.rez5_ProxyDBLogger._enrich_failure_metadata_with_key_infos&'ll>: O   (HLL9M,N,V '5!-"/'9&7 (" << 45=5<5F5FH12<< 67?7>H34<< 67?7>H34<< 56>6=nnH23"&<= x||$=>F (7#"/'9&7 )# &&2:B:M:MH67 xK" $**T  # $**V  sq3E7D*D( BD* $E72EEE$E7(D**E  E7 E  E7EE40E73E44E7c8ddlm}|jdduryy)z Returns True if errors should be tracked in the database By default, errors are tracked in the database If users want to disable error tracking, they can set the disable_error_logs flag in the general_settings rgeneral_settingsdisable_error_logsTFN)r_rrfrs r.r\z)_ProxyDBLogger._should_track_errors_in_dbs" @    4 5 =r'NN)T)__name__ __module__ __qualname__r/r`rXrrr}rrk ModelResponserr( staticmethodboolrer\rr.r%r%GsZ%) O O &O * O Tz O b  mS%22S84?mSmS^DtDcgDswDDL  rr%r*r@rcd|jDcic]"\}}|jds|dk(s| ||$}}}|sy|jdi}dD]S}|j|}t |t s%|jD]\}} |j|| ||<Uycc}}w)Nr:rDrC)rAr@)items startswith setdefaultrfrhr`) r*r@kvpatchrC bucket_namebucketkeyvalues r.rrs&nn. rda1<<3OSTX^S^dedqQT rE r "--.>CN7( ##K0 fd ##kkm ( U::c?*"'F3K (( ssB,B,B,rUcdddlm}ddlm}t ||sy|j duxr||S)Nr)missing_usage_is_expectedInteractionsAPIResponseF),litellm.interactions.background_cost_pollingrlitellm.types.interactionsrrhusage)rUrrs r.rrs4VB )+B C  $ $ , _1JK^1__rcdddlm}ddlm}t ||sy|j duxr||S)Nr)"is_pollable_background_interactionrF)rrrrrhr)rUrrs r.rrs4_B )+B C  $ $ , h1STg1hhrr:rRrTrSrcRtjdury||||y|tvS)a Determine if the cost callback should be tracked based on the kwargs Pass-through endpoints can be configured with ``auth=false``, which leaves the request with no key/user/team/end-user to attribute spend to. Those requests still forward real provider traffic that operators expect to see in request/usage logs, so they are tracked even when unauthenticated. The same reasoning applies to a completed managed batch's cost event (see _UNATTRIBUTED_TRACKABLE_CALL_TYPES). TF)rdisable_spend_updatesr"rs r.rrs=&--/477#6':MQ\Qh : ::rc|jd}t|tr|S|jd}|yt|tr%|jd}t|tr|SdSt|ddS)Nuser_api_key_budget_reservationuser_api_key_authr6)rfrhr`ri)r@metadata_budget_reservationuser_api_key_auth_objr6s r.rrs)16W)X-t4**#+<<0C#D$'.$9$=$=>R$S%/0BD%I!StS (*> EErrc|$|jdd}t|tr|S|jdd}t|tr|Sy)NrrD)rfrhlist)rr@r metadata_tagss r.rr,sM'mmNDA lD ) #<<5M-& rr9r!rrVr,r-rNr6rrc jK |jj|| |||||| | | d{} ||||| || || || | d{y7!#t$rz| v t| d{7#t$rSt j d t | d{7Y#t$rt j dYYwxYwwxYwwxYw7#t$rO| K t | d{7n$#t$rt j dYnwxYwd| d<#d| d<wxYwwxYww) NrPr5zAFailed to release budget reservation after database update failedzEFailed to invalidate budget reservation counters after release failed) rQrTrRrNrVr6rSrD request_idrequest_started_atrzRFailed to invalidate budget reservation counters after spend counter update failedTr7)rorprXrWr rYrZ)r9rr:rRrSrTrVr*rUr,r-rNr6rrspend_log_request_ids r.rr<s"%6%M%M%]%]'# 3!&^ & 4&'1#+) 3  7     ) 1EWXXX  $../rsAUghhh  !(22_           ) 7=Qcddd $..h  37";/ 37";/  sD3(AAACC C D3A CA2+A.,A21C2CB( B#!B(&C(C CC C  CCD3C D0$C:3C64C:9D$:DD$DD$D0$D++D00D3cDK|yddlm}||d{y7w)Nr)release_budget_reservationr5)/litellm.proxy.spend_tracking.budget_reservationr)r6rs r.rWrWs+! %-    cDK|yddlm}||d{y7w)Nr)&invalidate_budget_reservation_countersr5)rr)r6rs r.rZrZs-! 1- rr'r)Nrr=collections.abcrrtypingrrrrrklitellm._loggingr litellm.constantsr "litellm.integrations.custom_loggerr 'litellm.litellm_core_utils.core_helpersr r *litellm.litellm_core_utils.litellm_loggingr7litellm.litellm_core_utils.llm_cost_calc.guardrail_costrlitellm.proxy._typesrlitellm.proxy.auth.auth_checksrrrlitellm.proxy.auth.route_checksr'litellm.proxy.db.db_spend_update_writerrr$litellm.proxy.litellm_pre_call_utilsr3litellm.proxy.spend_tracking.spend_log_error_loggerrr1litellm.proxy.spend_tracking.spend_tracking_utilsrrlitellm.proxy.utilsrlitellm.types.utilsrrr litellm.utilsr r! frozenset pass_throughrllm_passthrough_routeallm_passthrough_routearetrieve_batchr"r__annotations__r#r%r`robjectrrrrrrrrrnrrWrZrrr.r s'$221I;S^/ 8J1 <0