tPjM!BUddlZddlZddlZddlmZddlmZmZddlmZddlm Z m Z m Z m Z ddl mZddlZddlmZddlmZmZmZmZdd lmZdd lmZmZdd lmZdd lmZm Z m!Z!dd l"m#Z#m$Z$ddl%m&Z&m'Z'ddl(m)Z)ddl*m+Z+m,Z,ddl-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6ddl7m8Z8de9fdZ:de;dzde;dzdeZOd?ed@ede9dzfdAZPdBedefdCZQdDedEedFe;dzdGe+fdHZRdDedEedFe;dIe;dGe+f dJZS dxd9e3dzdeBdzde;fdKZTeUdLhZVe eGdM< dydNeBdOeWdzdPe9dzdeBfdQZXdRZYe eGdS<dTZZe eGdU<ej|dVdWjeYzdXzdWjeZzdYzZ\e eGdZ<d[e;d\e9d]e;de9fd^Z]d[e;d\e9de9fd_Z^d[e;de;fd`Z_d&eCe0dzdeCe0dzfdaZ`dbZae eGdc<ddZbe eGde<dfeJdeBe;e9eDzfdzfdgZcdhe0de0fdiZddje4dzde4dzfdkZedzdle dOeWdzdme9de fdnZf dxdeBdoeBd3eBdzde;fdpZgd%eCe5dzdeCe5dzfdqZh dxdre3dzd3eBdzde;fdsZide"" z "6556s *AAapi_key _master_keyc8||ytj||S)u Raw-only constant-time master-key comparison. The hashed form is never considered equivalent — only the raw master-key string matches. F)secretscompare_digest)r3r4s r1_is_master_keyr8@s$ go  ! !'; 77zhashed-jwt-[a-fA-F0-9]{64}valuec`|tk(xs$t|xstj|duSN)r r_HASHED_JWT_RE fullmatch)r:s r1_is_non_secret_key_valuer?Ms5 // 7  & 7  # #E *$ 6r9Falready_redactedrAct|tr|sytjdd|}|sy|r t |r|St |S)Nz (?i)^bearer ) isinstancestrresubr?r)r:rAstrippeds r1_redact_logged_api_keyrIUsD eS !ff_b%8H 4X> h r9metadataapplied_guardrails batch_modelsbatch_successful_requestsbatch_failed_requestsmcp_tool_call_metadatavector_store_request_metadataguardrail_information usage_objectmodel_map_informationcold_storage_object_keylitellm_overhead_time_mscost_breakdownlitellm_call_idautorouter_savingsc 8|utd)iddddddddddddddddd dd dd dd dd dddddddddddddddddddddddddd| ddddddddd dd!dd"dd#|d$dd%| Stjd&tt |j ztd)itj Dcic]}||j|c}}|jd}|jd'}t|txrt|xr||k(}t||(|d<||d <||d<||d<||d<||d<t||d<t||d<||d<| |d<| |d<| |d<| |d!<||d#<| |d%<|Scc}w)*N user_api_keyuser_api_key_aliasuser_api_key_team_iduser_api_key_project_iduser_api_key_project_aliasuser_api_key_org_iduser_api_key_user_iduser_api_key_team_aliasspend_logs_metadatarequester_ip_addressadditional_usage_valuesrKstatussuccesserror_informationproxy_server_requestrLrMrNrOrPrSrRrQinternal_call_origineval_informationrTrUattempted_retries max_retriesattempted_fallbacksoriginal_model_grouprVcompression_savingsrXlitellm_gateway_injected_cacherWz;getting payload for SpendLogs, available keys in metadata: user_api_key_hashr@) rr debugrElistkeys__annotations__getrDr?rI0_get_vector_store_request_for_spend_logs_payload._sanitize_guardrail_information_for_spend_logs)rJrKrLrMrNrOrPrQrRrSrTrUrVrWrXkeyclean_metadata_raw_key _trusted_hash_already_redacteds r1_get_spend_logs_metadatar`s" % % #% "&% %) % (, % !% % "&% %)% !%% "&% %)%  $% %% #% "&% !% "'+#% $#'%% &$('% (+/)% *#'+% ,-% .#'/% 0"&1% 2"3% 4%<5% 6&*7% 8#9% :;% <!%=% >"&?% @ A% B!%C% D 2E% F,0G% H,I% % LEDQYQ^Q^Q`LaHbb .vSdStSt0uChll36G1G0uvN$((8H#<<(;"+=N'(%1N>"2KN./.CN*+/EN+,6f%7N23/]]r.sN*+%1N>".CN*+0GN,-1IN-.'5N#$+=N'((7N$% 11vs F _batch_costBATCH_COST_REQUEST_ID_SUFFIX call_type response_objkwargsc(|jd}|jdt|tr|jdnd|jdf}td|Dd}|'|tj j k(r |tS|S)Nstandard_logging_objectidrWc3HK|]}t|ts|s|ywr<)rDrE).0 candidates r1 z$get_spend_logs_id..s^yZ 35OT]^s """)rwrDdictnextraretrieve_batchr:r)rrrstandard_logging_payload candidate_ids resolved_ids r1get_spend_logs_idrs%zz*CD.89QSW.X $$T*^b $%M ^M^`dK9 0I0I0O0O#O;<== r9response_obj_dictc~d}t|trd|vr|jd}|sLt|dr@|j}t|dr|j }nt|dr t |}|Et|tr.dddd}|jD] \}}|||< d|vrd|d<|SdddddSiS) a Extract usage information for OCR/AOCR calls. OCR responses use usage_info (with pages_processed) instead of token-based usage. Args: response_obj: The raw response object (can be dict, BaseModel, or other) response_obj_dict: Dictionary representation of the response object Returns: A dict with prompt_tokens=0, completion_tokens=0, total_tokens=0, and pages_processed from usage_info. N usage_info model_dump__dict__r) prompt_tokenscompletion_tokens total_tokenspages_processed)rrrr)rDrrwhasattrrrvarsitems)rrrresultrzr:s r1_extract_usage_for_ocr_callrsJ#T*|?P/P&**<8  ', =!,, :| ,#..0J Z ,j)J j$ '!"%& !F )..0 $ U#s  $!.,-()M"#%& !#$   r9.c|y|jd}t|trt|jd}|r|S|jd}t|tsyt |S)z`Model access groups that authorized this request, as stamped onto request metadata at auth time.rrrrequest_model_access_groupslitellm_params)rwrDrrr)rr from_payloadrs r1get_request_model_access_groupsrsl ~&,jj1J&K*G489Q9U9UVs9tu  "JJ'78N ng . :> JJr9rfield)model_id model_groupapi_basecustom_llm_providerc2|y|j|xsdS)NrCrw)rrs r1_sl_attribution_fallbackrs# ' # ' ' . 4"4r9cJ|i}|i}n-t|tst|ts dt|i}|j di}t |}|j d|}|j d}|j dd}t|tr|} n#t|tr|j } ni} i} |dvr t|| } n[t||| sN| j ddxsi} t| tjr t| } nt| tr| } |j d } | s*t| tjr| j } t|xsd | |} ttdz|j d d}t|}|j d d }d}d}d}|6|j dd}|j dd}|j dd}|j d}t|txrt|xr||k(}t!||xsd }|?|xs#t!|dj ddxsd }|xs|dj d}t|j dgt"rt%|j dgnd}||j dt%|d}|j dij dd xs t'|d}|j dd xs t'|d}|j dd xs t'|d}d}|#|j di}|j d }t)|||dj d!dnd|"|j dij d"dnd|"|j dij d#dnd|"|j dij d$dnd||dj d%dnd||dj d&dnd||dj d'dnd||d(nd||j d)dn||j d*dnd||dj d+dnd|||j d,dnd||j d-dndttdz|j d.xs|j d./}gd0}i}| j+D]=\}} ||vs t| tr| j } |j-|| i?|j d1}!t|!ts2|j d'}"t|"tr|"j d1}!t|!trqd2|vr+|!j d3}#t|#t.r |#dkDr|#|d2<d4|vr>|!j d5xs|!j d6}$t|$t.r |$dkDr|$|d4<||d7<tj0 tj0j2d]i|}%nd8}%|durddl}&| d9|&j5} d}'|j d%}(|(|(j d:d}'|j d;xs|j d;})|j d<xst'|d<xsd}*tt|j d=xsd }+||j d=ndxst7|+|*|xsi}, t9d]id>t| d|xsd d?t|dt|d@t;|dAt;|dBt;|d=|,dC|j dDd xsd dE|j dFd xsd dG|j dHxsd dt%|dI|%dJ|j dKdd| j d|d| j d|d| j d|d|dL|xsd d|d|d|dM|'d;|)dN|j dNdd<|*xsd dOt=||PdQt?||RdStA|||TdUtC||VdWtE||dXtG|Y}-tIjJdZ|-j d>|-j d=|-j dJ~ ~ ~~|-S#tL$r}.tOd[t|.|.\|.d}.~.wwxYw)^Nrrcompletion_start_timer cache_hitF)ocraocrusagecombined_usage_object acompletionrrZrCrrrrrqr@rJTuser_api_key_end_user_idtagsz[] request_tags model_inforrrr hidden_paramsrUrKrLrMrNrOrPrRrSrQ&standard_logging_guardrail_informationrTrVrXrW)rKrLrMrNrOrPrRrSrQrTrUrVrXrW)rrrprompt_tokens_detailscache_read_input_tokens cached_tokenscache_creation_input_tokenscache_write_tokenscache_creation_tokensrdz Cache OFF _cache_hitnamespaced_tool_nameagent_idrmodel request_idr3 startTimeendTimecompletionStartTimeuserr`team_idr\organization_idr_ cache_keyspend response_costend_usermcp_namespaced_tool_namercmessages)rrJresponse)payloadrrh)rJrr session_id)rrrequest_duration_msre)rJzBSpendTable: created payload - request_id: %s, model: %s, spend: %sz$Error creating spendlogs object - %s)excrr)(rDr rrErwrrrrlitellmUsagerr r#r'r?rIrtrrrrupdater-cache get_cache_keytimerr_ensure_datetime_utc$_get_messages_for_spend_logs_payload$_get_response_for_spend_logs_payload0_get_proxy_server_request_for_spend_logs_payload_get_session_id_for_spend_log_get_request_duration_ms_get_status_for_spend_logr rs Exceptionr)/rr start_timeend_timerrJrrrrr_usage_combined_usagerr end_user_idr3standard_logging_prompt_tokens"standard_logging_completion_tokensstandard_logging_total_tokensr}_key_already_redactedr _model_id _model_group _api_baserUrr{special_usage_fieldsrdkvrrRrrrrrrOrr raw_model model_nameres/ r1get_logging_payloadrs~  ~  i 0LRV9W #l"34 "JJ'7H#)::.Ex#Pzz+.Izz+u5I,%( L) ,(335EO#+L:KL +IxAR S)--gt<B fgmm ,LE  %E $ZZ(?@O Z?**, 95 7H& QB&*+AD+H&**UnptJu&v3NCKll>2.G*+"./&)*!+)A)E)EoWX)Y&-E-I-IJ]_`-a*(@(D(D^UV(W%LL!45M=#&o+CM+RoWdhoWo%W?TU[Y[G !,  %(4889LM`d  "i%=j%I%M%MNh%i ;EhllSY[]F^`d;e:hll6267koL ,1I1M1Mn1]1i!":>"JK ||L"599$CG_ *HI#,,}b9=U ->L&))*b9=U *>I $+7;;ORP #0#4#45O#P .(3 %Z 0 4 45I4 P(3 % ( (" = A A.RV W(3 % ( (" = A AB]_c d(3 % ( (" = A ABY[_ `(3 %Z 0 4 45Mt T(3 %Z 0 4 45TVZ [(3 %Z 0 4 4^T JBZAe $%< =ko(3 % ( ()@$ GRZRf(,,GNlp(3 %Z 0 4 45NPT U!9D\Dh $ ( ()94 @nrIaHl $ ( ()=t Drv $J JJ( ) R^-?-?@Q-R s=N~#Y  31 ( (!Y'LLN # * *Aq6 2 3 4778OP +T 2,00@ lD )$0$4$45L$M !'. $,C C#8#<#<_#MM---!2CER'(AB (0G G(=(A(ABV(W)[p[t[t'\ ,c27IA7MI['(EF0GN,-}} MM//9&9  Dt:diik] +#GUGYGYZrGs)#9#=#=>TVZ#[ #)**Z"8"THLLS T   CG!4!:;I1I1U $$W-[_P  +>B O:+;*, 2w*, o2*, L*, )n *, +:6 *, )2 *, !55J K*, *, 4b9?R*, LL!7<B*, %LL)>?E2*,  /*,  *, **_a0*, >3PQ*,  ))O5ST!*, "$ii(;=_`#*, $&%*, &!&B'*, ()*, *%+*, ,-*, .&>/*, 01*, 2"0!3!34JD!Q3*, 4!4 9r5*, 6:)AH7*, <:BZcij=*, >"R!."?*, D5)AE*, L!9X NM*, N-!O*, X "" P KK % KK KK   un6M >AANs0G c;; d"dd"cddlm}|+|jdt|jdS|jdt|jdSt|j S)zy Get the session id for the spend log. This ensures each spend log is associated with a unique session id. r)uuidtrace_idlitellm_trace_id) litellm._uuidrrwrEuuid4)rrrs r1rr*so#+0H0L0LZ0X0d+// ;<<zz$%16::0122 tzz| r9rrc` t||z jdzS#t$rYywxYw)zBCompute request duration in milliseconds from start and end times.iN)r- total_secondsr)rrs r1rrAs7Hz)88:TABB s ! -- timestampcD|jtj}|S)z#Helper to ensure datetime is in UTC) astimezonerutc)rs r1rrIs$$X\\2I r9 start_dateend_dater prisma_clientcjKd}|jj||||d{}|gS|S7 w)Na WITH SpendByModelApiKey AS ( SELECT date_trunc('day', sl."startTime") AS group_by_day, COALESCE(tt.team_alias, 'Unassigned Team') AS team_name, sl.model, sl.api_key, SUM(sl.spend) AS model_api_spend, SUM(sl.total_tokens) AS model_api_tokens FROM "LiteLLM_SpendLogs" sl LEFT JOIN "LiteLLM_TeamTable" tt ON sl.team_id = tt.team_id WHERE sl."startTime" >= ($1::timestamptz AT TIME ZONE 'UTC') AND sl."startTime" < (($2::timestamptz + INTERVAL '1 day') AT TIME ZONE 'UTC') AND ($3::text IS NULL OR sl.team_id = $3) GROUP BY date_trunc('day', sl."startTime"), tt.team_alias, sl.model, sl.api_key ) SELECT group_by_day, jsonb_agg(jsonb_build_object( 'team_name', team_name, 'total_spend', total_spend, 'metadata', metadata )) AS teams FROM ( SELECT group_by_day, team_name, SUM(model_api_spend) AS total_spend, jsonb_agg(jsonb_build_object( 'model', model, 'api_key', api_key, 'spend', model_api_spend, 'total_tokens', model_api_tokens )) AS metadata FROM SpendByModelApiKey GROUP BY group_by_day, team_name ) AS aggregated GROUP BY group_by_day ORDER BY group_by_day; db query_raw)rrrr sql_query db_responses r1get_spend_by_teamrOsH 5In -//99)ZQY[bccK  ds $31 3 customer_idclKd}|jj|||||d{}|gS|S7 w)Na_ WITH SpendByModelApiKey AS ( SELECT date_trunc('day', sl."startTime") AS group_by_day, COALESCE(tt.team_alias, 'Unassigned Team') AS team_name, sl.end_user AS customer, sl.model, sl.api_key, SUM(sl.spend) AS model_api_spend, SUM(sl.total_tokens) AS model_api_tokens FROM "LiteLLM_SpendLogs" sl LEFT JOIN "LiteLLM_TeamTable" tt ON sl.team_id = tt.team_id WHERE sl."startTime" >= ($1::timestamptz AT TIME ZONE 'UTC') AND sl."startTime" < (($2::timestamptz + INTERVAL '1 day') AT TIME ZONE 'UTC') AND sl.team_id = $3 AND sl.end_user = $4 GROUP BY date_trunc('day', sl."startTime"), tt.team_alias, sl.end_user, sl.model, sl.api_key ) SELECT group_by_day, jsonb_agg(jsonb_build_object( 'team_name', team_name, 'customer', customer, 'total_spend', total_spend, 'metadata', metadata )) AS teams_customers FROM ( SELECT group_by_day, team_name, customer, SUM(model_api_spend) AS total_spend, jsonb_agg(jsonb_build_object( 'model', model, 'api_key', api_key, 'spend', model_api_spend, 'total_tokens', model_api_tokens )) AS metadata FROM SpendByModelApiKey GROUP BY group_by_day, team_name, customer ) AS aggregated GROUP BY group_by_day ORDER BY group_by_day; r )rrrrrr r s r1get_spend_by_team_and_customerrsK;Iz -//99)ZQY[bdoppK  qs %42 4ctr8|6|jdd}|dk(r|jd}| t|Sy#t$rYywxYw)NrrC _arealtimer{})1_should_store_prompts_and_responses_in_spend_logsrwrr)rrJrrs r1rrsi9: # /7;;KLIL(":">">z"J'$)(33 %$#$s A AA secret_fields_SENSITIVE_REQUEST_BODY_KEYS request_bodyvisitedmax_string_length_prompt_in_dbc.ddlmm t t t |}|vriSj |dtdtffd |jDcic]\}}|tvs||c}}Scc}}w)am Recursively sanitize request body to prevent logging large base64 strings or other large values. Truncates strings longer than MAX_STRING_LENGTH_PROMPT_IN_DB characters and handles nested dictionaries. Also strips keys listed in _SENSITIVE_REQUEST_BODY_KEYS (e.g. secret_fields which contains raw HTTP headers including Authorization tokens). r)r rr:r(c t|tr t| St|tr|Dcgc] } | c}St|trvt | kDrfd}d}t |z}t |z}||z}| kDr |z }t | kr|St ||z }|d|d d|d d|| d }|S|S|Scc}w)Ngffffff?g?z... (z skipped z chars. z) ...)rDr-_sanitize_request_body_for_spend_logs_payloadrtrElenr-)r:item start_ratio end_ratio start_chars end_chars total_keep skipped_charstruncated_valuer r_sanitize_valuerrs r1r'zF_sanitize_request_body_for_spend_logs_payload.._sanitize_values eT "@Qop p t $6; JK %0)$;  >> > LIu:!?? L(+5zJ'> \k*+;Ps` 4yA  A a% G 9 FA  :q5L Q a% r9ct|}||k\ry||}|dvr t|||S|dk(rd}n |dk(rd}nyd}|}||krI||}|dvrt|||}|dk(ry|}$||k(r|dz }n||k(r|dz}|dk(r|dzS|dz }||krIy) u  Given ``text[start]`` is ``[``, ``{``, ``'`` or ``"``, return the index just past the matching close, accounting for nested brackets and quoted strings (with escape sequences). Returns ``-1`` if the structure is unterminated. Implemented iteratively (no self-recursion): the bracket scanner inlines a quote-skip helper rather than re-entering itself, since JSON-style values cannot contain another bracket *as a first char* inside a quoted string — only the quote-skip case can occur. r:)'"[]{}rr7)rr>) r3r4r;firstclosedepthr<r=ends r1_scan_balanced_value_endrJcs4yA z;E &tUE:: | # E A a% G ?)$15CbyA  : QJE %Z QJEz1u  Q a% r9c|s|Sdtd}g}t|}d}||krtj||}|s|j ||dn|j |||j |j }||k\rnJ||}|dvr9t ||}|dk(r|j ||}n|j ||}n|}||krdj|S)u Strip echoed request input from provider error strings. Provider validation errors (e.g. OpenAI ``RateLimitError`` carrying 178 pydantic validation errors, each with its own ``'input': [...]`` field) embed the full request body in their message. When prompts must not be stored in spend logs, that echo is a back-door leak. Two leak shapes are handled: - Quoted-key form — ``"": `` where ``key`` is ``input``, ``messages`` or ``prompt`` (covers JSON bodies, Python dict-reprs, and ``/v1/completions`` payloads). - Assignment form — ``input_value=`` from Pydantic v2 validation errors, which render the offending value as a Python repr inside ``[type=..., input_value=..., input_type=...]``. The value scan understands nested ``[]`` / ``{}`` and quoted strings, so multi-modal payloads (``'messages': [{'content': [{...}]}]``) and user text containing brackets (``"secret[123"``) are handled correctly. rArN)rBrDr@rAr:rC)rrr2searchappendrIrJjoin) r3 redactionoutr;posmv_startrFv_ends r1$_redact_prompt_leaks_in_error_stringrUs,  45Q7IC4yA C ' ( / /c : JJtCDz "  4aeeg&'%%' a< W  ( (,T7;E{ 9% JJy !CC/ '0 773<r9c| tr|St|tr|gn|}|Dcgc]}t|tst| c}Scc}w)a  When ``store_prompts_in_spend_logs`` is False, redact prompt-carrying fields (``guardrail_request``, ``guardrail_response``, ``match_details``, ``classification``) before they land in ``LiteLLM_SpendLogs.metadata``. Guardrail hooks may echo the LLM request payload back into ``guardrail_response``, and two first-party hooks (``block_code_execution``, ``litellm_content_filter``) inline user-prompt substrings into ``match_details`` / ``classification`` too, so the flag must cover all four fields. Every other typed field on the entry (name, provider, mode, status, timings, action, violation_categories, risk_score, masked_entity_count, ...) is preserved so guardrail dashboards keep working. ``guardrail_information`` is typed ``Optional[List[...]]`` but at least one writer (``xecguard``) assigns a bare dict, so normalize to a list here to match OTEL's defensive read pattern; otherwise iteration would yield the dict's keys and crash the whole spend-log write. )rrDr(_redact_prompt_fields_in_guardrail_entry)rQentriesentrys r1ryrysS,$(Y([$$0:;PRV0W+,]rGIP lT^_dfjTk 4U ; ll ls A A)guardrail_requestguardrail_response match_detailsclassification!_PROMPT_CARRYING_GUARDRAIL_FIELDS) tokens_before tokens_after tokens_savedcompression_ratio_NUMERIC_COMPRESSION_STAT_KEYSr[c t|tsy|jDcic]6\}}|tvr)t|tt frt|t s||8}}}|xsdScc}}wr<)rDrrrcr-floatbool)r[rzr:statss r12_numeric_compression_stats_from_guardrail_responserhsu ($ /-224 C 0 0ZU|5T]ghmos]t U E =D s;A)rYct|jd}i|tDcic]}||vs|tc}}||Si|d|iScc}w)aE Replace prompt-carrying fields with the redaction marker. Purely numeric compression stats inside ``guardrail_response`` (e.g. Headroom's ``tokens_saved``) cannot carry prompt content, so they are preserved as a stats-only dict; spend aggregation reads them via ``extract_compression_saved_tokens``. r[)rhrwr^r)rYpreserved_statsrzredacteds r1rWrWssPPUPYPYZnPopO< <5V gcZ]afZf3) ) g<H >h >,o >> hs A  A rgc|ytti|}ts7dD]2}|j|}t |t s%t |||<4t|}tt|S)uA Sanitize ``error_information`` before it lands in ``LiteLLM_SpendLogs.metadata``. Provider errors are stored verbatim via ``str(original_exception)``; those strings can echo the full request body, producing multi-megabyte spend-log rows. - Always: cap ``error_message`` and ``traceback`` with the existing ``MAX_STRING_LENGTH_PROMPT_IN_DB`` DB-storage safeguard. - When ``store_prompts_in_spend_logs`` is False: additionally redact ``'input'`` / ``'messages'`` / ``'prompt'`` values *and* Pydantic v2 ``input_value=...`` assignments inside both ``error_message`` and ``traceback`` so prompts cannot leak through either field. Scoped to the spend-log path — OTEL/Datadog/etc. callbacks still receive the untruncated error per ``LITELLM_TRUNCATION_DB_SAFEGUARD_NOTE``. N) error_message traceback) r rrrwrDrErUrr$)rg sanitizedrr:s r1*_sanitize_error_information_for_spend_logsrpsx( T0/01I < >3 OEMM%(E%%#G#N %  O >iHI 6 BBr9obj max_depthc f|dkry| t}t|}||vryt|ttfs t |dr|j | t|tr6|j}t|||dz ||vr|j|SSt|trH|jDcic]\}}|t|||dz c}}||vr|j|SSt|tr4|Dcgc]}t|||dz c}||vr|j|SSt |dr0t|j||dz ||vr|j|SS|||vr|j|SScc}}wcc}w#||vr|j|wwxYw)a Convert object to JSON-serializable dict, handling Pydantic models safely. This avoids pickle-based deepcopy which fails on Pydantic v2 models containing _thread.RLock objects. Args: obj: Object to convert (dict, list, Pydantic model, or primitive) visited: Set of object IDs to track circular references max_depth: Maximum recursion depth to prevent infinite recursion Returns: JSON-serializable version of the object rzzrr7) r)rrDrrtrr*r r"_convert_to_json_serializable_dictremoverr)rqrrrr+rrrrs r1rtrt5sA~%%sGF %#d|$Z(@ F# c9 %NN,F5fgyST}U W  NN6 " T "adajajalmY]YZ\]A9!WiRSmTTm W  NN6 " T "adeY]6tWiRSmTe W  NN6 " S* %5cllGYYZ][ W  NN6 "  W  NN6 " ne W  NN6 " sB/F#FF F5F F F9%F5F FF0rctrttdz|jdi}||jdixsi}|#|jd}|rt|}||d<|:ddlm}m}||jdd }|| rt|}||d t|}t|} t| vrtjd t| Sy )z Only store if _should_store_prompts_and_responses_in_spend_logs() is True If turn_off_message_logging is enabled, redact messages in the request body. Nrhbodyrealtime_toolstoolsrperform_redactionshould_redact_message_logging standard_callback_dynamic_paramsrr}model_call_detailsrrz>Spend Log: request body was truncated before storing in DB. %sr)rr rrw*litellm.litellm_core_utils.redact_messagesr{r|rtrrr r infor) rJrr_proxy_server_request _request_bodyrxr{r|r_request_body_json_strs r1rrks9:'+D4K9K9KLbdf9g'h ,155fbAGRM!(. 3C(D!$($7M-;M'*!'58> Ce8f-" 1DVW$F}$UM%tTI-XM,6},E ".2HH$))T8* ) r9ctr|S|y|D]e}|jdxs t}|jdgxsg}|D]+}|jdgxsgD]}d|vst|d<-g|S)z~ If user does not want to store prompts and responses, then remove the content from the vector store request metadata Nvector_store_search_responsedatacontentr3)rrwr&r)rPvector_store_requestr response_data response_item content_items r1rxrxs 9:,,%, =E $ $%C D cHaHc %588DJ * EM - 1 1)R @ FB E \)+DL( E E E )(r9rc(|ytr|jd}|y|3|jd}|r t|trt|}||d<|Lddlm}m}|jdi}||jdd }|| rt|}|i| }td|i}|jd|} | yt| tr t| } n t| } t| vrtjd t| Sy) Nrrrealtime_tool_calls tool_callsrrzrr}r~rrz:Spend Log: response was truncated before storing in DB. %s)rrwrDrrr{r|rtrrErrr r rr) rrrrr{r|rrsanitized_wrappersanitized_response result_strs r1rrs.8:#KK 3    )/4I)J "z,'E#L1 -@ \*    %+JJ/?$DN"04:JJ?a4b)  -@RSA,O 0B|\ #PR\^jQk#l$5$9$9*l$S  % (# .)*<=J#$67J *j 8 % %L4  r9cddlm}ddlm}|j d}|duryt |t r|jdk(ry|dduS)Nr)general_settings)get_secret_boolstore_prompts_in_spend_logsTtrueSTORE_PROMPTS_IN_SPEND_LOGS)litellm.proxy.proxy_serverrlitellm.secret_managers.mainrrwrDrElower)rrstore_prompts_values r1rrs[;<"2!5!56S!Td" ' -  $ $ && 0 8 9T AAr9)rffailurec4|jdd}|dk(ryy)zk Get the status for the spend log. It's only a failure if metadata.get("status") is "failure" reNrrfr)rJ_statuss r1rrs""*h!=G) r9)NNNNNNNNNNNNNNr<)NN)N)lr*rFr6collections.abcrrrdttypingrrrr pydanticr rlitellm._loggingr r(r r rrrr,'litellm.litellm_core_utils.core_helpersrr1litellm.litellm_core_utils.internal_call_metadatar*litellm.litellm_core_utils.litellm_loggingrrr*litellm.litellm_core_utils.safe_json_dumpsrrlitellm.proxy._typesrr3litellm.proxy.spend_tracking.spend_log_error_loggerrlitellm.proxy.utilsrrlitellm.types.utilsrrr r!r"r#r$r%r& litellm.utilsr'r-r2rErfr8compiler=r?rIrrtrerrrvrrobjecttuplerrrrrrrrr frozensetrr)rr.r0rNr2r>rJrUryr^rcrhrWrprtrrxrrrrrr9r1rsp #'#,,1 ] TDO8   < 6S 68C$J8S4Z8D89:CDKP #* 4 TWZ^T^ ,0%),0(,@DTXNR $DH*.-1+/"&'+UTkUS D(Us)d"U #Tz U : U 7= U$((I#JT#QU CDtKU+U;TAU!4ZU$dlU"D(U4ZU U !Up'4e3  D $ 3QU: 4c4d4t4nKGCK,@4,GKERUWZRZOK"54t;5 O P5 5LGWL^ 4t; .X#PT*H AAA4ZA AHHHHH H  HZ!4t;Tk "'00A&BeB 15CmCm 4ZCm%($JCm CmT*IH*:9'1bjj((:;<?  xx789<  'e#c##&)3)s)s)X4s4s4nm CDtKm -.5m8,!5)   #sU{ d" ? .?(?( C=D C+d2 CF3#C3##*3#X[3#eh3#r/// 4K/ /d)#'(I#JT#Q) +,t3)43 #d *3 4K3 3lB4B&   !" r9