tPjdZddlmZddlZddlZddlmZddlmZddl m Z m Z ddl m Z ddl mZmZmZdd lmZerdd lmZed d Gd dZddZ d ddZ d ddZy)a Tool usage tracking for the dashboard. At request time the spend writer builds one ToolUsageTransaction per request that invoked tools (MCP namespaced tool name plus response tool_calls; declared-but-not- invoked tools are excluded) and queues it on the prisma client. The spend-log flush job drains the queue into LiteLLM_SpendLogToolIndex (per-request drill-down) and LiteLLM_DailyToolSpend (the per-day rollup the Cost Optimization card reads) in a single transaction, so a failed flush never leaves a partial rollup increment. ) annotationsN)Sequence) dataclass)datetimetimezone)groupby) TYPE_CHECKINGAnyFinal)DB_RETRY_SAFE_ERROR_TYPES) PrismaClientT)frozenslotscJeZdZUded<ded<ded<ded<ded <d ed <y ) ToolUsageTransactionstr request_iddater start_timetuple[str, ...] tool_namesfloatspendint total_tokensN)__name__ __module__ __qualname____annotations__j/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/db/spend_log_tool_index.pyrrs#O I Lr!rcr|t|tryddlm}t fd||dDS)a<Tool names invoked in a completion response, in call order, for any response surface get_tool_calls_from_response understands (chat completions, Responses API output items, Anthropic Messages tool_use blocks). Reads every choice of an ``n>1`` chat response: each choice cost money and its tool calls ran.r r)get_tool_calls_from_responsec3K|]9}t|jdxtrjxr;yw)nameN) isinstancegetrstrip).0 tool_callr&strippeds r" z+response_tool_call_names..1sA  immF33dS 94::3I3I#x3XY    ! !# &q )!+!2!2: 8J8JRZR^R^8J8_!   s-%C!! C-,C-c tK|sy|Dcgc]-}|jD]}|j||jd/}}}td|Dd}t |dzD]} |j j 4d{}|jj|dt|d D]~\\} }} t| } td | D} td | D} |jjd | |d i| || | t| dd| id| idt| idddddd{yycc}}w77#1d{7swYyxYw#t$rB||k\rt!j"d|zt%j&ddzd{7YQwxYww)aEWrite index rows and rollup upserts for a drained queue batch in one transaction. Retries only ConnectError, the one failure that proves the statements never reached the database. Post-send failures (Read timeouts and errors) are ambiguous and are NOT retried: the engine can abandon the transaction open on the pooled connection, so a retry's statements stack into the same transaction and one commit applies both increment sets. Ambiguous failures drop the batch; the caller logs it at error. Callers must not add their own retry around this function.N)r tool_namerc3K|]9}|jD](}|j||j|jf*;ywN)rrrr)r*txnrIs r"r-z0flush_tool_usage_transactions..vs<tehesestXa#((Isyy#*:*: ;t ;ts?Ac|d|dfSNrr entrys r"z/flush_tool_usage_transactions..ws58U1X.r!)keyrOT)dataskip_duplicatesc|d|dfSrNr rPs r"rRz/flush_tool_usage_transactions..~s_def_ginopiq^rr!c3&K|] }|d yw)Nr r*rQs r"r-z0flush_tool_usage_transactions..s>Ua>c3&K|] }|d yw)Nr rYs r"r-z0flush_tool_usage_transactions..s&EEuQx&ErZdate_tool_name)rrI)rrIrr request_count increment)rrr^)createupdate)whererTrXr)rrrsortedrangedbbatch_litellm_spendlogtoolindex create_manyrr1sumlitellm_dailytoolspendupsertlenr asynciosleeprandomuniform) prisma_client transactions n_retry_timesrLrI index_rows per_tool_dayattemptbatcherdate_keygroupedentriesrrs r"flush_tool_usage_transactionsr{`s    ~~IS^^\\J !t|t .L *+C C$''..0  G11==:_c=d6=lPr6s2)Xy7#GnG>g>>E#&&EW&E#EL2299/(QZ1[\)1-6).0<14W '+6u)=1rs # $!',,:0 $d#$2 $%%%)%  %  %  %%!%V7C7C07C7C 7Cr!