uPjk-tddlmZddlZddlmZmZmZddlmZm Z m Z ddl m Z ddl mZmZddZddZd d Zd!d Zd"d Zd#d Zd$d Zd$dZd%dZ d&dZ d&dZ d'dZd(dZdd d)dZ d*dZe dZd+dZ d,dZ!d+dZ" d-dZ# d.dZ$y)/) annotationsN)CallableIteratorSequence)AnyFinalTypeVar)AnthropicUsage)AllMessageValuesResponseAPIUsagec&t|tr|gSt|tr|jdd}nt|tr|}ngSg}|j dD]}|j D]}|j}|jds%|tddj}|r|dk(rI tj|}t|tsp|j||S#tj$rYwxYw)Nzutf-8replace)errorsz zdata:z[DONE]) isinstancedictbytesdecodestrsplit splitlinesstrip startswithlenjsonloadsJSONDecodeErrorappend)itemchunkeventsblocklinestrippedpayloadparseds v/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/base_llm/guardrail_translation/utils.py_anthropic_stream_chunk_eventsr' s$v $ GI 6 D#  "FV$ &$$& &Dzz|H&&w/s7|~.446Gg1 G,&$' f% & & M ''  s=C::DDcd}d}d}|D]}t|D]}|jd}|dk(r+|jdxsi}|jdxsi}n|dk(r|jdxsi}ni}t|tsr|jd t |jdxsd}d }|jd t |jd xsd}d }|syt || S) NrFtype message_startmessageusage message_delta input_tokensT output_tokensr.r/)r'getrrintr ) original_responser.r/ found_usagerevent event_typer+ usage_objs r&#_usage_from_anthropic_stream_chunksr8's LMK!#3D9 #E6*J_,))I.4"#KK06B .!IIg.4"  i.}}^,8"9==#@#EAF " }}_-9 #IMM/$B$Ga H " ! ##&  |= QQct|tr|jdS|t|ts t |ddSy)Nr,)rrr1listgetattr)r3s r&_blocked_usage_objr=DsA#T* $$W--$Z8I4-P('488 r9c t|tr/t|j||j|dxsdStt ||t ||dxsdSNr)rrr2r1r<)r7key fallback_keys r& _usage_tokensrBLsT)T"9==immL!&DEJKK wy#wy,'JKPq QQr9ct|trt|}||St|}t t |ddt |ddS)a Token usage for a synthetic guardrail-blocked response. A post-call block replaces the LLM's response with the violation message, but the upstream call already consumed tokens -- report that real usage (carried on ``ModifyResponseException.original_response``) rather than discarding it. Pre-call blocks never invoked the LLM (no original_response), so usage is zero. r. prompt_tokensr/completion_tokensr0)rr;r8r=r rB)r3 stream_usager7s r&blocked_response_usagerGRsW#T*ABST  # )*;?SL(OEXYM' >>RL !#!A\M%A r9cjt|dd}| t|Sddl}tt|ddS)N skip_system_message_in_guardrailrFr<boollitellmguardrail_to_applyperrOs r&+effective_skip_system_message_for_guardrailrSs:+-OQUVC Cy !CUK LLr9cjt|dd}| t|Sddl}tt|ddS)Nskip_tool_message_in_guardrailrFrMrPs r&)effective_skip_tool_message_for_guardrailrVs9+-MtTC Cy !A5I JJr9cbt|xsijdxsdjS)Nrole)rr1lower)r+s r& _message_roler[s*  2""6*0b 1 7 7 99r9c&td|DS)Nc3>K|]}t|dk7s|yw)systemNr[.0ms r& z1openai_messages_without_system..sEq a(8H(DEtuplemessagess r&openai_messages_without_systemris EHE EEr9c&td|DS)Nc3>K|]}t|dk7s|yw)toolNr_r`s r&rcz/openai_messages_without_tool..sCq a(8F(BCrdrergs r&openai_messages_without_toolrms CHC CCr9ct|r t|n t|}t|r t |n|}|t |t |k7fSN)rSrirfrVrmr)rQrhsystem_filteredfully_filtereds r&filter_messages_by_skip_flagsrrs[ 77I J 'x0 8_ 55G H %_5  3~.#h-? ??r9c t|ddduS)Nscan_only_tool_resultsT)r<)rQs r&.effective_scan_only_tool_results_for_guardrailrus %'? F$ NNr9F)rtc2|r|dk(ry|r|dk(ry|xr|dvS)Nr^Trl)rlfunction)rXskip_system_messageskip_tool_messagerts r&role_out_of_guardrail_scoper{s.tx/TV^ ! Fd2F&FFr9cFtfdt|DS)Nc3XK|]!\}}tt|s|#yw))ryrzrtN)r{r[)raindexr+rt skip_system skip_tools r&rcz4scoped_structured_message_indices..s6  E7* ' " +'#9    s'*)rf enumerate)rhrtrrs ```r&!scoped_structured_message_indicesrs$  '1   r9ToolTct|tsy|jd}t|tr%|jd}t|tr|SdS|jd}t|tr|SdS)Nrwname)rrr1r)rlrw function_name flat_names r&openai_tool_namersk dD !hhz*H(D!'||F3 *=# >}HDHxx'I"9c29<.sf$zRVX[G\aefs """)rrr1rf)rlrwrs r&anthropic_tool_namesrsk dD !.2hhv.>*.Ldhhz*RVH3=h3M8<</SWM f488F#3]"Cf ffr9c*t|}|r|dSdSr?)r)rlnamess r&anthropic_tool_namers'-E58&$&r9ct|xsd}tfd|DtfdtD}g||S)aUnion of the request's tools and guardrail-returned tools, keyed by name. Under ``scan_only_tool_results`` the guardrail never saw the request's tools, so a returned list can neither replace them (it would drop every user-defined function) nor be discarded (it may carry a tool the guardrail synthesized and told the model to call, like Compresr's retrieve tool). Keep every request tool and append only returned tools whose names aren't already taken by a request tool or an earlier returned tool. rxc38K|]}|xywrorx)rarlr tool_names r&rcz:merge_returned_tools_into_request_tools..s "gD)TX/BY$Af4"gsc3tK|]/\}}|xvrtfdd|Dr|1yw)Nc34K|]}|k7ywrorx)raearlierrrs r&rczDmerge_returned_tools_into_request_tools...s b7!3t!; bs)all)rar~rlrreturned_tools taken_namesrs r&rcz:merge_returned_tools_into_request_tools..sI E4dO #DK 7 \S b>Z`[`Ka bb s58)rf frozensetr) request_toolsrr originals additionsrrs `` @@r&'merge_returned_tools_into_request_toolsrsR]0b1I""gI"ggK$^4I $Y # ##r9ctt||t|t|dt |t|d|r|dnddfd }t |S)aSubstitute guardrail-returned messages back into the full conversation. Guardrails only ever see the scoped subset of messages, so a replacement list they hand back describes that subset, not the whole request. Writing it over ``data["messages"]`` wholesale would silently drop every out-of-scope message (system prompt, prior turns). Instead, swap each returned message into the position its scoped original came from; extra returned messages land after the last scoped position, and scoped originals without a counterpart are treated as removed by the guardrail. When nothing was filtered out this degenerates to the returned list itself, preserving wholesale-replacement behavior for unscoped guardrails. Nc3KtD].\}}|vr j|||k(s%Ed{0y7wro)rr1)r~r+appended full_messageslast_scoped_indexremoved replacementss r&_mergedz2merge_guardrailed_scoped_messages.._merged#sT' 6 $NE7""5'2 2))###  $ $s0AAAA)returnzIterator[AllMessageValues])rziprrrfr;)rscoped_indicesguardrailed_scopedrrrrrs` @@@@r&!merge_guardrailed_scoped_messagesr sn"s>3EFGL~c2D.E.GHIG.s>/B/DEFH5C~b1$$  ?r9)rrrz list[dict])r3z list[Any]rzAnthropicUsage | None)r3objectrr)r7rr@rrArrr2)r3z Any | Nonerr )r3rrr )rQrrrN)r+r rr)rhSequence[AllMessageValues]rztuple[AllMessageValues, ...])rQrrhrrz)tuple[tuple[AllMessageValues, ...], bool])rQrrrN) rXrryrNrzrNrtrNrrN) rhrrtrNrrNrrNrztuple[int, ...])rlrrz str | None)rlrrztuple[str, ...])rzSequence[ToolT] | NonerzSequence[ToolT]rzCallable[[ToolT], str | None]rz list[ToolT])rrrz Sequence[int]rrrzlist[AllMessageValues])% __future__rrcollections.abcrrrtypingrrr 8litellm.types.llms.anthropic_messages.anthropic_responser litellm.types.llms.openair r r'r8r=rBrGrJrSrVr[rirmrrrur{rrrrrrrrxr9r&rs" 88&&SH8R:R ,.MK:F(F!F D(D!D @ @*D @. @ O$) G  G G G ! G  G(!     & =g' $)$#$-$ $2-!3 r9