tPjD&@UdZddlZddlZddlZddlmZmZmZddlm Z m Z m Z m Z m Z ddlmZddlZddlmZddlmZddlmZdd lmZdd lmZmZmZmZmZm Z m!Z!dd l"m#Z#dd l$m%Z%dd l&m'Z'ddl(m)Z)m*Z*m+Z+m,Z,ddl-m.Z.m/Z/m0Z0ddl1m2Z2ddl3m4Z4m5Z5m6Z6m7Z7ddl8m9Z9e r$ddl:m;Z<ddl=m>Z>ddl?m@Z@ddlAmBZBddl3mCZCddl8mDZDdZEe eFd<dZGe eFd<Gdde ZHGdd e ZIGd!d"e ZJGd#d$e d%&ZKGd'd(e ZLGd)d*e ZMGd+d,eZNy)-z WebSearch Interception Handler CustomLogger that intercepts WebSearch tool calls for models that don't natively support web search (e.g., Bedrock/Claude) and executes them server-side using litellm router's search tools. N) AsyncIteratorMappingSequence) TYPE_CHECKINGAnyFinal TypedDictcast)ReadOnly)verbose_loggermessages)LITELLM_WEB_SEARCH_TOOL_NAME) CustomLogger)get_litellm_web_search_tool"get_litellm_web_search_tool_openai%get_litellm_web_search_tool_responses#is_anthropic_native_web_search_toolis_web_search_tool"is_web_search_tool_chat_completionis_web_search_tool_responses)WebSearchTransformationvalidated_max_agentic_loops)SearchResponse)CHAT_COMPLETION_AGENTIC_SURFACERESPONSES_AGENTIC_SURFACEAgenticLoopPlanAgenticLoopRequestPatch)AnthropicSearchQueryAnthropicServerToolUseBlockWebSearchInterceptionConfig)AllMessageValues)AgenticLoopParams CallTypes LlmProviders!StandardLoggingUserAPIKeyMetadata)ProviderConfigManager)Logging)BaseAnthropicMessagesConfig)UserAPIKeyAuth)AnthropicMessagesResponse) ModelResponse)CustomStreamWrapper*_websearch_interception_emit_native_blocks WEBSEARCH_EMIT_NATIVE_BLOCKS_KEYwebsearch_native_blocks$WEBSEARCH_NATIVE_BLOCKS_METADATA_KEYc.eZdZUeeeefdzed<y)_PlanMetadataViewNr1)__name__ __module__ __qualname__rrstrobject__annotations__x/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/integrations/websearch_interception/handler.pyr4r4Qs%gc6k&:;dBBr<r4ceZdZUeed<y)_AgenticLoopParamsViewagentic_loop_paramsN)r5r6r7r$r:r;r<r=r?r?Us**r<r?ceZdZUeed<y)_WebSearchSettingsViewwebsearch_interception_paramsN)r5r6r7r"r:r;r<r=rBrBYs#>>r<rBc2eZdZUeed<eeefdzed<y)_SearchToolConfigsearch_tool_nameNlitellm_params)r5r6r7r8r:rr9r;r<r=rErE]sCK(4//r<rEF)totalcLeZdZUdZeeed<eeeefed<eeed<y)_DeploymentKwargsViewzFTyped reads of the untyped request kwargs seen by the deployment hook.custom_llm_providerrGmodelN) r5r6r7__doc__r r8r:rr9r;r<r=rJrJbs-P!#&WS&[122 C=r<rJc(eZdZUdZeedzed<y) _UserAuthViewzETyped read of the optional team attached to the caller's auth object.Nteam_id)r5r6r7rMr r8r:r;r<r=rOrOjsO cDj !!r<rOceZdZdZ dXdeeezdzdedzdedzffd Ze de dedzfdZ dYd ed ee d ee dzd edzd e ee fdzde ee fdzf dZd e eefdedzde ee fdzfdZd e ee fd ee ee fde ee fdzfdZededdfdZe de ee fde fdZede dee ee fde fdZd ed ee d e de dzfdZde d ed ee d ee dzded ed e deee ffdZde d ed ee d ee dzded ed e deee ffdZde d ed ee d ee dzded ed e deee ffdZd e d ed ee de dd d!e d"d#ded e dd$fd%Zd e d ed ee de dd d!e d"d#ded e de fd&Z!de d'e d e de fd(Z"e d)ee d*ee#dzdee ee fd+ffd,Z$e d-e ee fdefd.Z%e d/ed0e#dzdee ee fe ee fffd1Z&e ded2ee ee fdefd3Z'd e d ed ee de d4e d"d#ded e dd5fd6Z(d e d ed ee de d4e d"d#ded e de fd7Z)d e d ed ee de d4e d"d#ded e de fd8Z*d ed eee zd)ee d4e d e de+f d9Z,e d eee zdee fd:Z-e d;e defd<Z.e d4e d e defd=Z/e d e de fd>Z0d ed ee d)ee d?ee d!e d"d#ded e dd$fd@Z1d ed ee d)ee d?ee d!e d"d#d e dee+ee#dzffdAZ2 dYd/ed e ee fdzdeee#dzffdBZ3dCe ee fd e ee fdzddfdDZ4e dEdFdedzde ee ffdGZ5e dCe ee fdzdedzfdHZ6e d e ee fdzddIfdJZ7dKe ddLfdMZ8dNee9dOeddLfdPZ: dZd ed ee d)ee d4e d"d#ded e dQedd5fdRZ; dZd ed ee d)ee d4e d e dQede+fdSZxZ?S)[WebSearchInterceptionLoggerab CustomLogger that intercepts WebSearch tool calls for models that don't natively support web search. Implements agentic loop: 1. Detects WebSearch tool_use in model response 2. Executes litellm.asearch() for each query using router's search tools 3. Makes follow-up request with search results 4. Returns final response Nenabled_providersrFmax_agentic_loopsct||!tjjg|_n1|Dcgc] }t |tr |jn|"c}|_||_|j||_ d|_ ycc}w)a Args: enabled_providers: List of LLM providers to enable interception for. Use LlmProviders enum values (e.g., [LlmProviders.BEDROCK]) If None or empty list, enables for ALL providers. Default: None (all providers enabled) search_tool_name: Name of search tool configured in router's search_tools. If None, will attempt to use first available search tool. max_agentic_loops: How many follow-up model calls one intercepted request may chain before the loop is refused and the turn ends. If None, LiteLLM's default of 3 applies. NF) super__init__r&BEDROCKvaluerS isinstancerF_validated_max_agentic_loopsrT_request_has_websearch)selfrSrFrTp __class__s r=rWz$WebSearchInterceptionLogger.__init__|s~$   $&2&:&:&@&@%AD "]n%oXYA|1LaggRS&S%oD " 0!%!B!BCT!U&+#&ps%B returnct|dS)zZ Reject loop ceilings the agentic loop cannot honor, at config load time. z/websearch_interception_params.max_agentic_loops)fieldr)rTs r=r[z8WebSearchInterceptionLogger._validated_max_agentic_loopss ++zGWebSearchInterceptionLogger.try_short_circuit_search..s8Q%a(8r)get_last_user_messagezNWebSearchInterception: Short-circuit search detected (provider=%s, query='%s')c38K|]}t|s|ywrirrks r=rnzGWebSearchInterceptionLogger.try_short_circuit_search..s H1!DQ!GQ Hsrdz6WebSearchInterception: Short-circuit search failed: %sSearch failed: srvtoolu_name web_searchserver_tool_usequery)typeidrvinput tool_use_idsearch_responsetext)rzrmsg_message assistantend_turn) input_tokens output_tokens)r{rzrolerLcontent stop_reason stop_sequenceusagezpWebSearchInterception: Short-circuit search completed, returning synthetic response (%s chars, native_blocks=%s))rSr&r(&get_provider_anthropic_messages_confighandles_web_search_nativelyr debug ValueError Exceptionall8litellm.litellm_core_utils.prompt_templates.common_utilsrpr listr#next_execute_searcherroruuiduuid4hexgetappendr"build_web_search_tool_result_blocklen)r]rLrrcrKrd provider_str provider_enumanthropic_configrpry native_toolsearch_result_text structurederr~ tool_nameresponses r=try_short_circuit_searchz4WebSearchInterceptionLogger.try_short_circuit_searchs{827R  ! ! -,dF\F\2\ #/ #=M&;&b&bm'  +0@0\0\0^$$G  8%88 -T$7G2H(-ST \^jlq " H H   I~7;7K7KE7R1R."J7;7K7KEZ`7K7a1a."J 35  "#,TZZ\-=-=,>!?K*v6F,I NN-%%%u-   NN'JJ +$.  0BCD'%!&'!< .   ~ " # t # aI&   F2S1a I  !Y[\ ]/>qc-BD  Isy%H6A G'2A$H6H-G=.H H HCH6'G:6H69G::H6=HH H3 H.(H6.H33H6 call_typec K|jdd|jdi|jddd}|dxs|djdd}|s tj|d\}}}}||jvry|jd}|sy|t j t jfvr|j|| Std |D}|sytjd td |Dr d |t<g}|D]v} t| rXt} |j| tjd| jdd| jddt f|j| x||d<|jdrtjdd|d<d |d<|S#t$rd}Y_wxYww)aE Pre-call hook to convert native Anthropic web_search tools to regular tools. This prevents Bedrock from trying to execute web search server-side (which fails). Instead, we convert it to a regular tool so the model returns tool_use blocks that we can intercept and execute ourselves. rKrfrGrL)rKrGrL)rLNrc)rdrcc32K|]}t|ywrirjrks r=rnzMWebSearchInterceptionLogger.async_pre_call_deployment_hook..P"HQ#5a#8"HrozMWebSearchInterception: Converting native web_search tools to LiteLLM standardc32K|]}t|ywrirrrks r=rnzMWebSearchInterceptionLogger.async_pre_call_deployment_hook..\E!215EroT3WebSearchInterception: Converted %s (type=%s) to %srvunknownrznonestreamMWebSearchInterception: deployment hook converting stream=True to stream=FalseF(_websearch_interception_converted_stream)rlitellmget_llm_providerrrSr% responses aresponses_convert_responses_toolsanyr rr0rrrr) r]rdr kwargs_viewrK_rc has_websearchconverted_toolstoolconverted_tools r=async_pre_call_deployment_hookz:WebSearchInterceptionLogger.async_pre_call_deployment_hook+s$*::.CR#H$jj)92>ZZ,5 **?@ KP`DaDeDe !2E # )/6/G/GkZaNb/c,&1 d&<&< < k )&(# )s+AGG6EG GGGGctd|Dsytjd|Dcgc]}t|r t n|}}i|d|i}|j drtjdd|d<d|d <|Scc}w) zMConvert Responses API web search tools to the LiteLLM standard function tool.c32K|]}t|ywrir)rlrs r=rnzGWebSearchInterceptionLogger._convert_responses_tools..}sH$/5HroNzPWebSearchInterception: Converting Responses web_search tools to LiteLLM standardrcrrFTr)rr rrrr)r]rdrcrrconverted_kwargss r=rz4WebSearchInterceptionLogger._convert_responses_toolsysH%HHopqv" hl7STX7Y 1 3_c c" " #GV"FWo"F ::h   !p q). X &KO G H" sBconfigc|jdd}|jdd}|jdd}d}|&g}|D]} t|}|j|!||||S#t$r|j|YIwxYw)a Initialize WebSearchInterceptionLogger from proxy config.yaml parameters. Args: config: Configuration dictionary from litellm_settings.websearch_interception_params Returns: Configured WebSearchInterceptionLogger instance Example: From proxy_config.yaml: litellm_settings: websearch_interception_params: enabled_providers: ["bedrock"] search_tool_name: "my-perplexity-search" max_agentic_loops: 5 Usage: config = litellm_settings.get("websearch_interception_params", {}) logger = WebSearchInterceptionLogger.from_config_yaml(config) rSNrFrT)rSrFrT)rr&rr)clsrenabled_providers_strrFrTrSrgrs r=from_config_yamlz,WebSearchInterceptionLogger.from_config_yamls0(.zz2Et'L"(**-?"F#)::.A4#H>B , " 1 77$0$:M%,,];  7/-/  "7%,,X67sA,,B B rc|jd}|jddk(r!t|tr|jdS|jdS)z@Effective tool name, handling OpenAI ``function`` wrapper shape.functionrzrvrrZdict)rfns r= _tool_namez&WebSearchInterceptionLogger._tool_namesIHHZ( 88F z )jT.B66&> !xxr< tool_choicerct|tr|jddk7r|S|Dchc]}|j|}}|jd|vr|Si|dtiScc}w)aRepoint a forced ``tool_choice`` at ``litellm_web_search`` when it names a web-search tool that was just converted away. Native clients (e.g. Claude Code) force the search tool via ``tool_choice={"type": "tool", "name": "web_search"}``. Since the tool definition gets renamed to ``litellm_web_search``, an unrewritten ``tool_choice`` points at a tool that no longer exists, which Anthropic rejects with "Tool 'web_search' not found in provided tools". rzrrv)rZrrrr)rrrrmconverted_namess r=_sync_forced_tool_choicez4WebSearchInterceptionLogger._sync_forced_tool_choicesp+t, 0G60Q =L!M#.."3!M!M ??6 "o 5 D+Dv'CDD"NsA&c HK|jdijdd}tjd||jxsd|j0||jvr"tjd||jy|jd}|syt d |D}|sytjd ||jd }|j ||j |d <t d |Dr d |t <g}|D]v} t| rXt} |j| tjd| jdd| jddtf|j| x||d<tjd|D cgc]} | jdc} d|vr$|j|jd||d<|jdrtjdd|d<d |d<|Scc} ww)a Pre-request hook to convert native web search tools to LiteLLM standard. This hook is called before the API request is made, allowing us to: 1. Detect native web search tools (web_search_20250305, etc.) 2. Convert them to LiteLLM standard format (litellm_web_search) 3. Convert stream=True to stream=False for interception This prevents providers like Bedrock from trying to execute web search natively (which fails), and ensures our agentic loop can intercept tool_use. Returns: Modified kwargs dict with converted tools, or None if no modifications needed rGrKrfz^WebSearchInterception: Pre-request hook called - custom_llm_provider=%s - enabled_providers=%sALLNz7WebSearchInterception: Skipping - provider %s not in %srcc32K|]}t|ywrirjrks r=rnzEWebSearchInterceptionLogger.async_pre_request_hook..rrozAWebSearchInterception: Pre-request hook triggered for provider=%srTc32K|]}t|ywrirrrks r=rnzEWebSearchInterceptionLogger.async_pre_request_hook.. rroTrrvrrzrz1WebSearchInterception: Tools after conversion: %srrz=WebSearchInterception: Converting stream=True to stream=FalseFr) rr rrSrrTr0rrrrr) r]rLrrdrKrcrdeployment_max_agentic_loopsrr standard_toolrms r=async_pre_request_hookz2WebSearchInterceptionLogger.async_pre_request_hooks' &,ZZ0@"%E%I%IJ_ac%d l   " " +e  ! ! -2ETMcMc2c  IK^`d`v`v zz'* #"H%"HH `buv.4jj9L.M$  ! ! -2N2V*.*@*@F& ' EuE E7;F3 4;= -D!$' ; = &&}5$$IHHVY/HHVV,0  &&t, -*w ?YhAiTU!%%-Ai  F "$($A$A&**]B[]l$mF= ! ::h   !` a$F8 AEF= > BjsF"H"$H .\s'U!(:1(='Uroz4WebSearchInterception: No web search tool in request anthropicrrresponse_formatzAWebSearchInterception: No WebSearch tool_use detected in responseQWebSearchInterception: Detected %s WebSearch tool call(s), executing agentic looprrz)thinkingredacted_thinkingrrf signaturedatazCWebSearchInterception: Extracted %s thinking block(s) from response websearch) tool_calls tool_typergrthinking_blocksT)rr-async_should_run_chat_completion_agentic_loopr'async_should_run_responses_agentic_loopr rrzrSrrtransform_requestrrZrgetattrr)r]rrLrrcrrKrdhas_websearch_toolshould_interceptrrrblock block_typethinking_block_dict tools_dicts r=async_should_run_agentic_loopz9WebSearchInterceptionLogger.async_should_run_agentic_loop-s ::1 26U UKK!!$7L  ::1 26O OEE!!$7F  Y[npvwGhX  ! ! -2ETMcMc2c  W#&&  "9 %('U QS'U$U!  !W X"9 (?'P'P'( $*   !d e"9  _adeoap .0 h %ll9b1Gh 26<"G @E%&"YYv. $UFD9 >>eT*#**51280D'!Z/:A%UW:X+J7;B5+WY;Z+K86=eVR6P+F3#**+>?% @(   UWZ[jWk  %$+*.  ZGs)4I?I97I?.I</E-I?BI?<I?cKtjd||tjdt||j3||jvr%tjd||jdifSt d|xsgD}|stjddifSt j ||d\} } | stjd difStjd t| | d |dd } d | fSw)z Check if WebSearch tool interception is needed for Chat Completions API. Similar to async_should_run_agentic_loop but for OpenAI-style chat completions. zJWebSearchInterception: Chat completion hook called! provider=%s, stream=%srrFc32K|]}t|ywri)rrks r=rnz\WebSearchInterceptionLogger.async_should_run_chat_completion_agentic_loop..s'eRS(J1(M'eroz.s'_A(DQ(G'_rozFWebSearchInterception: No litellm_web_search tool in responses requestrrzNWebSearchInterception: No WebSearch function_call detected in responses outputzUWebSearchInterception: Detected %s WebSearch function_call(s), executing agentic looprrT)r rrSrrrrrs r=rzCWebSearchInterceptionLogger.async_should_run_responses_agentic_loops  RTgio   ! ! -2ETMcMc2c  W#&&  "9 $''_RWR][]'_$_!  !i j"9 '>'P'P'( $*   !q r"9  cehiset %$+*  ZsC(C*"anthropic_messages_provider_configz"BaseAnthropicMessagesConfig | None*anthropic_messages_optional_request_params logging_objzLiteLLMLoggingObj | Nonez1AnthropicMessagesResponse | AsyncIterator[object]c K|d} |jdg} tjdt| |j ||| | |||| d{S7w)z Execute agentic loop with WebSearch execution for Anthropic Messages API. This is the legacy method for Anthropic-style responses. rrz?WebSearchInterception: Executing agentic loop for %s search(es))rLrrrrrrrdN)rr rr_execute_agentic_loop) r]rcrLrrrrrrrdrrs r=async_run_agentic_loopz2WebSearchInterceptionLogger.async_run_agentic_loop su$",/ !&+^>H9 : !'  e  - s45C7C18C70C316C7'C5(A C73C75C7plancKd|jjti}|d}|s|S|j||Sw)a Inject Anthropic-native ``web_search_tool_result`` blocks into the final response when the originating client used a native ``web_search_*`` tool. See ``WebSearchTransformation.build_web_search_tool_result_block`` for the block shape. The blocks are prepended to ``response.content`` so Anthropic-native clients (Claude Desktop, the Anthropic SDK) can render citations / sources alongside the model's textual reply. r1)rrr2_inject_native_blocks)r]rrrd metadata_view native_blockss r=%async_post_agentic_loop_response_hookzAWebSearchInterceptionLogger.async_post_agentic_loop_response_hookrsL" &t}}'8'89]'^3  --FG O))(MBBs=?rr .c>tfdt|DS)a Build a ``server_tool_use`` + ``web_search_tool_result`` pair per tool_call. The pair is what Anthropic's spec requires: a bare result block, or one keyed by the model's ``toolu_...`` id instead of a ``srvtoolu_...`` one, is rejected on replay ("String should match pattern '^srvtoolu_'") and leaves native clients without a search to attach the sources to. c3K|]K\}}tjtj||tkr|ndD]}|Myw)N)ryr)rR_native_result_pair_tool_call_queryr)rli tool_callrr s r=rnzJWebSearchInterceptionLogger._build_native_result_blocks..sj 94HH1BB9M9:SAS=T9T 21 5Z^I    sAA)tuple enumerater s `r=rz7WebSearchInterceptionLogger._build_native_result_blockss$ )* 5   r<rc|jd}t|tsy|jd}t|tr|SdS)Nr|rfry)rrZrr8)r tool_inputrys r=rz,WebSearchInterceptionLogger._tool_call_querys?%MM'2 *g.!~~g."5#.u6B6r<ryrcdtjj}t|t |j t j||fS)Nru)ry)r{r|r})rrrr!r model_dumprr)ryrr~s r=rz/WebSearchInterceptionLogger._native_result_pairsU ))9)9(:; ';>RY^>_ ` k k m # F F' /   r<rcj|s|St|tr1|jdxsg}t|t|z|d<|St |ddxsg} t|t|z|_|S#t tf$r-tjdt|jY|SwxYw)z?Prepend native blocks to response content, dict or object form.rNzNWebSearchInterception: could not inject native blocks into response of type %s) rZrrrrrAttributeError TypeErrorr rrzr5)rrexistings r=rz1WebSearchInterceptionLogger._inject_native_blockssO h %||I.4"H"&}"5X"FHY O8Y5; #M2T(^CH  *   `X''  sA668B21B2rz#ModelResponse | CustomStreamWrapperc K|d} |jdd} tjdt| |j ||| ||||| d{S7w)z Execute agentic loop with WebSearch execution for Chat Completions API. Similar to async_run_agentic_loop but for OpenAI-style chat completions. rrrzOWebSearchInterception: Executing chat completion agentic loop for %s search(es))rLrrrrrrdrN)rr rr%_execute_chat_completion_agentic_loop) r]rcrLrrrrrrdrrs r=&async_run_chat_completion_agentic_loopzBWebSearchInterceptionLogger.async_run_chat_completion_agentic_loopsz"",/ !&+rcrrmodel_alias_mapstream_responsecustom_prompt_dict_websearch_interception> acompletionr9rKlitellm_logging_objr/rKzXWebSearchInterception: Built responses request patch model=%s input_items=%d searches=%d)rLrrcrrd)rZrrr_create_empty_search_resultr rrasynciogather_extract_search_textzipr_normalize_responses_inputitems startswithr8rr)r]rLrrrrdr search_taskssearch_resultsresult search_texts search_textitemfollowup_items input_list tools_paramkvoptional_params_cleankwargs_for_followupfull_model_names r=r1z:WebSearchInterceptionLogger._build_responses_request_patch"s(  immG4d; '@R@V@VW^@_$$Yw%7%@$P5578   cehiuevw&-nnl&[VZ&[ [O]^Vt88@^ ^+.j,*G! ! & ;,(}}Y78!*{B!? 3(}}Y7) !  ! ! ! $!;;HEV ,009 (--/( 1vv qD( (   & 1<< 9: qD &  &   e  6::6K+Lc R!'(=!> ?qHO f   O    '!!+K!>+D1&   E !\^! *( & sUI A#H)*9I #H.$I ,H1I AH6& ! r<rJc,t|trtjd|d|St|tr0t |dk(r"|\}}t|t r|St |Stjdt|t |S)Nz=WebSearchInterception: Responses search failed with error: %srtz7WebSearchInterception: Unexpected search result type %s) rZrr rr rr8rrz)rJ text_valuers r=rCz0WebSearchInterceptionLogger._extract_search_text}s fi (  !`bh i$VH- - fe $V)9"MJ!+J!<: Q#j/ QVX\]cXde6{r<c|jd|jdd}|jd}|rt|trz|jd}|gt|ttfrQt j |r<|dkDr7||kr2t j|dz}tjd||||}|S)zExtract max_tokens and validate against thinking.budget_tokens. Anthropic API requires ``max_tokens > thinking.budget_tokens``. If the constraint is violated, auto-adjust to ``budget_tokens + 1024``. max_tokensr budget_tokensrzvWebSearchInterception: max_tokens=%s <= thinking.budget_tokens=%s, adjusting to %s to satisfy Anthropic API constraint) rrZrintfloatmathisfiniteceilr r)rrdr\thinking_paramr^adjusteds r=_resolve_max_tokensz/WebSearchInterceptionLogger._resolve_max_tokenss*--  JJ|T * !0 3 3J ? j>#1#5#5o#FM)}sEl;MM-0!A%.&*ii &>&EH"((N"% "*Jr<cdh}|jDcic]\}}|jdr||vs||!c}}Scc}}w)uBuild kwargs for the follow-up call, excluding internal keys. ``litellm_logging_obj`` MUST be excluded so the follow-up call creates its own ``Logging`` instance via ``function_setup``. Reusing the initial call's logging object triggers the dedup flag (``has_logged_async_success``) which silently prevents the initial call's spend from being recorded — the root cause of the SpendLog / AWS billing mismatch. r>r<)rFrG)rd_internal_keysrQrRs r=_prepare_followup_kwargsz4WebSearchInterceptionLogger._prepare_followup_kwargssL"7 7#\\^ Q1<<@Y3Z_`hv_vAqD   s ???rc K|j|||||||d{\} } | j tdt|} | j | j | j } | $ttdz| jdd} n| jdd| tt|jdd} tjd| | j| jxs|d| | jd{} |jtr%|j!|| }|j#| |} | S7,7Cw) ?Legacy path: execute search + build patch + run follow-up call.rN1WebSearchInterception: missing follow-up messagesr\r])r\rrLr r;)rrrrupdaterr\r r_popranthropic_messagesacreaterLrdr0rr)r]rLrrrrrrrdr r rr\rrs r=rz1WebSearchInterceptionLogger._execute_agentic_loopsv372U2U!+7a#3V3 - ) )  ! ! )PQ Q!%&P!Q}<<="--  cDj/*=*=lD*QRJ    d 3  c6::lD#ABJL^LfLfM !"++%%.M  M "" M G  ::6 7#'#C#C%#5$D$M11(MJHQ- ,G s#EE C*E E  AE Ec jKg}|D]} | djd} | r9tjd| |j|j | |Rtjd| d|j|j tjdt |tj|dd id {} g} g} t| D]\}}t|tr=tjd ||| jd || jd Tt|trqt |d k(rc|\}}| jt|trtt|n t|| jt|t r|nd tjdt#||| jt|| jd "t%j&|| |\}}||tt(|gz}t+|dd xs|jdd}|}|j-||}tjd||j/Dcic]\}}|dk7s ||}}}|j1|}|3d|j2jdii}|djd|}tjd||t |t | t5|||||}|| fS7`cc}}ww)a Execute litellm.search() and build follow-up request patch. Returns the patch alongside the parallel list of structured ``SearchResponse`` objects (one per tool_call, ``None`` when the search failed or the tool_call had no query). The caller uses these to optionally build Anthropic-native ``web_search_tool_result`` content blocks for the final response. r|ry4WebSearchInterception: Queuing search for query='%s'rs0WebSearchInterception: Tool call %s has no queryr{:WebSearchInterception: Executing %s search(es) in parallelr3TN6WebSearchInterception: Search %s failed with error: %srtrY2 0IAv&),$$%]_`bhi$++ofX,FG"))$/FE*s6{a/?/5, ,$++ZPZ\_E`Dj,Afijtfuv"))jIY[i>j*:ptu$$%ceijpeqstu$++CK8"))$/ 0"+B*T*T!/++ '< %-0A4lC[/\$\"+/@$Gs6::VgirKs 445_agh _aklHMMO5 QSTXdSdAqD5 *5 &*%B%B6%J  "%{'E'E'I'IJ_ac'd;L++@AEEguUO p   " # $ %  /!'!>&  (((C!\R5 s,CL3 L* GL3 L-L-"B L3-L3cK ddlm}|j |}d}i}|j |}|K|j||d{t|jdixsi}|jd}|sd }tjd |tjd |||j|}|dn|j|| } |jD cic]\} } | dk7r| | | } } } | tjd||d | d{n tjd||| d| d{} tj | }tjd|t#||| fS#t$rtjdd}YwxYw7[cc} } w77o#t$$r}tj&d||d}~wwxYww)a  Execute a single web search using router's search tools. Returns both the formatted text (fed back to the model in the follow-up call) and the structured ``SearchResponse`` (preserved so callers can build Anthropic-native ``web_search_tool_result`` blocks for clients that requested a native ``web_search_*`` tool). The structured value is None on the failure path so callers can still emit an empty result block rather than dropping the search entirely. r) llm_routerz~WebSearchInterception: Could not import llm_router from proxy_server, falling back to direct litellm.asearch() with perplexityN) search_tool)rrdrGsearch_provider perplexityzXWebSearchInterception: No search tools configured in router, using default provider '%s'zDWebSearchInterception: Executing search for '%s' using provider '%s')user_api_key_authrF)ryr)ryrlitellm_metadataz>WebSearchInterception: Search completed for '%s', got %s charsz1WebSearchInterception: Search failed for '%s': %sr;)litellm.proxy.proxy_serverr ImportErrorr r_select_search_tool_from_router_selected_search_tool_name_authorize_search_toolrr"_get_user_api_key_auth_from_kwargs_build_search_request_metadatarFrasearchrformat_search_responserrr)r]ryrdrrrsearch_litellm_paramsrFrsearch_metadatakeyrY search_kwargsrJrrs r=rz+WebSearchInterceptionLogger._execute_searchVsLA  "A"&!E!EQ[!E!\K*.O46 !&*&E&ER]&E&^ &11kRX1YYY(,[__=Mr-R-XVX(Y%"7";";G? F#F3"F##F3)F31F33 G<GGGrc fK|jd}t|tr|sy|j|}|yddlm}m}m}|||d{dt|ddi}|d} | r=ddl m } m } m } || | | t|dd| d{} ||| d{yy7X77 w) NrFr)can_key_call_search_toolcan_team_call_search_toolget_team_object)rF valid_tokenrP) prisma_clientproxy_logging_objuser_api_key_cacheparent_otel_span)rPrrrr)rF team_object) rrZr8rlitellm.proxy.auth.auth_checksrrrrrrrr)r]rrdrFrrrr auth_viewrPrrrrs r=rz2WebSearchInterceptionLogger._authorize_search_tools #.//2D"E*C08H #'#J#J6#R  $   '-)   ,5g>OQZ\`6a*b "9-    (7+#5!():#DIYc_ccr<zUserAPIKeyAuth | NonecR|sydD]<}|j|}t|ts%|jd7|dcS|jd}t|tsydD]<}|j|}t|ts%|jd7|dcSy)N)rrrrGr)rd metadata_keyrrGs r=rz>WebSearchInterceptionLogger._get_user_api_key_auth_from_kwargss< 5Lzz,/H(D)hll;N.O.[ 344 5 !' +; <.$/< 5L%)),7H(D)hll;N.O.[ 344 5 r<rz_SearchToolConfig | Nonecx| t|dsytt|dxsg}|j|dS)N search_toolsrouter)rsource)hasattrrr_select_search_tool_from_list)r]rrs r=rz;WebSearchInterceptionLogger._select_search_tool_from_routersA  WZ%H"7:~#F#L"M 11|T\1]]r<rrc|jr|Dcgc]#}|jd|jk(s"|%}}|rO|djdixsijd}tjd|j|||dStjd|j||rC|d}|jdixsijd}tjd|||Sycc}w)NrFrrGrzHWebSearchInterception: Found search tool '%s' from %s with provider '%s'zfWebSearchInterception: Search tool '%s' not found in %s, falling back to first available or perplexityzSWebSearchInterception: Using first available search tool from %s with provider '%s')rFrr r)r]rrrmatching_toolsr first_tools r=rz9WebSearchInterceptionLogger._select_search_tool_from_list s  /;uttxxHZ?[_c_t_t?tduNu#1!#4#8#89I2#N#TRT"Y"YZk"l$$^))#  &a((  x%%   ,QJ)~~.>CIrNNO`aO  e   5vs #C3C3rc vK|j||||||d{} | j tdt|} | j | j | j ddtjd| jxs|| jd| | jd{S77w)rkr.Nrlr)rLrr;) r/rrrrmrrnrr=rLrd) r]rLrrrrrrdrr paramss r=r+zAWebSearchInterceptionLogger._execute_chat_completion_agentic_loop-s&*%N%N!++ &O&    ! ! )PQ Q_- m334 =$'(( %%."++  ""      s"B9B5BB90B71B97B9c,Kg}|D]}d} d|vr(t|dtr|djd} nLd|vrH|d} t| tr3| jdi} t| tr| jd} | r9tjd| |j |j | |tjd|jd |j |jtjd t|tj|d d id{} g} t| D]\}}t|tr,tjd ||| j d|Bt|trNt|dk(r@|\}}| j t|trt!t|n t|tjdt#||| j t|t%j&|| |\}}|dk(r||gzt!t(t|z}n||t!t|gz}tjdtjdt|hd}|j+Dcic]\}}|j-dr||vs||!}}}|}d|vr!|d}|j-|s d|vr|d|}tjd|t||jd}|j+Dcic] \}}|dvr||}}}|||d<t/||||S7Icc}}wcc}}ww)z?Execute litellm.search() and build chat-completion rerun patch.Nr|ryrr6rrrsrsr{rtr3TrurtrYrv)rrIrrzSWebSearchInterception: Making follow-up chat completion request with search resultsz3WebSearchInterception: Follow-up messages count: %s>r=r9r:r;rKr>r<r<rKr?zOWebSearchInterception: Built chat completion request patch model=%s messages=%drc>rc extra_bodyrr9r:r;)rLrrrd)rZrrr rrrr@rrArBr!rrr r8r rzrrxrrFrGr)r]rLrrrrdrrHrryfuncargsrIrzrrJrZrr|tool_messages_or_userr~internal_paramsrQrRrTrUrKrPrSs r=r/z@WebSearchInterceptionLogger._build_chat_completion_request_patchMs! # HIE)# 9W3Et(L!'*..w7y( ,dD)88K4D!$- $ 1$$%[]bc##D$8$8v$8$NO$$%WYbYfYfgkYlm##D$D$D$FG% H* Y[^_k[lm&-nnl&[VZ&[ [24">2 9IAv&),$$%]_`bhi$++ofX,FGFE*s6{a/? & A$++ZPZ\_E`Dj,Afijtfuv$$%ceijpeqstu$++CK8 9 $ 6 6!/+   ! h &!)->,?!?$tDzShBi!i "*!T01-"  rsRTWXjTkl" $\\^& Q1<<@Y3Z_`hw_wAqD& &   F *)/0E)F ##$78S=M%8$95'"B ]  " # -009 (--/ ( 1 qD (  (   "-8 !' *&!'1&   g!\d& " ( s>D:N<N=F N N#N(N-A.NN,N Nc Kyw)z >/1ABa1b<M --LM  %)A Aj $%= >G  $+()AB   +;;B'+(, , s 23d:,*,: ,8ww3:ww/3 JJt*JDzD J !4Z J V $t+ J c6k T !JXL38nL1:T1AL c6k T !L\ c6k* 3;Dfrs <<==&+F:;G  7 0W421 +W %V/H$eGC C+Y+?Y?0 0 I"I" HN,HNr<