uPj$THUddlZddlZddlmZmZmZmZddlmZddl m Z ddl m Z m Z mZmZmZmZddlZddlmZddlZddlmZddlmZdd lmZdd lmZdd lmZdd l m!Z"dd l#m$Z$m%Z%ddl&m'Z'ddl(m)Z)ddl*m+Z+ddl,m-Z-ddl.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6e rddl.m7Z7ne8Z7ddl9m:Z:ddl;mZ>ddl?ddl@mAZAddlBmCZCmDZDe r ddlEmFZFddlGmHZIne ZIddlJmKZKe)ZLe+ZMeeNd<deee8eOfdzd ePfd!ZQ dxd"e8fd#ZR dyd$e8e2zd%e8d&eSe1dzd'e8dzd(eTdzd)e/dzd*eUe8eOfdzd+ePdzd,e8dzd-e0dzd.ePdzd/ePdzd0ePdzd1eVdzd2ed3d4e5dzdee6dzd5eVdzd6ed7dzd8e8dzd9eUe8eOfdzd:eUe8eOfdzd;eUe8eOfdzdZXd?e'dzd@ePd ePfdAZYd%e8d=e8dzd@ePd ePfdBZZedCeUe8e fdDePd edEfdFZ[eD dzd$e8e2zd%e8d&eSe1dzd'e8dzd(eTdzd)e/dzd*eUe8eOfdzd+ePdzd,e8dzd-e0dzd.ePdzd/ePdzd0ePdzd1eVdzd2ed3dGe\dHeUzdzd4e5dzdee6dzd5eVdzd6ed7dzd8e8dzdIe8dzdJe8dzd9eUe8eOfdzd:eUe8eOfdzd;eUe8eOfdzdz(_has_file_search_tool..Ks,U!z!T"EquuV} 'EEUs02)anyr1s r<_has_file_search_toolr@Gs  UuU UU mock_responsectd+iiddddddddd dd dd dd dd ddddddd|gdgdgddddddddddddddd diid!d"gdd#d$d%d&id'id(d)did*S),Nid5resp_67ccd2bed1ec8190b14f964abc0542670bb6a6b452d3795bobjectresponse created_atigstatus completederrorincomplete_details instructionsmax_output_tokensmodelzgpt-4.1-2025-04-14outputmessage4msg_67ccd2bf17f0819081ff3bb2cf6508e60bb6a6b452d3795b assistant output_text)r5text annotations)r5rDrIrolecontentparallel_tool_callsTprevious_response_id reasoning)effortsummarystore temperatureg?rUformatr5 tool_choiceautodisabled$ cached_tokensrW{) input_tokensinput_tokens_details output_tokensoutput_tokens_details total_tokens)r1top_p truncationusageusermetadata)r!rBs r<mock_responses_api_responsertNsP . , I, j,  *,  k , T , !$ ,  D,  ,  ),  %P)'%2$1+-  , 2 "43, 4 #D5, 6 DT:7, 8 T9, : 3;, < X/0=, > 6?, @$ ")8!(!?6OOPVW)V ) #L)B)Z)Z%LQV*[* 0I/g/g +V_u0h0% )+%,E,c,c#-L-d-)(V'@'U'U($3' ( ( , ("- =YcAd&B(7&4#8*; &N2&%# 0DE 8cc*;5Q(70G%>%W%WX^%_ d,&?%c%c!/*>%1&d&N &% O `' $ I$@ #<">sC O. O B O.-O.2O. O!!A#O.O$CO.!O'"A,O.O*A,O.;O,< O.O.!O.$O.'O.*O.,O.responses_api_provider_configuse_chat_completions_apic|duxs|duS)zTWhether the request reaches its provider as a chat completion, not a Responses call.NTrr)rrs r<_bridges_to_chat_completionsrs )D 0 T4LPT4TTrActt|}|yttj|d||xs|dS)a``_bridges_to_chat_completions`` for callers running before the provider config is resolved. Resolving the config is a pure lookup, so this asks the same question the dispatch asks rather than restating its condition. Both callers resolve the provider before this runs, so the only way to be wrong is a prompt manager that moves the model across the bridge boundary, which would leave the deferred points to a pass that never comes. TrrOproviderr.)2_normalize_openai_chat_completions_responses_modelrr*!get_provider_responses_api_config)rOr~rnormalized_models r< _will_bridge_to_chat_completionsrsPQQVW" '??"1%0C  !7$4Q$7  rArbridged)NNc#K|sdyd|t< d|jtdy#|jtdwxYww)a!Tell the cache-control hook that this layer's messages are not the ones sent upstream. A Responses request keeps its system prompt in ``instructions``, which only becomes a system message when the chat-completion bridge builds one, so a role-targeted point is placed by the bridge's pass rather than this one. Only raised for a request that will be bridged. A provider serving Responses natively gets no second pass, so this layer is the last one that can place anything and handing a point forward there drops it. NT)rpop)rrs r<2_prompt_management_sees_a_provisional_message_listrsB  -1F )*9  148 148sA /A AA  text_formatr service_tiersafety_identifierc Kt} tj}d|d<tj||}|||d<|1t j ||jdd\}}}}||d<|jd d} ttdz|jd d}!ttdz|jd d}"|}#t| tr| j|!| rtj|}$t|t!||t#|jd 5| j%||$||!|"|jdd|jdd|d{\}}%}&dddttt&ztj(||$%}||#k7rt+|#||||!}|j-d d&|d<t/t0fid|d|d|d|d|d|d|d|d|d| d| d | d!| d"| d|d#|d$|d%|d&|d'|d(|d)|d*|d+|d|d,|d-||}'t3j4}(t/|(j6|'})|j9d|)d{}*tj:|*r |*d{}+n|*}+t|+t<r7tj>|+|jd.i|/}+||+j@d<|+tCd0|+|+S7#1swYxYw77r#tD$r},t jF|||,||1d},~,wwxYww)2zS Async: Handles responses API requests by reusing the synchronous function TrrrUNrUbase_urlrOapi_baser~litellm_logging_obj prompt_idprompt_variablesrnon_default_paramsrr prompt_labelprompt_versionrOmessagesrrrrrrequest_kwargsr client_input merged_inputoriginal_model swapped_modelr~rr_async_prompt_merged_paramsrurOrvrMrNrwrqrYrZr[r^rxryr_rar1rmrnrprzr{r|r}rrrresponses_api_responserr~z8Got an unexpected None response from the Responses API: rOr~original_exceptioncompletion_kwargs extra_kwargs)$localsasyncioget_event_loopr!convert_text_format_to_text_paramlitellmget_llm_providerr9rstrr8r7LiteLLMLoggingObj"should_run_prompt_management_hooks responses_input_to_chat_messagesrrr async_get_chat_completion_promptrmerge_prompt_management_input _resolve_prompt_swapped_providerrr responses contextvars copy_contextrunrun_in_executor iscoroutiner!/_update_responses_api_response_id_with_model_id_hidden_params ValueError Exceptionexception_type)-rurOrvrMrNrwrqrYrZr[r^rxryr_rUrrar1rmrnrprrrzr{r|r}r~r local_varslooprrrrrrrmerged_optional_paramsfuncctxfunc_with_context init_responserGes- r<rrs7LJI ,,.#|(IIVahlm  !%Jv   &+2+C+CjnnZ&F, (A"Aq1DJ, -&,ZZ0Et%Ld FJJ{D,IJ "&td{FJJ?QSW4X"Y %  !2 !DDymsDt":"["[\a"bLC8.VZZ@Z5[0\ .NN)'-'%5!'ND!A#)::.>#E#)O    * ((((FF#(!-!-E&&F#1"'(;!' '# JJ{D )4JF0 1      &  0    !4 "6    "  $ ! "$# $% &' (") *+ ,(- .$/ 0"1 23 4!45 6&7 80; @!--/#*377D#9%)%9%9$@Q%RR   } -**H$H h 4 5/__'/!',>!C$7H>QH # #$9 :  WX`Wabc ci   R S+&  $$ 3 (    ss MD,L:=L7L8LDLLL L!ALMLL LL L=L88L==MrrrcXtj|d}|jd|jd|S |xstj|d}||k(r|Stjd|d|d|d|d |d |d |d || #tj$r|cYSwxYw)NrOr.api_keyrz prompt_id 'z' swaps model 'z' -> 'z$', which changes the provider from 'z' to 'z' after credentials for 'z3' were already resolved. Refusing to send them to 'z'. Point the request at a model whose provider matches the prompt's metadata.model, or set ignore_prompt_manager_model on the prompt to keep the requested model.)rQrO llm_provider)rrr9BadRequestError)rrr~rrswapped_provideroriginal_providers r<rrss&66]KAN zz)$J)?)G #6#k':R:RYg:hij:k,,  ! !)ON3C6-Y/07G6HI!""UVfUghU U %    " "  sBB)(B)rrc (|jdd}|"|jD] \}} | ||< |||fSttdz|j dd} tt dz|j dd} |} t j|} t|tr|j| |rt|t|||5|j|| || | |j dd|j dd|\}}}dddtttzt j||  }||d <||d <|| k7rt!| |||| }||d <jD] \}} | ||< |||fS#1swY|xYw)NrrrrrrrrrrurOrr~)ritemsrrr9r8rrr7rrrrget_chat_completion_promptrrr)rurOr~rrrr async_mergedkeyvaluerrrrrrs r<*_apply_prompt_management_to_responses_callr's8>zzB_ae7fL&,,. $JC#JsO $e000C$J ;(EFI"4$; ;Mt0TU!N2SSTYZL%'89>Q>t>t?u?@ 4U>%#)#!1#ZZ=%zz*:DA%?   & $ $ $ $ B B$))  $ 7# 7 N ""B-#$7# # 1DJ, -0668 $JC#JsO $ %, ,,Q  s >FFzopenai/chat_completions//_OPENAI_CHAT_COMPLETIONS_RESPONSES_MODEL_PREFIXcr|jts|dfS|ttd}|s|dfSd|dfS)u Strip `openai/chat_completions/` → `openai/` and return True when the prefix was applied (same effect as use_chat_completions_api=True). FNzopenai/T) startswithr(len)rO remainders r<rrsO   K Le|S!PQSTI e| YK $ &&rAc<|jdd}t|S)zQPop use_chat_completions_api; True when the chat-completions bridge is requested.rN)rr)ruse_ccs r< _pop_use_chat_completions_api_kwr/sJJ94@F <rAz responses/_RESPONSES_ROUTING_PREFIXcT|jts|S|ttdS)N)r*r0r+rs r<_strip_responses_routing_prefixr2s*   5 6 ./1 22rAlitellm_paramsc||js||_tj||\}}}}||d<|||_|||_t ||fS)N)rOr3r~)r~rrrrr2)rOr~r3rprovider_modelresolved_providerdynamic_api_keydynamic_api_bases r<%_resolve_model_provider_for_responsesr9s{ &~/Q/Q-@*   %   ):J$%"!0#"2 *> :HT`Iacg>hFJJ|R044T:nrM    2""7  E Jw  Y $ & 64S&[ 12T95A&&;  $ 7 %<rA _is_asyncc ddlm}|j|syid|d|d|d|d |d |d |d |d | d| d| d| d| d|d|d|d|||||||||d|}|r tdi|St tfi|S)zDReturn a response when MCP gateway handles the call; otherwise None.rrr?NrurOrvrMrNrwrqrYrZr[r^rxryr_rUrar1)rmrnrprzr{r|r}r~rr)rr_should_use_litellm_mcp_gatewayrr)r1rurOrvrMrNrwrqrYrZr[r^rxryr_rUrarmrnrprzr{r|r}r~rrArmcp_call_kwargss r<#_responses_try_dispatch_mcp_gatewayrE-s<> % D D5 D Q 7   .  &  H 2  4 Y  j & {  {!" #$ &" 234 5O8&999 5 I IIrAallowed_openai_paramsc! t|r||dus|jryddlm}!ddh}"id|d|d |d |d | d | d | d| d| d|d|d|d|d|d|d|d||||||||||d |rddini|j D#$cic] \}#}$|#|"vs |#|$c}$}#}%| r |!d|||d|%St |!f|||d|%Scc}$}#w)zMReturn a response when emulated file_search handles the call; otherwise None.NTr)$aresponses_with_emulated_file_searchrrrvrMrNrwrqrYrZr[r^rxryr_rUrarmrnrp) rrrrFrzr{r|r}r~r)rurOr1rr)r@supports_native_file_search.litellm.responses.file_search.emulated_handlerrHr"r)&r1rurOrrrvrMrNrwrqrYrZr[r^rxryr_rUrarmrnrprrrrFrzr{r|r}r~rrArH_internal_skipkvemulated_kwargss& r<,_responses_try_dispatch_emulated_file_searchrOssJ ! '%- #t +,HHJ/ =N7  . &  H  2   4 Y  j & {  {  j!" #$%."!6&" 2562J & -r78#LLN FDAqa~.E1a4 F9O<3m%uTYm]lmm ,       Gs  B=B=c 2 t} |jd}|jdd} |jdddu}!t|}"|jd}#t j |t |#tr|#nd}||d <t j|| }|||d <t|\}$}%|$}||d <|"xs|%}"|1tj||jd d\}&}}&}&||d<t|||||||"\}}}tdAi|}'|'jr0t |'jtrt!|'jSt#|||'|\}}t%||||\}}t'dAid|d|d |d|d|d|d|d|d|d|d| d| d| d | d!| d |d"|d#|d$|d%|d |d&|d'|d(|d|d)|d*|!}(|(|(S|d})nt)j*||+})|j-|| 5d,|vr1t/j1|jd,}*|*|*} |*|d<t j2|}+t5dAid|d|d |d-|)d.|"d|d|d|d|d|d|d|d| d| d| d | d!| d |d"|d#|d$|d%|d/|d0|d1|d2|d |d&|d'|d(|d|d)|d*|!},|,|,St7|)|"r(t9j:dA|||+||!| ||||nt<|d3 |S|jd4}-t j>||)|+|t |-t@r|-nd5}.|jC|||t|.i|.|!| |jd6tE||'jFd7|vr|d7n|jdd8|9t jH|}| tKd:tLj;|||)|.||'||||xst<|!|jd;|)jO|| |<|jd7i|jd=>}/t |/tPr7t jR|/|jd7i|?}/||/jTd<|/S#tV$r}0tjX|||0||@d}0~0wwxYw)Bzk Synchronous version of the Responses API. Uses the synchronous HTTP handler to make requests. rrNrFTheaders)rzclient_headersrzrrUrOrrr~)rurOr~rrrrrsrOr~r3r)rur1rrr1rurvrMrNrwrqrYrZr[r^rxryr_rarmrnrpr{r|r}rrArreasoning_effortrrrrrrF) rOruresponses_api_requestr~rAryrzr|r}rF drop_paramsrOrresponse_api_optional_paramsrFrVr<r)rrr<data_residencyrqrrOrpoptional_paramsr3r~2custom_llm_provider is required but passed as Noner+)rOryr~shared_session)rOrur$response_api_optional_request_paramsr~r3 logging_objrzr|r}rAr+ fake_streamrr]rrrr)-rr9rr/rmerge_client_forwarded_headersr7r8rrrrr'r)rBrrtr9r@rEr*rupdater_map_reasoning_effort)get_requested_response_api_optional_paramrOrr0response_api_handlerr!get_optional_params_responses_apirupdate_from_kwargsr&r,_restore_encrypted_content_item_ids_in_inputrbase_llm_http_handlershould_fake_streamr!r rrr)1rurOrvrMrNrwrqrYrZr[r^rxryr_rUrrar1rmrnrprrrzr{r|r}rFr~rrrrrArrR_stripped_model_from_chat_completions_prefixrr3 _mcp_dispatchr_mappedrX_file_search_dispatchrequest_drop_paramsresponses_api_request_paramsrGrs1 r<rrs PJy 8> CX8Y-3ZZ8I4-P!::lE:dB #CF#K & 9 50OO'-7-M>SW '4 ?#(IIVahlm  !%Jv :llq9r66# 7#;#\?\  &+2+C+CjnnZ&F, (A"Aq1DJ, -,V 3 3!%=- )u)!5 >v >  ' 'J~7S7SUX,Y.^=Y=YZ Z%J 3)! & ""6EW]jtu u C      &  0    !4 "6    "  $ ! "$# $% &"' () *(+ ,$- ."/ 01 2!43 45 6 7 :  $   &,0 ),A,c,c,- ) &!  !3z!A;=SST^TbTbcuTvwG"# *1 ;' % N Nz Z %(T"( "( "( "( +H "( &> "(  "( &"( 0"( "( "( !4"( "6"(  "( "( ""( !"( "$#"( $%"( &$'"( ()"( *"+"( ,-"( .&/"( 001"( 2$3"( 4#85"( 6(7"( 8$9"( :";"( <="( >!4?"( @A"( B C"( F ! ,( ( '(EG_ `<QQ &B$7#+%#*#6O&;   &,ZZ %>4L4n4n*G)E"7/9:Mt/T+Z^ 5 $ .. !=>.'#2$jj6"=>QSaSjSj"k;MQW;WV$67]c]g]ghr]s !4 / ")UUV[\  &QR R(==*G1M 3)+'!.::h'5HHF@SI$ZZ(:B?!::&67#> * h 4 5/__'/!',>!C$7H>QH # #$9 :  $$ 3 (    s3E Q.BQ.C(Q.3Q.5E8Q.. R7RRrc 0Kt} tj}d|d<tj|} | j dxs|}| j dxs|}t tf||||||d|} tj} t | j| } |jd| d{} tj| r | d{}|S| }|S7)7 #t$r}tjd||||d}~wwxYww) zz Async version of the DELETE Responses API DELETE /v1/responses/{response_id} endpoint in the responses API Tadelete_responsesrrr~rr~rzr{r|r}Nr)rrrr!_decode_responses_api_response_idr9rdelete_responsesrr r r r rrrrrzr{r|r}r~rrrdecoded_response_idrrrrrGrs r<rsrs@&J& ,,.&*"#9Q8r8r#9 *--m<K 1556KLcPc   # 3'#!    !--/#*377D#9%)%9%9$@Q%RR   } -**H%H S+  $$ 3 (    Y DB/C+=C'>C+C)C+"D#C+&D'C+)C++ D4DDDc t} |jd}|jdd} |jdddu} tdi|} t j |} | jdxs|}| jd xs|}| t d tjd| } | t d ||j||j|dd|id| i| tj||| | ||||xst| |jd|jd }|S#t$r}tj d||||d}~wwxYw)z Synchronous version of the DELETE Responses API DELETE /v1/responses/{response_id} endpoint in the responses API rrNrsFTrtrr~r\rz&DELETE responses is not supported for rrOr[r3r~r+r] rr~rr3r_rzr|r}rAr+r]rrr)rr9rr)rrvrr*rrbrgridelete_response_api_handlerrrrrrrzr{r|r}r~rrrrrAr3ryrrGrs r<rwrw/&JC 8> CX8Y-3ZZ8I4-P!::&95ATI !5 >v >9Q8r8r#9 *--m<K 1556KLcPc  &QR R " C C,  & ) 0EFYEZ[\ \&! ..{"?!4 / 0KK# 3*G)+'!.::h'!::&67L    $$ 3 (    D(D55 E>EEc Kt} tj}d|d<tj|} | j dxs|}| j dxs|}t tf||||||d|} tj} t | j| } |jd| d{} tj| r | d{}n| }t|tr(tj||j di| }|S7`7C#t $r}t#j$d|||| d}~wwxYww) ax Async: Fetch a response by its ID. GET /v1/responses/{response_id} endpoint in the responses API Args: response_id: The ID of the response to fetch. custom_llm_provider: Optional provider name. If not specified, will be decoded from response_id. Returns: The response object with complete information about the stored response. Taget_responsesrtrr~ruNrrr)rrrrrvr9r get_responsesrr r r r r7r!r rrrrxs r<rrsk2J. ,,.#' 9Q8r8r#9 *--m<K 1556KLcPc   # 3'#!    !--/#*377D#9%)%9%9$@Q%RR   } -**H$H h 4 5/__'/!',>!C$7H  S+  $$ 3 (    sN E B/D"=D>D"D AD"E D" D"" E +EE  E c 0t} |jd}|jdd} |jdddu} tdi|} t j |} | jdxs|}| jd xs|}| t d tjd| } | t d ||j||j|dd|id| i| tj||| | ||||xst| |jd|jd }t|tr(t j ||jdi|}|S#t"$r}t%j&d||||d}~wwxYw)aq Fetch a response by its ID. GET /v1/responses/{response_id} endpoint in the responses API Args: response_id: The ID of the response to fetch. custom_llm_provider: Optional provider name. If not specified, will be decoded from response_id. Returns: The response object with complete information about the stored response. rrNrFTrtrr~r\rz#GET responses is not supported for r}r+r]r~rrrrr)rr9rr)rrvrr*rrbrgrirrr7r!r rrrrs r<rrs2JK 8> CX8Y-3ZZ8I4-P!::&6>$F !5 >v >9Q8r8r#9 *--m<K 1556KLcPc  &QR R " C C,  & ) 0BCVBWXY Y&! ..{"?!4 / )66# 3*G)+'!.::h'!::&677   h 4 5/__'/!',>!C$7H   $$ 3 (    sE E-- F6FFafterbeforelimitorder)ascdescc 6Kt} tj} d| d<tj|} | j dxs|}| j dxs|}t tf|||||||||d | } tj}t |j| }| jd|d{}tj|r |d{}|S|}|S7)7 #t$r}tjd||| | d}~wwxYww) z&Async: List input items for a responseTalist_input_itemsrtrr~) rrrrvrrrzr}r~Nr)rrrrrvr9rlist_input_itemsrr r r r rrr)rrrrvrrrzr}r~rrrryrrrrrGrs r<rr<sBJ& ,,.&*"#%=%_%_lw%x)--m<K 1556KLcPc   #' 3    !--/#*377D#9%)%9%9$@Q%RR   } -**H%H S+  $$ 3 (    sY DB2C.C*C.C, C.%D&C.)D*C.,C.. D7DDDc  t} | jd} | jdd} | jdddu} tdi| }t j |}|jdxs|}|jd xs|}| t d tjd| }|t d || j| | j| dd|id| i| tj||||| |||||||xst| | jd| jd}|S#t$r}tj d||| | d}~wwxYw)zList input items for a responserrNrFTrtrr~r\rz&list_input_items is not supported for r}r+r])rr~rr3r_rrrvrrrzr}rAr+r]rrr)rr9rr)rrvrr*rrbrgrilist_responses_input_itemsrrrr)rrrrvrrrzr}r~rrrrrAr3ryrrGrs r<rrtsJ< 8> CX8Y-3ZZ8I4-P!::&95ATI 4 >v >%=%_%_lw%x)--m<K 1556KLcPc  &QR R " C C,  & ) 0EFYEZ[\ \&!..*K8-? 3 / 0JJ# 3*G)+'.::h'!::&67K $  $$ 3 (    sD,D99 E!EE!c 0Kt} tj}d|d<tj|} | j dxs|}| j dxs|}t tf||||||d|} tj} t | j| } |jd| d{} tj| r | d{}|S| }|S7)7 #t$r}tjd||||d}~wwxYww) z Async version of the POST Cancel Responses API POST /v1/responses/{response_id}/cancel endpoint in the responses API Tacancel_responsesrtrr~ruNr)rrrrrvr9rcancel_responsesrr r r r rrrrxs r<rrrzr{c t} |jd}|jdd} |jdddu} tdi|} t j |} | jdxs|}| jd xs|}| t d tjd| } | t d ||j||j|dd|id| i| tj||| | ||||xst| |jd|jd }|S#t$r}tj d||||d}~wwxYw)z Synchronous version of the POST Responses API POST /v1/responses/{response_id}/cancel endpoint in the responses API rrNrFTrtrr~r\rz&CANCEL responses is not supported for r}r+r]r~rrr)rr9rr)rrvrr*rrbrgricancel_response_api_handlerrrrrrs r<rrrrc Kt} tj} d| d<|1tj|| j dd\} }} } || d<t tf|||||||||d | } tj}t |j| }| jd|d{}tj|r |d{}n|}t|tr(tj || j di| }|S7`7C#t"$r}tj$|||| | d}~wwxYww) z Async version of the POST Compact Responses API POST /v1/responses/compact endpoint in the responses API Runs a compaction pass over a conversation, returning encrypted, opaque items. Tacompact_responsesNrrr~) rurOrMrZrzr{r|r}r~rrr)rrrrrr9rcompact_responsesrr r r r r7r!rr rr)rurOrMrZrzr{r|r}r~rrrrrrrrrGrs r<rrYsn.J3 ,,.'+#$  &+2+C+CjnnZ&F, (A"Aq1DJ, -   %!5'#! 3    !--/#*377D#9%)%9%9$@Q%RR   } -**H$H h 4 5/__'/!',>!C$7H  S+  $$ 3 (    sN EB%D3D4DDADEDD E!D;;EEc  t} | jd} | jdd} | jdddu} tdi| }t |||| \}}| t dt j|| }|t d || j| tj| }| jd }tj|||dt|tr|nd }| j| |t|i|| t!||j"d |tj$|}t&j)|||||| ||||xst*| | jd| jd }t|t,r(tj.|| jdi|}|S#t0$r}t3j4|||| | d}~wwxYw)z Synchronous version of the POST Compact Responses API POST /v1/responses/compact endpoint in the responses API Runs a compaction pass over a conversation, returning encrypted, opaque items. rrNrFTrSr\rz'COMPACT responses is not supported for rVrW)rrYr}r+r]) rOrurr^r3r_r~rzr|r}rAr+r]rrrrr)rr9rr)r9rr*rrbrrdrfr7rrgr8r&rrhricompact_response_api_handlerrr!r rrr)rurOrMrZrzr{r|r}r~rrrrrAr3rrXrprqrGrs r<rrsF.J` 8> CX8Y-3ZZ8I4-P!::&:EBdJ !5 >v >%J 3)! & ""  &QR R " C C,  & ) 0FGZF[\] ]&! % N Nz Z % &,ZZ %>4L4n4n*G)E"&/9:Mt/T+Z^ 5 $ .. !=>.#2"=>QSaSjSj"k !4 / )UUV[\)EE*G1M)+ 3'!.::h'!::&67F " h 4 5/__'/!',>!C$7H   $$ 3 (    sF;G G0G++G0ci|jdxsi}|jdxsijdxs|jdxsg}|r||d<|S)Nrrq guardrails)r9)rrqrs r<_build_litellm_metadata_for_wsr's`F += > D"FHJ/52::<HjFJJWcLdjhjJ!+ OrA websocketr,rrclK|jd}|jdd}td i|}td i|} tj|||\} } } } t | }t | | xs|jxstj| d<|j|||i| | d}| *tj|tj| }| xs"|jxstjxsd}| xs=|jxs/tjxstjxs td}hd }|jDcic] \}}||vs ||}}}t!j"d ||||||||jd t%|| d |d{ycc}}w7 w) a  Private function to handle the Responses API WebSocket mode. For PROXY use only. Resolves the LLM provider from ``model``, looks up the matching ``BaseResponsesAPIConfig``, and hands off to ``BaseLLMHTTPHandler.async_responses_websocket``. rrpN)rOrrrYrZrOPENAI_API_KEY> rOrr}rrruser_api_key_dictr~rr) rOrr_rrrr}rrr~rr)r9r)r%rrr2r&rrgr*r LlmProvidersr openai_keyr'r"riasync_responses_websocketr)rOrrrr}rrrpr3litellm_params_dictr5_custom_llm_providerr7r8resolved_modelrresolved_api_baseresolved_api_key_explicit_keysrLrMremaining_kwargss r<_aresponses_websocketr/s$5;JJ?T4U**VT*D0:6:N!3!=f!=      ?) % 0f>3J3JfgN^N^fbf ,  ! ! , ?? ,    , * +  N17 Z1!>BYq!tZZ  9 9 '&C"  **%897?0     [ s$EF4 F,#F,(>F4&F2' F4)aIn a peaceful grove beneath a silver moon, a unicorn named Lumina discovered a hidden pool that reflected the stars. As she dipped her horn into the water, the pool began to shimmer, revealing a pathway to a magical realm of endless night skies. Filled with wonder, Lumina whispered a wish for all who dream to find their own hidden magic, and as she glanced back, her hoofprints sparkled like stardust.)NNNNNNNNNNNNNNNNNNNNNNN)NNNNNNNNNNNNNNNNNNNNNNNNNN)NNNNNNNNNNNNNNNNNNNNNNNNNNN)NNNNN)NNNrNNN)NNNNNNN)NNN)xrrcollections.abcrrrr contextlibr functoolsrtypingr r r r r rhttpxpydanticrrlitellm._loggingrIlitellm.completion_extras.litellm_responses_transformation.transformationrlitellm.constantsr1litellm.integrations.anthropic_cache_control_hookr#litellm.litellm_core_utils.asyncifyr*litellm.litellm_core_utils.litellm_loggingrr8litellm.litellm_core_utils.prompt_templates.common_utilsrr.litellm.llms.base_llm.responses.transformationr*litellm.llms.custom_httpx.llm_http_handlerr;litellm.responses.litellm_completion_transformation.handlerrlitellm.responses.utilsrlitellm.types.llms.openairrrrr r!r"r#r$r-litellm.litellm_core_utils.get_litellm_paramsr%"litellm.llms.openai.data_residencyr&litellm.secret_managers.mainr'litellm.types.responses.mainlitellm.types.routerr) litellm.utilsr*r+fastapir, mcp.typesr-MCPToolstreaming_iteratorr/rir0__annotations__rFrr@rtr>intr8floatTimeoutrrrrr5rrtupler'r(rr/r0r2r9r@rErOrDeleteResponseResultrsrwrrrrrrrrrrrrrAr<rs*CC%EE +.\BSRI=   6LLJ7*5 !)GA+,3Y3[)5[V'#v+*>!?$!FV4Vo11n04#$("&)-'+'+"&" $%)%)(,59/3,0+/,0&*9E # #E E$ % ,E* E Tz E 4  E3;$&EE*E4E $;Et E 4KEE > "E d"!E" I  %#E$ 4<%E&*+d2'E( *)E.V $t+/E0c6k"T)1E2S&[!D(3E4U]] "T )5E8t9E<===EPU#9D#@U\`U U %(4ZKO ,9 cN9 9z99004#$("&)-'+'+"&" $%)37%)(,59#$(/3,0+/,0&*?o # #o o $ % ,o * o Tz o 4  o 3;$&o o *o 4o  $;o t o  4Ko o  > "o k"T)D0!o "d"#o $ I  %%o & 4<'o (*+d2)o * *+o ,*-o .Tz/o 4V $t+5o 6c6k"T)7o 8S&[!D(9o :U]] "T );o >t?o B==Co o dt CK  Tz   :@- # #@- @-t@-+T1 @- cN @- S&[! @-#@- 3# #S#* 45@-H:T/S 'c 'eCQUIFV 'T#v+->4 $05/33333 N NtN)NS&[! N  3d ? N2 # # I  % cNS&[!   3# #Xi%84%? ?@ BCJ I  %CJ # #CJ  CJ $ % , CJ * CJTzCJ 4 CJ3;$&CJCJ*CJ4CJ $;CJt CJ 4KCJ !CJ" #CJ$d"%CJ& 4<'CJ(*+d2)CJ* *+CJ,V $t+-CJ.c6k"T)/CJ0S&[!D(1CJ2U]] "T )3CJ4t5CJ6 f 7CJ89CJ: 4Z;CJLV I  %V # #V  V $:D#@ V # V$ % ,V*VTzV 4 V3;$&VV*V4V $;V t !V" 4K#V$%V& 'V(d")V* 4<+V,*+d2-V. */V0*1V2Tz3V4i4'$.5V6 9t+7V8V $t+9V:c6k"T);V<S&[!D(=V>U]] "T )?V@tAVB f CVDEVFIff6J&JKKdRGVr04#$("&)-'+'+"&" $%)37%)(,59#$(/3,0+/,0.2&*Ab # #b b $ % ,b * b Tz b 4  b 3;$&b b *b 4b  $;b t b  4Kb b  > "b k"T)D0!b "d"#b $ I  %%b & 4<'b (*+d2)b * *+b ,*-b .Tz/b 4V $t+5b 6c6k"T)7b 8S&[!D(9b :U]] "T );b > 9t+?b @tAb b J  /3,0+/,0&*9 9 V $t+ 9 c6k"T) 9 S&[!D( 9 U]] "T )9 t9 9 9 x /3,0+/,0&*V V V $t+ V c6k"T) V S&[!D( V U]] "T )V tV Iff6J&JKKV V r /3,0+/,0&*G G V $t+ G c6k"T) G S&[!D( G U]] "T )G tG G G T /3,0+/,0&*d d V $t+ d c6k"T) d S&[!D( d U]] "T )d td Iff6J&JKKd d N $$*.2,0&*4 4 :4  $J4 #Y  4  4 = ! 4 V $t+4 U]] "T )4 t4  4 4 n $$*.2,0&*J J :J  $JJ #Y  J  J = ! J V $t+J U]] "T )J tJ  Iffd* ++J J Z /3,0+/,0&*9 9 V $t+ 9 c6k"T) 9 S&[!D( 9 U]] "T )9 t9 9 9 x /3,0+/,0&*V V V $t+ V c6k"T) V S&[!D( V U]] "T )V tV Iff6J&JKKV V r $'+/3,0+/,0&*J # #J J *J * J V $t+J c6k"T)J S&[!D(J U]] "T )J tJ J J Z $'+/3,0+/,0&*w # #w w *w * w V $t+w c6k"T)w S&[!D(w U]] "T )w tw Iff6J&JKKw w ~4D  Z ZZDjZ4Z Z T\ ZZrA