uPj<ddlmZmZmZddlmZmZddlZddlZddl m Z ddl m Z ddl mZddlmZmZddlmZdd lmZdd lmZdd lmZdd lmZmZmZmZd dlm Z m!Z!Gdde!Z"Gdde Z#y)) AsyncIteratorIteratorMapping)AnyFinalN)verbose_logger) XAI_API_BASE)AuthenticationError)filter_value_from_dictstrip_name_from_messages) XAIModelInfo)-apply_server_side_tool_usage_details_to_usage)get_secret_str)AllMessageValues)Choices ModelResponseModelResponseStreamUsage)$OpenAIChatCompletionStreamingHandlerOpenAIGPTConfigceZdZededzfdZdedzdedzdeedzedzffdZ d&deded e e d ed ededzdedzdeffd Z d'dedzdedzded ed ed e dzdeffd Z dede fdZdede fdZdede fdZ d(ded edede def dZ d(deeeezezde de dzdefdZded e e d ed ededef fd ZededdfdZ d&dedej8deded e e d ed ededzde dzdeffd Zed eezeeefzdzddfd!Zded"eddfd#Z ed$eeeefzdzddfd%Z!xZ"S)) XAIChatConfigreturnNcy)Nxai)selfs i/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/xai/chat/transformation.pycustom_llm_providerz!XAIChatConfig.custom_llm_provider"sapi_baseapi_keycb|xstdxst}tj|}||fS)Nr )rr r get_api_key)rr"r#dynamic_api_keys r$_get_openai_compatible_provider_infoz2XAIChatConfig._get_openai_compatible_provider_info&s3M~n=M!-!9!9'!B((r!headersmodelmessagesoptional_paramslitellm_paramsc >ddlm}m} m} t j |} | |r-| s+ d|j |d<d|vr d|vrd |d<|St |-|||||| | S#| $r+} t||jxsdt| | d} ~ wwxYw) Nr)XAIOAuthAuthenticator XAIOAuthErrorshould_use_xai_oauthzBearer Authorizationr)r) llm_providermessagez content-typez Content-Typezapplication/json)r(r)r*r+r,r#r") litellm.llms.xai.oauthr.r/r0r r%get_access_tokenr r strsupervalidate_environment)rr(r)r*r+r,r#r"r.r/r0r&exc __class__s rr8z"XAIChatConfig.validate_environment-s  ".!9!9'!B  / -45J5L5]5]5_4`+a(W,w1N*<'Nw++)#,  ! )!%!9!9!BUH  sA,,B1&BBstreamcddlm}m}tj|} ||r| s|j }t ||| ||||S)Nr)r.r0)r"r#r)r+r,r;)r4r.r0r r% get_api_baser7get_complete_url) rr"r#r)r+r,r;r.r0r&r:s rr>zXAIChatConfig.get_complete_urlUs] W!-!9!9'!B  /,.;;=Hw'#+) (  r!cVgd}|j|r|jd|j|r|jd tj||j r|jd|S#t $r!}tjd|Yd}~|Sd}~wwxYw)N) logit_biaslogprobs max_tokensnparallel_tool_callspresence_penaltyresponse_formatseedr;stream_options temperature tool_choicetools top_logprobstop_puserweb_search_optionsstopfrequency_penalty)r)r reasoning_effortz.Error checking if model supports reasoning: %s) _supports_stop_reasonappend_supports_frequency_penaltylitellmsupports_reasoningr Exceptionrdebug)rr)base_openai_paramses rget_supported_openai_paramsz)XAIChatConfig.get_supported_openai_paramsms% .  % %e ,  % %f -  + +E 2  % %&9 :  V))4KcKcd"))*<="! V  !QST U U!! Vs 2A>> B(B##B(cd|vsd|vsd|vryy)Nz grok-3-minigrok-4grok-code-fastFTrrr)s rrSz#XAIChatConfig._supports_stop_reasons E !X%6:Je:Sr!cd|vryd|vryy)z From manual testing grok-4 does not support `frequency_penalty` When sent the model fails from xAI API r^Fr_Trr`s rrUz)XAIChatConfig._supports_frequency_penaltys u  u $r!non_default_params drop_paramsc|j|}|jD]b\}}|dk(r||d<|dk(r@|>g}|D]"} t| d} | |j| $t |dkDsP||d<V||vs[|^|||<d|S)N)r)max_completion_tokensrBrKstrictr)r\itemsr rTlen) rrbr+r)rcsupported_openai_paramsparamvaluerKtools rmap_openai_paramszXAIChatConfig.map_openai_paramss*.)I)IPU)I)V.446 3LE5//05 -'!e&7!+D1$AD' T*+u:>/4OG,11$-2OE* 3r!streaming_response sync_stream json_modect|||S)N)rnrorp)!XAIChatCompletionStreamingHandler)rrnrorps rget_model_response_iteratorz)XAIChatConfig.get_model_response_iterators 11#  r!c@t|}t| |||||S)zp Handle https://github.com/BerriAI/litellm/issues/9720 Filter out 'name' from messages )r r7transform_request)rr)r*r+r,r(r:s rruzXAIChatConfig.transform_requests(,H5w(/>[bccr!choicec|jdk(rB|jjr+t|jjdkDrd|_yyyy)z Helper to fix finish_reason for tool calls when XAI API returns empty string. XAI API returns empty string for finish_reason when using tools, so we need to set it to "tool_calls" when tool_calls are present. r tool_callsN) finish_reasonr3ryrh)rvs r(_fix_choice_finish_reason_for_tool_callsz6XAIChatConfig._fix_choice_finish_reason_for_tool_callssJ   2 %&..*C*CFNNLeLeHfijHj#/F Ik*C %r! raw_responsemodel_response request_datac t|||||||||| | |  } | jr3| jD]$} t| ts|j | & |j }|j| ||j| |jt| dd| S#t$r }tjd|Yd}~Sd}~wwxYw)a Transform the response from the XAI API. XAI API returns empty string for finish_reason when using tools, so we need to fix this after the standard OpenAI transformation. Also handles X.AI web search usage tracking. ) r)r|r} logging_objr~r*r+r,encodingr#rpz*Error extracting X.AI web search usage: %sNusage)r7transform_responsechoices isinstancerr{json)_enhance_usage_with_xai_web_search_fieldsrXrrY&_fold_reasoning_tokens_into_completion)_normalize_openai_compatible_usage_totalsgetattr)rr)r|r}rr~r*r+r,rr#rpresponservraw_response_jsonr[r:s rrz XAIChatConfig.transform_responses0 '4%)#%+)5     "** Jfg.AA&I J  R'3'8'8':   : :8EV W 33H= 66wxRV7WX  R  !Mq Q Q Rs"B-- C6CCtargetcd|yt|trt|dd}n|}|yt|tr|j dxsi}t|trt |j dxsd}nt t|ddxsd}|dkryt |j dxsd}t |j dxsd}t |j dxsd}|||zk(ry|||z|zk7ry||z|d<yt|dd}|rt t|ddxsdnd}|dkryt t|ddxsd}t t|ddxsd}t t|ddxsd}|||zk(ry|||z|zk7ry||z|_y) a Reconcile xAI Usage to the OpenAI invariant. xAI accounts ``reasoning_tokens`` separately from ``completion_tokens`` while still summing them into ``total_tokens``. OpenAI's contract (o1/o3) folds reasoning into ``completion_tokens``, so fold here to keep ``total = prompt + completion``. Idempotent. Accepts a ``ModelResponse`` (non-streaming), a ``Usage`` object, or a raw usage ``dict`` (streaming chunk) so streaming and non-streaming paths stay in sync. Nrcompletion_tokens_detailsreasoning_tokensr prompt_tokenscompletion_tokens total_tokens)rrrdictgetintr)rrdetailsrrrrs rrz4XAIChatConfig._fold_reasoning_tokens_into_completion s >  fm ,3:67D3QEE =  eT "ii ;<BG'4(#&w{{3E'F'K!#L #&ww8JA'N'SRS#T 1$ / : ?a@M #EII.A$B$Ga H uyy8=A>L}/@@@}/@@CSSS):=M)ME% & %!C!D /BA F K!L75.!<AB =+<< <  =+<3G3G3O ,22 1 5 5g >.$/ '++,LM gw ' 9% I  !JG T (r!rc|yt|trht|jdxsd}t|jdxsd}||z}t|jdxsd|kr||d<yt|jxsd}t|j xsd}||z}t|j xsd|kr||_yy)Nrrrr)rrrrrrr)rrrexpected_totals rrz7XAIChatConfig._normalize_openai_compatible_usage_totalsss =  eT " / : ?a@M #EII.A$B$Ga H *->>N599^,12^C(6n% E//415  7 7 <1=&):: u!!&Q '. 8!/E  9r!)NN)N)F)#__name__ __module__ __qualname__propertyr6r tupler'rlistrr8boolr>r\rSrUrmrrrrrsru staticmethodrr{httpxResponserrrrr __classcell__r:s@rrr!s\ S4Z)d )-04Z) sTz3:% &)##& & & '( &  &  & t& *&  & ^# * t       t    0*"*"*"X34   ""       8"'  $SMM#,>>N    $;   dd'(d d  d  d d 00T00*#!%55nn5& 5  5'(555t5$;5 5n?G%S#X6=?G ?G?GBU UjnUswU"0tCH~%,0 00r!rc(eZdZdedeffd ZxZS)rrchunkrc|jdg}t|dk(rd|vr diddg|d<d|vr5|d0tj|dtj |dt ||S)a Handle xAI-specific streaming behavior. xAI Grok sends a final chunk with empty choices array but with usage data when stream_options={"include_usage": True} is set. Example from xAI API: {"id":"...","object":"chat.completion.chunk","created":...,"model":"grok-4-1-fast-non-reasoning", "choices":[],"usage":{"prompt_tokens":171,"completion_tokens":2,"total_tokens":173,...}} rrrN)indexdeltarz)rrhrrrr7 chunk_parser)rrrr:s rrz.XAIChatCompletionStreamingHandler.chunk_parsers9b1 w<1 E!1+,b4 PQE)  e g :  @ @w P  C CE'N Sw#E**r!)rrrrrrrrs@rrrrrs+$++>++r!rr)$collections.abcrrrtypingrrrrVlitellm._loggingrlitellm.constantsr litellm.exceptionsr 8litellm.litellm_core_utils.prompt_templates.common_utilsr r litellm.llms.xai.common_utilsr litellm.llms.xai.cost_calculatorrlitellm.secret_managers.mainrlitellm.types.llms.openairlitellm.types.utilsrrrropenai.chat.gpt_transformationrrrrrrr!rrs_<< +*2786 c0Oc0L +(L+r!