uPj;dZddlZddlmZmZddlmZmZddlm Z m Z m Z m Z ddl Z ddlmZddlmZmZddlmZmZdd lmZmZmZmZmZe rddlZdd lmZdd lm Z d d l!m"Z"m#Z#e r ddl$m%Z&e&Z'ne Z'Gdde(Z)GddeZ*y)z* Common base config for all LLM providers N)ABCabstractmethod) AsyncIteratorIterator) TYPE_CHECKINGAnyFinalUnion) BaseModel)DEFAULT_MAX_TOKENSRESPONSE_FORMAT_TOOL_NAME)AsyncHTTPHandler HTTPHandler)AllMessageValues%ChatCompletionToolChoiceFunctionParam#ChatCompletionToolChoiceObjectParamChatCompletionToolParam$ChatCompletionToolParamFunctionChunk)CustomStreamWrapper) ModelResponse)!map_developer_role_to_system_roletype_to_response_format_param)LoggingceZdZ d dededeejzdzdejdzdejdzdedzde ffd Z xZ S) BaseLLMExceptionN status_codemessageheadersrequestresponsebodystatus_code_is_synthesizedc*||_||_||_||_|r||_nt j dd|_|r||_n&t j||j|_||_ t|-|jy)NPOSTzhttps://docs.litellm.ai/docs)methodurl)rr ) rr#rrr httpxRequestr!Responser"super__init__) selfrrrr r!r"r# __class__s n/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/base_llm/chat/transformation.pyr,zBaseLLMException.__init__+sx'*D'#  "DL ==Z3 dOd eded-e'd#ed!ed:eded;e4e2zdzd0e dzd)r-rUs r/is_max_tokens_in_requestz#BaseConfig.is_max_tokens_in_requestes11b5LPb5bbr0optional_paramsc|j|}|rNd|vrId|vrD|jd}t|tr|jdnd}| |tz|d<yyyyy)a Handles scenario where max tokens is not specified. For anthropic models (anthropic api/bedrock/vertex ai), this requires having the max tokens being set and being greater than the thinking token budget. Checks 'non_default_params' for 'thinking' and 'max_tokens' if 'thinking' is enabled and 'max_tokens' or 'max_completion_tokens' is not specified, set 'max_tokens' to the thinking token budget + DEFAULT_MAX_TOKENS r_r`rW budget_tokensN)r]r[rEr6r )r-rUrbr]thinking_valuethinking_token_budgets r/+update_optional_params_with_thinking_tokensz6BaseConfig.update_optional_params_with_thinking_tokensks&*%=%=o%N   2 27NVh7h$3$7$7 $CN7A.RV7W""?3]a "%00EHZ0Z -1 8i 2 r0modelstreamcustom_llm_providercy)zG Returns True if the model/provider should fake stream Fr>)r-rhrirjs r/should_fake_streamzBaseConfig.should_fake_stream~sr0toolsc4d|vr||d<|Sg|d||d<|S)z> Helper util to add tools to optional_params. rmr>)r-rbrms r/_add_tools_to_optional_paramsz(BaseConfig._add_tools_to_optional_paramssG / )',OG $  ( )((OG $r0messagesct|S)zz Translate `developer` role to `system` role for non-OpenAI providers. Overriden by OpenAI/Azure )rp)r)r-rps r/'translate_developer_role_to_system_rolez2BaseConfig.translate_developer_role_to_system_roles1(CCr0elitellm_paramscy)z Returns True if the model/provider should retry the LLM API on UnprocessableEntityError Overriden by azure ai - where different models support different parameters Fr>)r-rsrts r/9should_retry_llm_api_inside_llm_translation_on_http_errorzDBaseConfig.should_retry_llm_api_inside_llm_translation_on_http_errorsr0 request_datac|S)zH Transform the request data on UnprocessableEntityError r>)r-rsrws r//transform_request_on_unprocessable_entity_errorz:BaseConfig.transform_request_on_unprocessable_entity_errors r0cy)z Returns the max retry count for UnprocessableEntityError Used if `should_retry_llm_api_inside_llm_translation_on_http_error` is True rr>r?s r/'max_retry_on_unprocessable_entity_errorz2BaseConfig.max_retry_on_unprocessable_entity_errorsr0cyr=r>)r-rhs r/get_supported_openai_paramsz&BaseConfig.get_supported_openai_params r0valueis_response_format_supportedenforce_tool_choicec"d}d|vr|d}n d|vr|dd}|rm|sktdtt}tdt t|}|j d g|d j ||r||d <d |d <|S|r||d <|S)u Follow similar approach to anthropic - translate to a single tool call. When using tools in this way: - https://docs.anthropic.com/en/docs/build-with-claude/tool-use#json-mode - You usually want to provide a single tool - You should set tool_choice (see Forcing tool use) to instruct the model to explicitly use that tool - Remember that the model will pass the input to the tool, so the name of the tool and description should be from the model’s perspective. Add response format to tools This is used to translate response_format to a tool call, for models/APIs that don't support response_format directly. Nresponse_schema json_schemaschemafunction)name)rXr)r parametersrm tool_choiceT json_moderQ)rrr rr setdefaultappend)r-rbrrrr _tool_choice_tools r/_add_response_format_to_toolsz(BaseConfig._add_response_format_to_toolss&$(  % 12K e # .x8K ;"E>D]^#L 3=C\ituE  & &w 3 G $ + +E 2"1= .+/OK (*16O- .r0 drop_paramscyr=r>)r-rUrbrhrs r/map_openai_paramszBaseConfig.map_openai_paramss r0rapi_keyapi_basecyr=r>)r-rrhrprbrtrrs r/validate_environmentzBaseConfig.validate_environments r0 fake_streamc  |dfS)a0 Some providers like Bedrock require signing the request. The sign request funtion needs access to `request_data` and `complete_url` Args: headers: dict optional_params: dict request_data: dict - the request body being sent in http request api_base: str - the complete url being sent in http request Returns: dict - the signed headers Update the headers with the signed headers in this function. The return values will be sent as headers in the http request. Nr>) r-rrbrwrrrhrirs r/ sign_requestzBaseConfig.sign_requests.}r0c | td|S)z{ OPTIONAL Get the complete url for the request Some providers need `model` in `api_base` zapi_base is required) ValueError)r-rrrhrbrtris r/get_complete_urlzBaseConfig.get_complete_urls  34 4r0cyr=r>r-rhrprbrtrs r/transform_requestzBaseConfig.transform_request0s r0c6K|j|||||Sw)z Override to allow for http requests on async calls - e.g. converting url to base64 Currently only used by openai.py )rhrprbrtr)rrs r/async_transform_requestz"BaseConfig.async_transform_request;s/%%+) &  s raw_responsemodel_responser logging_objencodingztiktoken.Encoding | Nonerc yr=r>) r-rhrrrrwrprbrtrrrs r/transform_responsezBaseConfig.transform_responsePs r0parsed_responsec|S)a Repair a parsed OpenAI-format response dict before generic conversion. Providers routed through the OpenAI SDK handler bypass transform_response, which calls convert_to_model_response_object directly on the SDK's parsed output. Override this to normalize a malformed response (e.g. github_copilot returning empty choices for Anthropic-native Claude responses). r>)r-rs r/transform_parsed_response_dictz)BaseConfig.transform_parsed_response_dictas r0 error_messagercyr=r>)r-rrrs r/get_error_classzBaseConfig.get_error_classlr~r0streaming_response sync_streamcyr=r>)r-rrrs r/get_model_response_iteratorz&BaseConfig.get_model_response_iteratorps r0dataclientsigned_json_bodyrc Ktwr=NotImplementedError r-rhrjrrrrrprrrs r/get_async_custom_stream_wrapperz*BaseConfig.get_async_custom_stream_wrapperxs"!s c tr=rrs r/get_sync_custom_stream_wrapperz)BaseConfig.get_sync_custom_stream_wrappers "!r0cyr=r>r?s r/rjzBaseConfig.custom_llm_providersr0cy)NFr>r?s r/has_custom_stream_wrapperz$BaseConfig.has_custom_stream_wrappersr0cy)z Some providers like Bedrock invoke do not support the stream parameter in the request body. By default, this is true for almost all providers. Tr>r?s r/%supports_stream_param_in_request_bodyz0BaseConfig.supports_stream_param_in_request_bodysr0c|S)zNHook for providers to post-process streaming responses. Default: pass-through.r>)r-ris r/post_stream_processingz!BaseConfig.post_stream_processings r0r!chunkscy)zNHook for providers to merge chunk metadata into assembled streaming responses.Nr>)r-r!rs r/+apply_assembled_streaming_response_metadataz6BaseConfig.apply_assembled_streaming_response_metadatas r0 prompt_tokenscompletion_tokenscy)a Calculate any additional costs beyond standard token costs. This is used for provider-specific infrastructure costs, routing fees, etc. Args: model: The model name prompt_tokens: Number of prompt tokens completion_tokens: Number of completion tokens Returns: Optional dictionary with cost names and amounts, e.g.: {"Infrastructure Fee": 0.001, "Routing Cost": 0.0005} Returns None if no additional costs apply. Nr>)r-rhrrs r/calculate_additional_costsz%BaseConfig.calculate_additional_costss r0r=)T)NN)NNNN)F)NNN)r0r/r;r;Es    &NDOVZDZ]aDaNfjmqfqNxdxtx c4cDc [d[ei[.+/ Tz t  !4Z    T $ SW  D'( D   D&&8< AVAVfjos     %) ,,,'+ , " ,  ,\           ##      '(      t  *       $# "#'    t Tzt D[ tUT\! "@#*t     t  (  '(            '(         *#!%  nn (  '    '(   - t $;    d t  S s TTYTaTaMa fv  "'  !(3-s1C_"TU  $;   "+/!%)- " "! "' "  "  " " "!4' "$; " $, "  "09=!%)- " "! "' "  "  " " "..5 "$; " $, "  "S4Z4tSS!S   C\_dhkodor0r;)+__doc__rFabcrrcollections.abcrrtypingrrr r r(pydanticr litellm.constantsr r &litellm.llms.custom_httpx.http_handlerrrlitellm.types.llms.openairrrrrtiktoken,litellm.litellm_core_utils.streaming_handlerrlitellm.types.utilsr base_utilsrr*litellm.litellm_core_utils.litellm_loggingr_LiteLLMLoggingObjr Exceptionrr;r>r0r/rsr #333 KPP1 X*'y'6~~r0