uPj7ddlmZmZmZddlmZmZddlZddlm Z m Z ddl m Z ddl mZddlmZddlmZmZdd lmZd d lmZd d lmZd dlmZddlmZer ddlZddlm Z!e!Z"neZ"GddeZ#y)) TYPE_CHECKINGAnyFinal)HeadersResponseN),drop_tool_reference_parts_from_tool_messageshoist_images_from_tool_messages) convert_to_azure_openai_messages)BaseLLMException)GPT_REASONING_SERIES_MARKERS)+API_VERSION_MONTH_SUPPORTED_RESPONSE_FORMAT*API_VERSION_YEAR_SUPPORTED_RESPONSE_FORMAT) ModelResponse)UnsupportedParamsError)AllMessageValues) BaseConfigAzureOpenAIError)LoggingcJeZdZdZ d2dedzdeezdzdedzdedzdedzdedzd edzd eezdzd edzd edzd dfdZe fdZ ded eefdZ e ded e fdZ ded e fdZdeded e fdZ d3dededede ded ef dZdedeedededed ef dZ d4ded ed!ed"ed#edeededed$d%d&edzd'e dzd efd(Zd efd)Zdedefd*Zd eefd+Zd eefd,Zd-ed.edeezd efd/Z d4dededeededed&edzd0edzd efd1ZxZS)5AzureOpenAIConfigaR Reference: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chat-completions The class `AzureOpenAIConfig` provides configuration for the OpenAI's Chat API interface, for use with Azure. Below are the parameters:: - `frequency_penalty` (number or null): Defaults to 0. Allows a value between -2.0 and 2.0. Positive values penalize new tokens based on their existing frequency in the text so far, thereby minimizing repetition. - `function_call` (string or object): This optional parameter controls how the model calls functions. - `functions` (array): An optional parameter. It is a list of functions for which the model may generate JSON inputs. - `logit_bias` (map): This optional parameter modifies the likelihood of specified tokens appearing in the completion. - `max_tokens` (integer or null): This optional parameter helps to set the maximum number of tokens to generate in the chat completion. - `n` (integer or null): This optional parameter helps to set how many chat completion choices to generate for each input message. - `presence_penalty` (number or null): Defaults to 0. It penalizes new tokens based on if they appear in the text so far, hence increasing the model's likelihood to talk about new topics. - `stop` (string / array / null): Specifies up to 4 sequences where the API will stop generating further tokens. - `temperature` (number or null): Defines the sampling temperature to use, varying between 0 and 2. - `top_p` (number or null): An alternative to sampling with temperature, used for nucleus sampling. Nfrequency_penalty function_call functions logit_bias max_tokensnpresence_penaltystop temperaturetop_preturnc tj} | jD]%\} } | dk7s | t|j| | 'y)Nself)localscopyitemssetattr __class__)r'rrrrrr r!r"r#r$locals_keyvalues o/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/azure/chat/gpt_transformation.py__init__zAzureOpenAIConfig.__init__?sF !--/ 4JCf}!2U3 4c t|SN)super get_config)clsr,s r0r6zAzureOpenAIConfig.get_configQsw!##r2modelc gdS)N)r#r streamstream_optionsr"rmax_completion_tokenstools tool_choicer!rruserrrr=r>r$logprobs top_logprobsresponse_formatseed extra_headersparallel_tool_calls prediction modalitiesaudioweb_search_optionsprompt_cache_keystore)r'r8s r0get_supported_openai_paramsz-AzureOpenAIConfig.get_supported_openai_paramsUs   r2c@tfdtDxsdvS)acWhether Azure rejects the legacy ``max_tokens`` key for this deployment. Deliberately wider than ``AzureOpenAIGPT5Config.is_model_gpt_5_model``: the whole gpt-5 name family needs the rename, including the ``gpt-5-chat*`` models that are excluded from the reasoning path by https://github.com/BerriAI/litellm/issues/13781. c3&K|]}|v ywr4rL).0markerr8s r0 zCAzureOpenAIConfig.requires_max_completion_tokens..sNv6U?Ns gpt5_series)anyr )r7r8s `r0requires_max_completion_tokensz0AzureOpenAIConfig.requires_max_completion_tokensws#N1MNNhR_chRhhr2cDddl}|jdd|}d|vsd|vryy) aj Determines if the model supports response_format. - Handles Azure deployment names (e.g., azure/gpt-4.1-suffix) - Normalizes model names (e.g., gpt-4-1 -> gpt-4.1) - Strips deployment-specific suffixes - Passes provider to supports_response_schema - Backwards compatible with previous model name patterns rNz (\d)-(\d)z\1.\2zgpt-3.5zgpt-35FT)resub)r'r8rWnormalized_models r0#_is_response_format_supported_modelz5AzureOpenAIConfig._is_response_format_supported_models2 #%&&x"G ( (H,=r2api_version_yearapi_version_monthct|}t|}tt}tt}||kDry||kry||k\S)z - check if api_version is supported for response_format - returns True if the API version is equal to or newer than the supported version TF)intrr )r'r[r\api_year api_monthsupported_yearsupported_months r0)_is_response_format_supported_api_versionz;AzureOpenAIConfig._is_response_format_supported_api_versionsU ./01 #$N O!$%P!Q n $  &/ /r2non_default_paramsoptional_params drop_params api_versionc |j|}|j|}|jd}t|dk\r|d} |d} |d} nd} d} d} |j D]b\} } | dk(r|r|j d| !| dk(r | | | | |d<3| d ks| d k(r| d ks| d k(r4| d k(r/| d kr*t jd us||d urjtd d|d| dk(r:| dk(r5| dkr0t jd us||d urtd d| d| d|d| |d<| dk(rVt| trF|j|}| | d }n|j| | }|xr|}|j|| |}| dk(r8t| tr(|j dg|dj| X| |vs^| || <e|S)N-rrrrr<r>20231201Tiz6Azure does not support 'tool_choice', for api_version=z. Bump your API version to '2023-12-01-preview' or later. This parameter requires 'api_version="2023-12-01-preview"' or later. Azure API Reference: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chat-completions) status_codemessagerequired202405zAzure does not support 'z' as a z param, for api_version=a. To drop 'tool_choice=required' for calls with this Azure API version, set `litellm.drop_params=True` or for proxy: `litellm_settings: drop_params: true` Azure API Reference: https://learn.microsoft.com/en-us/azure/ai-services/openai/reference#chat-completionsrB)rer/is_response_format_supportedr=)rMrUsplitlenr* setdefaultlitellmrfr isinstancedictrZrc_add_response_format_to_toolslistextend)r'rdrer8rfrgsupported_openai_paramsrenames_max_tokensapi_version_timesr[r\api_version_dayparamr/rZ(is_response_format_supported_api_versionrss r0map_openai_paramsz#AzureOpenAIConfig.map_openai_paramss*.)I)I%)P$($G$G$N#.#4#4S#9  !Q &03  1! 4 /2O#  $ "O.446; /LE5 $);**+BEJ-' $+/@/HOLc5:OM2)61,6;Lt;S,6;LPT;TYhkoYo"..$6;;RWbfjWj "8,/,bcnbopY)\#*,(F27HD7P"..$6;;RWbfjWj "8,/*B5'QVPWWop{o|}H)I# :? 6++ 5$0G6:6^6^_d6e3#+/@/H?Crs[,,+GV.126+W$LLh h r2