uPj6dZddlmZmZmZddlZddlmZddlm Z ddl m Z m Z ddl mZddlmZerddlZdd lmZdd lmZmZeZneZeZeZGd d e ZGd de Zy)an Transformation for Azure Foundry Agent Service API. Azure Foundry Agent Service provides an Assistants-like API for running agents. This follows the OpenAI Assistants pattern: create thread -> add messages -> create/poll run. Model format: azure_ai/agents/ API Base format: https://.services.ai.azure.com/api/projects/ Authentication: Uses Azure AD Bearer tokens (not API keys) Get token via: az account get-access-token --resource 'https://ai.azure.com' The API uses these endpoints: - POST /threads - Create a thread - POST /threads/{thread_id}/messages - Add message to thread - POST /threads/{thread_id}/runs - Create a run - GET /threads/{thread_id}/runs/{run_id} - Poll run status - GET /threads/{thread_id}/messages - List messages in thread See: https://learn.microsoft.com/en-us/azure/ai-foundry/agents/quickstart ) TYPE_CHECKINGAnyFinalN)verbose_logger)convert_content_list_to_str) BaseConfigBaseLLMException)AllMessageValues) ModelResponse)Logging)AsyncHTTPHandler HTTPHandlerceZdZdZy)AzureAIAgentsErrorz6Exception class for Azure AI Agent Service API errors.N)__name__ __module__ __qualname____doc__p/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/azure_ai/agents/transformation.pyrr1s@rrceZdZdZdZdZdZfdZede de fdZ ede de fd Z d e d zd e d zde e d ze d zffd Zde dee fdZdedede de def dZdede fdZ d.d e d zd e d zde dedede d zde fdZde dede fdZde deededededef dZ d/dede deededed e d zd e d zdefdZde dedeej6zdefdZ d.de d zde d zde d zde fd Zede fd!Z ede fd"Z! d/de d#ejDd$e#d%e$d&edeededed'd(d e d zd)e d zde#fd*Z%e d0de ded e d e d zd$e#d%e$deded+e&e'zd,e de d zded zde'fd-Z(xZ)S)1AzureAIAgentsConfiga Configuration for Azure AI Agent Service API. Azure AI Agent Service is a fully managed service for building AI agents that can understand natural language and perform tasks. Model format: azure_ai/agents/ The flow is: 1. Create a thread 2. Add user messages to the thread 3. Create and poll a run 4. Retrieve the assistant's response messages z 2025-05-01<g?c $t|di|y)Nr)super__init__)selfkwargs __class__s rrzAzureAIAgentsConfig.__init__Ns "6"rmodelreturnc d|vS)zs Check if the model is an Azure AI Agents route. Model format: azure_ai/agents/ agents/r)r!s ris_azure_ai_agents_routez,AzureAIAgentsConfig.is_azure_ai_agents_routeQsE!!rcXd|vr%|jdd}t|dk(r|dS|S)z Extract agent ID from the model string. Model format: azure_ai/agents/ -> or: agents/ -> r$)splitlen)r!partss rget_agent_id_from_modelz+AzureAIAgentsConfig.get_agent_id_from_modelZs5   ;;y!4E5zQQx rapi_baseNapi_keycFddlm}|xs|d}|xs|d}||fS)z Get Azure AI Agent Service API base and key from params or environment. Returns: Tuple of (api_base, api_key) r)get_secret_strAZURE_AI_API_BASEAZURE_AI_API_KEY)litellm.secret_managers.mainr0)rr-r.r0s r$_get_openai_compatible_provider_infoz8AzureAIAgentsConfig._get_openai_compatible_provider_infois3 @B~.AB?^,>?  rcdgS)zZ Azure Agents supports minimal OpenAI params since it's an agent runtime. streamr)rr!s rget_supported_openai_paramsz/AzureAIAgentsConfig.get_supported_openai_params{s zrnon_default_paramsoptional_params drop_paramsc|S)z; Map OpenAI params to Azure Agents params. r)rr8r9r!r:s rmap_openai_paramsz%AzureAIAgentsConfig.map_openai_paramss rc:|jd|jS)z4Get API version from optional params or use default. api_version)getDEFAULT_API_VERSION)rr9s r_get_api_versionz$AzureAIAgentsConfig._get_api_versions""=$2J2JKKrlitellm_paramsr6cB| td|jd}|S)ay Get the base URL for Azure AI Agent Service. The actual endpoint will vary based on the operation: - /openai/threads for creating threads - /openai/threads/{thread_id}/messages for adding messages - /openai/threads/{thread_id}/runs for creating runs This returns the base URL that will be modified for each operation. zeapi_base is required for Azure AI Agents. Set it via AZURE_AI_API_BASE env var or api_base parameter./) ValueErrorrstrip)rr-r.r!r9rBr6s rget_complete_urlz$AzureAIAgentsConfig.get_complete_urls1&  w  ??3'rct|jdxs|jd}|r|S|j|S)z Get the agent ID from model or optional_params. model format: "azure_ai/agents/" or "agents/" or just "" agent_id assistant_id)r?r,)rr!r9rIs r _get_agent_idz!AzureAIAgentsConfig._get_agent_ids@ *--j9`_=P=PQ_=` O++E22rmessagesheadersc|j||}g}|D]p}|jdd} |jdd} t| tr t |} t| t s t | } |j | | dr|||j|d} d|vr|d| d<d|vr|d| d<tjd | | S) z Transform the request for Azure Agents. This stores the necessary data for the multi-step agent flow. The actual API calls happen in the custom handler. roleusercontent)rOrQ)rIrLr> thread_id instructionsz#Azure AI Agents request payload: %s) rKr? isinstancelistrstrappendrArdebug) rr!rLr9rBrMrIconverted_messagesmsgrOrQpayloads rtransform_requestz%AzureAIAgentsConfig.transform_requests,,UOD%' JC7766*Dggi,G'4(5c:gs+g,  % %t&H I J!*00A*  / )#2;#?GK  _ ,&5n&EGN #BGLrc$d|d<|rd||d<|S)aQ Validate and set up environment for Azure Foundry Agents requests. Azure Foundry Agents uses Bearer token authentication with Azure AD tokens. Get token via: az account get-access-token --resource 'https://ai.azure.com' See: https://learn.microsoft.com/en-us/azure/ai-foundry/agents/quickstart zapplication/jsonz Content-TypezBearer Authorizationr)rrMr!rLr9rBr.r-s rvalidate_environmentz(AzureAIAgentsConfig.validate_environments)$#5 )0 ':GO $r error_message status_codect||S)N)rbmessage)r)rrarbrMs rget_error_classz#AzureAIAgentsConfig.get_error_classs!k=QQrcustom_llm_providercy)z_ Azure Agents uses polling, so we fake stream by returning the final response. Tr)rr!r6rfs rshould_fake_streamz&AzureAIAgentsConfig.should_fake_stream srcy)z>Azure Agents doesn't have native streaming - uses fake stream.Frrs rhas_custom_stream_wrapperz-AzureAIAgentsConfig.has_custom_stream_wrappersrcy)zK Azure Agents does not use a stream param in request body. Frrjs r%supports_stream_param_in_request_bodyz9AzureAIAgentsConfig.supports_stream_param_in_request_bodys r raw_responsemodel_response logging_obj request_dataencodingztiktoken.Encoding | None json_modec |S)zV Transform the Azure Agents response to LiteLLM ModelResponse format. r) rr!rnrorprqrLr9rBrrr.rss rtransform_responsez&AzureAIAgentsConfig.transform_response"s $rtimeout acompletionc 0ddlm} ddlm} ddlm}|"|r t |ni}d|d<| |d i|}| td| r7| r| j|||||||||  S| j|||||||||| S| j|||||||||| S) aT Dispatch method for Azure Foundry Agents completion. Routes to sync or async completion based on acompletion flag. Supports native streaming via SSE when stream=True and acompletion=True. Authentication: Uses Azure AD Bearer tokens. - Pass api_key directly as an Azure AD token - Or set up Azure AD credentials via environment variables for automatic token retrieval: - AZURE_TENANT_ID, AZURE_CLIENT_ID, AZURE_CLIENT_SECRET (Service Principal) See: https://learn.microsoft.com/en-us/azure/ai-foundry/agents/quickstart r)get_azure_ad_token)azure_ai_agents_handler)GenericLiteLLMParamszhttps://ai.azure.com/.default azure_scopeaapi_key (Azure AD token) is required for Azure Foundry Agents. Either pass api_key directly, or set AZURE_TENANT_ID, AZURE_CLIENT_ID, and AZURE_CLIENT_SECRET environment variables for Service Principal auth. Manual token: az account get-access-token --resource 'https://ai.azure.com') r!rLr-r.rpr9rBrvrM) r!rLr-r.rorpr9rBrvrMr) litellm.llms.azure.common_utilsry$litellm.llms.azure_ai.agents.handlerrzlitellm.types.routerr{dictrEacompletion_streamrw completion)r!rLr-r.rorpr9rBrvrwr6rMryrzr{azure_auth_paramss rrzAzureAIAgentsConfig.completion6s 8 GP= ?@NtN';SU /N m ,()=)R@Q)RSG ?^  .AA%%# +$3#1##B  /::%%##1 +$3#1##;  +55!!-' /-6  r)N)NN)FN)*rrrrr@MAX_POLL_ATTEMPTSPOLL_INTERVAL_SECONDSr staticmethodrWboolr%r,tupler4rVr7rr<rArGrKr r]r`inthttpxHeadersr rerhpropertyrkrmResponser LiteLLMLoggingObjrufloatrr __classcell__)r s@rrr5s $'#"""" s s  !*!t! sTz3:% & !$c         LLL#*t     t  < 33 3 3# 3//'(/ /  /  / /p##'(     t* 6RSRsRTTYTaTaMaRfvR+/ Tz t  !4Z   4t"#!%nn&  '   '(-t$; ($#WWWWt W & W ' WWWWWt WW WWrr)rtypingrrrrlitellm._loggingr8litellm.litellm_core_utils.prompt_templates.common_utilsr)litellm.llms.base_llm.chat.transformationrr litellm.types.llms.openair litellm.types.utilsr tiktoken*litellm.litellm_core_utils.litellm_loggingr _LiteLLMLoggingObj&litellm.llms.custom_httpx.http_handlerr rrrrrrrrsi.-, +S6-XT*KA)AY*Yr