uPj9UdZddlZddlmZddlmZmZddlmZm Z ddl Z ddl m Z ddl mZddlmZmZdd lmZdd lmZdd lmZmZdd lmZdd lmZdZeed<ehdZ eddhZ!eed<dZ"eed<dZ#eed<dZ$eed<dZ%eed<Gdde Z&Gdde Z'Gd d!e Z(Gd"d#e Z)Gd$d%eeZ*y)&a9 Amazon Bedrock Mantle - Responses API backend. Mantle serves Responses on two upstream paths: gpt frontier models (gpt-5.5 / gpt-5.4) on `/openai/v1/responses`, and everything else that supports Responses (e.g. gpt-oss) on the standard `/v1/responses`. The gate picks the path per model and injects it via `use_openai_path`. Payloads and SSE follow the OpenAI Responses spec, so this config inherits OpenAIResponsesAPIConfig and overrides only the endpoint URL and authentication. Auth: Bearer token (BEDROCK_MANTLE_API_KEY or the standard AWS_BEARER_TOKEN_BEDROCK, or litellm_params.api_key) when present; otherwise AWS SigV4 (service name "bedrock") using the standard credential chain (IAM role / access key / profile / web identity), signed via the shared BaseAWSLLM._sign_request after the request body is finalized. N)Mapping)AnyFinal)ReadOnly TypedDict)verbose_logger) BaseAWSLLM)MANTLE_HOST_REBedrockMantleAuthMixin)OpenAIResponsesAPIConfig)get_secret_str)ResponseInputParam!ResponsesAPIOptionalRequestParams)GenericLiteLLMParams) LlmProviders)/openai/v1/responses /v1/responsesz /responsesz /openai/v1z/v1_BASE_SUFFIXES_TO_STRIP>mcpcustomfunction namespace tool_searchautodefault'_BEDROCK_MANTLE_SUPPORTED_SERVICE_TIERSadditional_tools'_CODEX_ADDITIONAL_TOOLS_INPUT_ITEM_TYPE agent_message$_CODEX_AGENT_MESSAGE_INPUT_ITEM_TYPEcontext_compaction)_CODEX_CONTEXT_COMPACTION_INPUT_ITEM_TYPElocal_shell_call'_CODEX_LOCAL_SHELL_CALL_INPUT_ITEM_TYPEc.eZdZUeeed<eeed<y)_RewrittenOutputTextBlocktypetextN__name__ __module__ __qualname__rstr__annotations__y/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/bedrock_mantle/responses/transformation.pyr&r&>s 3- 3-r0r&cHeZdZUeeed<eeed<eeedfed<y)_RewrittenAssistantMessageItemr'role.contentN)r*r+r,rr-r.tupler&r/r0r1r3r3Cs, 3- 3- e5s:; <*CDrJabhaiiqHr{{3- F}}V$Ns6{l+     %,VHH=D040D0D,/vr0headersmodelc|xs t}|j|j}|rd||d<|jr|j|d<|S)NzBearer AuthorizationzOpenAI-Project)r_resolve_bearer_tokenapi_keyaws_bedrock_project_id)rHr^r_rPbearers r1validate_environmentz4BedrockMantleResponsesAPIConfig.validate_environmentwsY'A+?+A22>3I3IJ )0'9GO $  0 0(6(M(MG$ %r0cyNFr/rMs r1supports_native_file_searchz;BedrockMantleResponsesAPIConfig.supports_native_file_searchr0cyrhr/rMs r1supports_native_websocketz9BedrockMantleResponsesAPIConfig.supports_native_websocketrjr0toolscZg}g}|D]i}t|ts|j|%|jd}|tvr|j|P|jt |k|r6t jdtt|tt|S)z4Keep only tool types Mantle's Responses API accepts.r'zSBedrock Mantle Responses API: dropping unsupported tool type(s) %s (supported: %s).) isinstancedictappendget-_BEDROCK_MANTLE_SUPPORTED_RESPONSE_TOOL_TYPESr-rwarningsortedset)rmkept dropped_typestool tool_types r1_filter_unsupported_toolsz9BedrockMantleResponsesAPIConfig._filter_unsupported_toolss"$*,  5DdD) D!(III D!$$S^4 5   " "es=)*DE   r0params drop_paramsc2|jd}||tvr|S|s%tjj dd|dt j d|tt|jDcic]\}}|dk7s ||c}}Scc}}w)N service_tieriz-bedrock_mantle does not support service_tier=a; the Bedrock Mantle Responses API only accepts 'auto' or 'default'. Set `drop_params: true` (litellm_settings or this deployment's litellm_params) to have LiteLLM drop it, or remove service_tier from the client (Codex CLI sends it when a speed tier is set in ~/.codex/config.toml).) status_codemessagezSBedrock Mantle Responses API: dropping unsupported service_tier %r (supported: %s).) rrrlitellmutilsUnsupportedParamsErrorrrtruitems)r|r}rkeyvalues r1 _handle_unsupported_service_tierz@BedrockMantleResponsesAPIConfig._handle_unsupported_service_tiers$jj8  <3Z#ZM--66CLCSThh7   a  : ; .4\\^UzsEsn?TU UUUs < B Binputstr | ResponseInputParam$response_api_optional_request_paramsc|j|\}}|j|}|ri|dg|jdxsg|in|} t |||| ||S)Nrm)r_rrrPr^)_hoist_codex_additional_tools_normalize_codex_input_itemsrrrEtransform_responses_api_request) rHr_rrrPr^remaining_input hoisted_toolsnormalized_inputrequest_paramsrIs r1rz?BedrockMantleResponsesAPIConfig.transform_responses_api_requests*.)K)KE)R&"&"C"CO"T 6 :>>wGM2" 6 w6"1?) 7  r0itemcVt|txr|jdtk(S)Nr')rorprrr)rs r1_is_codex_additional_tools_itemz?BedrockMantleResponsesAPIConfig._is_codex_additional_tools_items#$%e$((6*:>e*eer0cL|jd}t|tr|SgS)Nrm)rrrolist)rrms r1_tools_of_additional_tools_itemz?BedrockMantleResponsesAPIConfig._tools_of_additional_tools_items$xx("5$/u7R7r0ct|ts|gfS|Dcgc]}|j|s|}}|s|gfS|Dcgc]}|j|r|}}|Dcgc]}|j|D]}|}}}t j dt |t |||j|fScc}wcc}wcc}}w)aCodex's "responses lite" wire mode ships tool definitions inside `input` as {"type": "additional_tools", "role": "developer", "tools": [...]} items. api.openai.com accepts that item type; Mantle rejects the whole request with 400 "Invalid 'input': value did not match any expected variant" but accepts the same tools at the top level, so move them there and strip the items from `input`. zBedrock Mantle Responses API: hoisting %d tool(s) out of %d 'additional_tools' input item(s) into the top-level tools param (Mantle rejects that input item type).)rorrrrdebugrWr{)clsrradditional_tools_itemsrryrs r1rz=BedrockMantleResponsesAPIConfig._hoist_codex_additional_toolss%&"9 :?(m$3CfCfgkCl(m(m%"9 38!j4@c@cdh@i$!j!j*@w$SMpMpquMvwTww w T   & '   = =m LLL)n"kwsCCCC"C Mapping[str, object]cv|jd}t|tsydjd|DS)Nr5c3K|]E}t|tr3t|jdxs|jdxsdGyw)r(r9rN)rorpr-rr).0blocks r1 zFBedrockMantleResponsesAPIConfig._agent_message_text..sD %&  &!IUYY/B%CIr J sA A )rrrorjoin)rr5s r1_agent_message_textz3BedrockMantleResponsesAPIConfig._agent_message_texts;),'4(ww     r0cB|j|}|syddd|dfd}|S)Nr assistant output_text)r'r()r'r4r5)r)rrr( rewrittens r1_normalize_agent_message_itemz=BedrockMantleResponsesAPIConfig._normalize_agent_message_items8--d3!.=?< r0cX|jd}t|tr|syd|d}|S)Nr9 compaction)r'r9)rrror-)rr9rs r1"_normalize_context_compaction_itemzBBedrockMantleResponsesAPIConfig._normalize_context_compaction_item s4#'88,?#@+S19J>Jar5s r0c|jd}t|tr|sy|jd}d|dt|trt j |ndd}|S)Nr<action function_call local_shellz{})r'r<r=r>)rrror-rpjsondumps)rr<rrs r1 _normalize_local_shell_call_itemz@BedrockMantleResponsesAPIConfig._normalize_local_shell_call_items\),'3'w*#!/9&$/GF+T 8 r0ztuple[object, str | None]ct|ts|dfS|jd}|tk(r|j ||fS|t k(r|j ||fS|tk(r|j||fS|dfS)zKReturns (normalized item or None to drop it, original type when rewritten).Nr') rorprrr rr"rr$r)rr item_types r1_normalize_codex_input_itemz;BedrockMantleResponsesAPIConfig._normalize_codex_input_item"s$%: 88F+ < <44T:IE E A A99$?J J ? ?77=yH HTzr0ct|ts|Stfd|D}tt d|D}|rt j d||Dcgc] \}}| | }}}|Scc}}w)a.Rewrite Codex history item types Mantle rejects with 400 "Invalid 'input': value did not match any expected variant" into supported equivalents. `agent_message` (Codex multi-agent traffic; its encrypted_content slot carries the plaintext payload when the model never issued encrypted args) becomes an assistant message, `context_compaction` becomes the `compaction` spelling Mantle accepts, and `local_shell_call` becomes the function_call its recorded function_call_output already pairs with. c3@K|]}j|ywrD)r)rrrs r1rzOBedrockMantleResponsesAPIConfig._normalize_codex_input_items..@s!ZD#"A"A$"G!Zsc3,K|] \}}| |ywrDr/)r_rs r1rzOBedrockMantleResponsesAPIConfig._normalize_codex_input_items..As1t 9^g^s)1ts zVBedrock Mantle Responses API: rewrote Codex input item type(s) %s that Mantle rejects.)rorr6ru frozensetrrt)rr normalizedrewritten_typesrrrws` r1rz zz'*M%/t%rs" #1+8R76,"1::s0t-1:FI;N1O'O1C'C.=$e=3G)5G1C'C  =Y= %y% O&<>VOr0