uPjZdZddlmZddlmZmZmZmZmZddl m Z ddl m Z ddl mZddlmZmZddlmZdd lmZdd lmZdd lmZdd lmZmZmZmZmZdd l m!Z!m"Z"m#Z#ddl$m%Z%erddl&m'Z'ddl(m)Z*ddl+m,Z,ddlm-Z-ddl$m.Z.GddedZ/GddedZ0GddeZ1y)a OpenAI Responses API Handler for Unified Guardrails This module provides a class-based handler for OpenAI Responses API format. The class methods can be overridden for custom behavior. Pattern Overview: ----------------- 1. Extract text content from input/output (both string and list formats) 2. Create async tasks to apply guardrails to each text segment 3. Track mappings to know where each response belongs 4. Apply guardrail responses back to the original structure Responses API Format: --------------------- Input: Union[str, List[Dict]] where each dict has: - role: str - content: Union[str, List[Dict]] (can have text items) - type: str (e.g., "message") Output: response.output is List[GenericResponseOutputItem] where each has: - type: str (e.g., "message") - id: str - status: str - role: str - content: List[OutputText] where OutputText has: - type: str (e.g., "output_text") - text: str )Sequence) TYPE_CHECKINGAnyFinalUnioncast)ResponseFunctionToolCall)FunctionToolParam) BaseModel)ReadOnly TypedDict)verbose_proxy_logger)-OpenAiResponsesToChatCompletionStreamIterator)BaseTranslation) LiteLLMCompletionResponsesConfig)AllMessageValuesChatCompletionToolCallChunkChatCompletionToolParamOpenAIMcpServerToolResponsesAPIStreamEvents)GenericResponseOutputItemOutputFunctionToolCall OutputText)GenericGuardrailAPIInputs)CustomGuardrail)Logging)UserAPIKeyAuth)ResponseInputParam)ResponsesAPIResponsec>eZdZUdZeeeed<eedzed<y)ResponseOutputEnvelopezODict form of a Responses API response, as far as guardrail write-back reads it.outputNmodel) __name__ __module__ __qualname____doc__r robject__annotations__str/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/openai/responses/guardrail_translation/handler.pyr!r!Es$Y Xf% && C$J r,r!F)totalc2eZdZUdZeeed<eeed<y)ResponsesStreamChunkzPResponses API streaming event, as far as the accumulated-stream helpers read it.typetextN)r$r%r&r'r r*r)r+r,r-r0r0LsZ 3- 3-r,r0ceZdZdZdedeedzfdZ d.dedddd deee ffd Z dedeefd Z d ee e zd eeddfdZdeedeeee ffdZdeeee fdeeee fdeeee ffdZdedeeee fdeedzddfdZdededeedeedeeeedzfddf dZdedeedeeeedzfddfdZ d/dedefdddd d d!d"edzdedeff d#Z d/d$eedddd d d!d"edzdeef d%Zd$eedefd&Zd$eedefd'Z dddefd(Z! d.d)e d*edeedeedeeeefd+ee"dzddfd,Z#dedefdeedeeeefddfd-Z$y)0OpenAIResponsesHandlera Handler for processing OpenAI Responses API with guardrails. This class provides methods to: 1. Process input (pre-call hook) 2. Process output response (post-call hook) Methods can be overridden to customize behavior for different message formats. datareturnNc|jd}|ytj||}|rttt |SdS)z Convert Responses API request data to OpenAI-spec structured messages. Transforms `input` (string or ResponseInputParam) and optional `instructions` into chat completion messages. inputN)r8responses_api_request)getr)transform_responses_api_input_to_messagesrlistr)selfr5 input_datamessagess r-get_structured_messagesz.OpenAIResponsesHandler.get_structured_messages^sN!HHW-  :dd"& :BtD)*H5KtKr,guardrail_to_applyrlitellm_logging_objzLiteLLMLoggingObj | NonecK|jd}g}||S|j|}t|trt |g}g}d|vr/|dr*t |d}|j |d||r||d<|r||d<|jd} | r| |d<|j||d|d{} | jd g} | r| d n||d<|j||| jdtjd |St|t s|Sg} g} g}t |jdxsg}t|D]\}}|j||| | | d|vr|dr|j |d|| rt | }| r| |d <|r||d<|r||d<|jd} | r| |d<|j||d|d{} | jd g} |j||| jd|j|| |d{tjd||S77o7!w)z Process input by applying guardrails to text content. Handles both string input and list of message objects. r8Ntextstoolsstructured_messagesr#requestinputs request_data input_type logging_objrErz,OpenAI Responses API: Processed string input)messagemsg_idxtexts_to_checkimages_to_check task_mappingsimages)r? responsesrRz2OpenAI Responses API: Processed input messages: %s)r:r@ isinstancer*rr<_extract_and_transform_toolsapply_guardrail _apply_guardrailed_tools_to_datardebug enumerate_extract_input_text_and_images#_apply_guardrail_responses_to_input)r=r5rArBr>tools_to_checkrGrJoriginal_toolsr#guardrailed_inputsguardrailed_textsrPrQrRoriginal_tools_listrOrNs r-process_input_messagesz-OpenAIResponsesHandler.process_input_messagesns>BXXg=N ?A  K%)%A%A$%G j# &.j\BF68N$4=!%d7m!411$w-P!&4F7O"0C,-HHW%E"'w'9'I'I!$/ (J("  !3 6 6w C 4E-a0:DM  1 1$HZH^H^_fHg h & &'U VK*d+K+-,.=? >B488GCTCZXZ>[!** 5  GW  / /- /+ 0   d?tG}  - -d7m^ L .^DF#2x "0w"0C,-HHW%E"'w'9'I'I!$/ (J(" !3 6 6w C   1 1#"&&w/ ::#++;   ""#WYcd O"`" s8B2I4I 5D+I I!AI0I1IIIclg}|jdxsgD]}t|ts|jddvr/|jdr|jt |dV|jddk(sk|jds}|jt |d|S)z{Extract tool names from Responses API request (tools[].name for function and custom, tools[].server_label for mcp).rFr1)functioncustomnamemcp server_label)r:rUdictappendr*)r=r5namestools r-extract_request_tool_namesz1OpenAIResponsesHandler.extract_request_tool_namess#%HHW%+ 8DdD)xx#99dhhv>N Sf./&!U*txx/G Sn!567  8 r,rFr]c|Pt|tr?tj|\}}|j t tt |yyy)z Extract and transform tools from Responses API format to Chat Completion format. Uses the LiteLLM transformation function to convert Responses API tools to Chat Completion tools that can be passed to guardrails. N)rUr<r6transform_responses_api_tools_to_chat_completion_toolsextendrr)r=rFr]transformed_tools_s r-rVz3OpenAIResponsesHandler._extract_and_transform_toolssS  E4!8 1gghmn !  ! !$t,C'DFW"X Y "9 r,guardrailed_toolsc,tj|S)z| Remap guardrail-returned tools (Chat Completion format) back to Responses API request tool format. )r|jdd}|yt|tr%|j||j|dfyt|trt |D]\}}t|t s|jdd} | -|j| |j|t|f|jddk(sm|jdi} t| t s| jd} | s|j| yy)z Extract text content and images from an input message. Override this method to customize text/image extraction logic. contentNr2r1 image_urlurl)r:rUr*rjr<rZriint) r=rNrOrPrQrRr content_idx content_itemtext_strrrs r-r[z5OpenAIResponsesHandler._extract_input_text_and_images,s!Y5 ?  gs #  ! !' *  '4 1  &-6w-? <) \lD1+//=H+&--h7%,,gs;7G-HI$''/;>$0$4$4["$E %i6"+--"6C" / 6 6s ; <'r,r?rTclKt|D]\}}||}tt|d}ttdz|d}||jdd} | Lt | t r | |||d<gt | t sx|{t ||d|ts|||d|d<yw)z Apply guardrail responses back to input messages. Override this method to customize how responses are applied. rNr{rr2)rZrrr:rUr*r<ri) r=r?rTrRtask_idxguardrail_responsemappingrOcontent_idx_optionalrs r-r\z:OpenAIResponsesHandler._apply_guardrail_responses_to_inputTs-6i,@ d (H(#H-G3 +G#'d GAJ#? w'++It+A+A'2+N! ??)/"/@ $ # ??6 "&A A=hhitu "!6 = =a @ F F Q QJ24'+D1L,Mz'Z|$0':?T?Z?Z&;&A&AF7O(88!1=1Ir) 3 9 $ # $??@PQ %>m_%UO@J;??[eKfhl@m  B/33G >!   #''/>AAr,c jdj|Dcgc]}|jddc}Scc}w)zB Get the string so far from the responses so far. r2)joinr:)r=rrs r-rz2OpenAIResponsesHandler.get_streaming_string_so_faros-wwAQRX VR0RSSRs0c"t|dr |jy|jD]}t|tr2 t j |j }|jr|}t|ttfs\t|tr |jn|jdg}|s|D]G}t|tr|js yt|ts4|jdsFyy#t$rYwxYw)z Check if response has any text content to process. Override this method to customize text content detection. r"FrTr2) rr"rUr rmodel_validate model_dumpr Exceptionrir:rr2)r=rrgeneric_response_output_itemrrs r-_has_text_contentz(OpenAIResponsesHandler._has_text_contentus x*hoo.E#?? ,K+y13L3[3[\g\r\r\t3u03;;&B +(A4'HI"+/HI ''$B7 (/, %lJ?+00'+' d;+//7'+, ,.#!s1D D Drrrclt|ts+t|trTt|drHt |ddk(r9|6t j ||}|jtt|yt|trZ|jddk(rF|C tdi|}t j ||}|jtt|yyd} t|tr? |j} tj | } | j"r | j"} n$t|tr|jdg} ny| syt%j&d|t)| D]u\} } t| t*r | j,}n#t| tr| jd}nF|sI|j||j|t/| fwy#t$rYywxYw#t$r*t|dr|j"r |j"} nYyYwxYw) z Extract text content, images, and tool calls from a response output item. Override this method to customize text/image/tool extraction logic. r1 function_callN)tool_call_itemindexrz0OpenAI Responses API: Processing output item: %sr2r+)rUrr rrr@convert_response_function_tool_call_to_chat_completion_tool_callrjrrrir:r rrrrrrrYrZrr2r)r=rrrPrQrRrtool_call_dict tool_call_objroutput_item_dumprrr text_contents r-rz6OpenAIResponsesHandler._extract_output_text_and_imagess k#9 : {I . V, V,?".4uu'2( $**40K^+\]   T *{v/F//Y".+C+Rk+RM%E&G&G'4(&N(..t4OQ_/`a 9= k9 - *5*@*@*B 6O6^6^_o6p,/77:BBG T *!ooi4G  ""#UWbc*37); E %K, 3+00 L$/+//7 %%l3$$j#k2B%CD E;!  ; 2{7J7J)11G s%AG12=H1 G=<G=.H32H3cKt|tr|jdg}nt|dr|jxsg}nyt |D]\}}||}t t|d}t t|d} |t|k\rA||} t| trd| jsc| t| jks|| j| } t| tr|| _ t| ts|| d<t| tr tj| j} | jrx| t| jkr`| j| } t| trA|| _ t| dr.| jr"| j| } t| dr|| _ tt| ts| jdg}|s| t|kst|| tr ||| d<t|| ds||| _ y#t $rYwxYww)z Apply guardrail responses back to output response. Override this method to customize how responses are applied. r"Nrr{r2r)rUrir:rr"rZrrr|rrrr2r rrr)r=rrTrRrrrrrrrr generic_itemoriginal_contentrs r-rz;OpenAIResponsesHandler._apply_guardrail_responses_to_outputs h %&ll8R8O Xx (&oo3O ,5i,@' G (H(#H-Gc71:.JsGAJ/KS11)*5K+'@A&&;[=P=P9Q+Q#.#6#6{#CL!, ;,> )#L$7/A V,K3 #<#K#KKLbLbLd#eL#++ c,BVBV>W0W'3';';K'H %lJ?0BL-&{I>;CVCV3>3F3F{3S 0#*+;V#D4F ,1O' G>!sUB/I2I 7IIB'H7II+I;,I)I7 IIII)N)NNN)%r$r%r&r'rir<rr@r*r(rbrmr rrrVrrvrrXrtupler[r\rr!rrrr0boolrrrrrrr+r,r-r4r4SsLDLT:J5Kd5RL(;? kk.k8 k c6k  kZ t S Z%(;;<Z45Z  Z& d3i TXY]^aci^iYjTk T#v+./tCK() d3; : X XT#v+./ X 784? X  X&<&<&<S &< c &< E#sTz/23 &< &kb;?59$( B s)B .B 8 B 3 B Tk B  cB H B8DX;Y B^b BTHEYEQE QEf:G.0FFG:G9:GE#s(O, :G  :Gr,r4N)2r'collections.abcrtypingrrrrr2openai.types.responses.response_function_tool_callr !openai.types.responses.tool_paramr pydanticr typing_extensionsr r litellm._loggingrIlitellm.completion_extras.litellm_responses_transformation.transformationrrs<%99W?11Y :EW3<8 Ye 9EQ G_Q Gr,