uPj?~dZddlmZmZmZddlmZddlmZddl m Z erddl m Z ddl mZddl mZGd d eZy ) z OpenAI Text Completion Handler for Unified Guardrails This module provides guardrail translation support for OpenAI's text completion endpoint. The handler processes the 'prompt' parameter for guardrails. ) TYPE_CHECKINGAnyFinal)verbose_proxy_logger)BaseTranslation)GenericGuardrailAPIInputs)CustomGuardrail)Logging)TextCompletionResponsec `eZdZdZ ddedddddefd Z dd d ddddd edzd edzdef dZy)OpenAITextCompletionHandlerae Handler for processing OpenAI text completion requests with guardrails. This class provides methods to: 1. Process input prompt (pre-call hook) 2. Process output response (post-call hook) The handler specifically processes the 'prompt' parameter which can be: - A single string - A list of strings (for batch completions) Ndataguardrail_to_applyr litellm_logging_objzLiteLLMLoggingObj | Nonereturnc K|jd}|tjd|St|trt |g}|jd}|r||d<|j ||d|d{}|jdg}|r|d n||d<tjd t|t|d|St|trg} g} t|D]8\} } t| ts| j| | j| :| rt | }|jd}|r||d<|j ||d|d{}|jdg}t| D]O\} }| t|ks|| |d|<tjd |t| | t|| Q|Stjd t||S77w) a3 Process input prompt by applying guardrails to text content. Args: data: Request data dictionary containing 'prompt' parameter guardrail_to_apply: The guardrail instance to apply Returns: Modified data with guardrails applied to prompt promptNz7OpenAI Text Completion: No prompt found in request datatextsmodelrequestinputs request_data input_type logging_objrrz_OpenAI Text Completion: Applied guardrail to string prompt. Original length: %d, New length: %dz\OpenAI Text Completion: Applied guardrail to prompt[%d]. Original length: %d, New length: %dzLOpenAI Text Completion: Unexpected prompt type: %s. Expected string or list.) getrdebug isinstancestrrapply_guardraillenlist enumerateappendwarningtype)selfrrrrrrguardrailed_inputsguardrailed_textstexts_to_check text_indicesidxp guardrail_idx prompt_idxs /home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/openai/completion/guardrail_translation/handler.pyprocess_input_messagesz2OpenAITextCompletionHandler.process_input_messages!s8 * > & &'` aK fc ".fX>FHHW%E"'w'9'I'I!$/ (J("  !3 6 6w C 5F.q1FDN & &qF DN# ` U %$&N"$L#F+ -Qa%"))!, '', - 2H)&+F7O+=+M+M!!%( 3 ,N,&" %7$:$:7B$G!2;<1H -M:$s+<'==5F}5UXz2,22B&} => 1- @A  " ! ( (^V    s">&s3A8G?:G:;BG?A"G?#G=$5G?A!G?=G?responser user_api_key_dictrc zKt|dr |jstjd|Sg}g}t |jD]Y\}} t| dst | j ts.|j| j |j|[|r |d|i}n d|vr||d<d|vr|j|} | r| |d<t|} t|dr|jr|j| d<|j| |d| d{} | jd g} t |D]q\}}|t| ks|j|j }| ||j|_tjd |t|t| |s|S7w) a Process output response by applying guardrails to completion text. Args: response: Text completion response object guardrail_to_apply: The guardrail instance to apply litellm_logging_obj: Optional logging object user_api_key_dict: User API key metadata to pass to guardrails Returns: Modified response with guardrails applied to completion text choicesz9OpenAI Text Completion: No choices in response to processtextNr3litellm_metadatarrrrzaOpenAI Text Completion: Applied guardrail to choice[%d] text. Original length: %d, New length: %d)hasattrr6rrr$rr7r r%'transform_user_api_key_dict_to_metadatarrr!rr")r(r3rrr4rr+choice_indicesr-choice user_metadatarr)r*r/ choice_idx original_texts r1process_output_responsez3OpenAITextCompletionHandler.process_output_responsexs(x+83C3C & &'b cO!# "$X%5%56 +KCvv&:fkk3+G%%fkk2%%c* + # *H5 \1/7L,"5'+'S'STe'f  7DL!345NKFx)hnn"*..w.@.P.P)%/ /Q/)  (:'='=gr'J .7~-F ) z 3'8#99$,$4$4Z$@$E$EM8I-8XH$$Z05(..>"M*-m<=  -)s&AF;F;9B(F;!F9"5F;A"F;)N)NNN)__name__ __module__ __qualname____doc__dictrr2r@r1r r s  ;? UU.U8 U Uv;?(,$( K*K.K8 K : K Tk K KrGr N)rDtypingrrrlitellm._loggingrrOs5-,1X9EW:o/orG