tPjFUddlZddlmZddlmZddlmZmZddlZddlZddl m Z ddl m Z ddl mZddlmZmZdd lmZdd lmZdd lmZdd lmZmZmZdd lmZmZmZdZ ee!d<GddeZ"y)N)AsyncGenerator)datetime)AnyFinal)verbose_proxy_logger) DualCache)CustomGuardrail)get_async_httpx_clienthttpxSpecialProvider)UserAPIKeyAuthGuardrailEventHooks)GuardrailConfigModel)DynamoAIProcessedResultDynamoAIRequestDynamoAIResponse)CallTypesLiteralGuardrailStatusModelResponseStreamdynamoaiGUARDRAIL_NAMEc peZdZdZddddgfdededzdedzded eef fd Z d!d eeeefd e d ededzde f dZ de de fdZ de defdZde defdZdededededeezezdzf dZdededefdZdedefdZdedededeedffdZedeedzfdZedee fd Z xZ!S)"DynamoAIGuardrailsz DynamoAI Guardrails integration for LiteLLM. Provides content moderation and policy enforcement using DynamoAI's guardrail API. litellm_testNguardrail_nameapi_keyapi_basemodel_id policy_idsc ttj|_|xst j d|_|j s td|xst j dd|_|jd|_ |xst j dd|_ t j d d}|xs|r|jd ng|_ ||_ d |_||_|j!d t#|j%t'|Pdd |i|t+j,d|j|jy)N) llm_providerDYNAMOAI_API_KEYzbDynamoAI API key is required. Set DYNAMOAI_API_KEY environment variable or pass api_key parameter.DYNAMOAI_API_BASEzhttps://api.dynamo.aiz/v1/moderation/analyze/DYNAMOAI_MODEL_IDrDYNAMOAI_POLICY_IDS,rsupported_event_hooksrzBDynamoAI Guardrail initialized with guardrail_name=%s, model_id=%s)r r GuardrailCallback async_handlerosgetenvr ValueErrorrapi_urlrsplitr rguardrail_provideroptional_params setdefaultlistget_supported_event_hookssuper__init__rdebug) selfrrrrr kwargsenv_policy_ids __class__s /home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/guardrails/guardrail_hooks/dynamoai/dynamoai.pyr7zDynamoAIGuardrails.__init__+s04AUAgAgh?")),>"? ||t ![BII.ACZ$[ --(?@ !FBII.A2$F !# *? D$]n)=)=c)BZ\,", & 148V8V8X3YZ AA&A"" P    MM messages event_type text_type request_datareturnc Ktj}d|i}|jr|j|d<|jr|j|d<dd|jd}t j d|j| |jj|jt||d {}|j|j} tj} | |z j} |rP|j| } |j|j | || |j#| j#| | | S7#t$j&$r} tj} | |z j} t j(d t+| |rJ|j|j d t+| i|d |j#| j#| | d } ~ wwxYww)a Call DynamoAI Guardrails API to analyze messages for policy violations. Args: messages: List of messages to analyze text_type: Type of text being analyzed ("input" or "output") request_data: Optional request data for logging purposes Returns: DynamoAIResponse: Response from the DynamoAI Guardrails API r? policyIdsmodelIdzapplication/jsonzBearer )z Content-Type Authorizationz&DynamoAI request to %s with payload=%s)urljsonheadersN)r1guardrail_json_responserBguardrail_status start_timeend_timedurationr@zDynamoAI API request failed: %serrorguardrail_failed_to_respond)rnowr rrrr8r/r+postdictraise_for_statusrI total_seconds_determine_guardrail_status:add_standard_logging_guardrail_information_to_request_datar1 timestamphttpx HTTPErrorrPstr)r9r?r@rArBrMpayloadrJresponse response_jsonrNrOrLes r=_call_dynamoai_guardrailsz,DynamoAIGuardrails._call_dynamoai_guardrailsWs$%LLN  +  ??#'??GK ==!%GI /&t||n5  "" 4 LL  / $($6$6$;$;LL']%<%H  % % '#+==?M||~H :-<<>H*.*J*J=*Y OO'+'>'>,9!-%5)335%//1%)P ! 36 ||~H :-<<>H & &'H#a& QOO'+'>'>-4c!f,=!-%B)335%//1%)P  ' s>BH 4E9E:BEH EH.BHHH r^c|jdd}|jdg}g}i}|dk(r|D]}|jdi}|jdi}|jdd} |jd xs|r|jd nd xsd} | dk(sk|j| |jd | |jd |jd |r|jdnd d|| <||dS)a Process the response from the DynamoAI Guardrails API Args: response: The response from the API with 'finalAction' and 'appliedPolicies' keys Returns: DynamoAIProcessedResult: Processed response with detected violations finalActionNONEappliedPoliciesBLOCKpolicyoutputsnameunknownactionNidmethod descriptionmessage)policyIdrkrmrnro)violations_detectedviolation_details)getappend) r9r^ final_actionapplied_policiesrqrrapplied_policy policy_infopolicy_outputs policy_name policy_actions r=%_process_dynamoai_guardrails_responsez8DynamoAIGuardrails._process_dynamoai_guardrails_responses#'ll=&A "*,,/@""E0235 7 ""2 ,002> !/!3!3Ir!B*oofi@ #&&x0xUc^5G5G5Qimxrx !G+'..{;$/OOD$9"/"-//(";'2}'EESN$6$6y$AY] 6%k2 0$7!2  r>r_c t|tsy|jdry|jdd}|dk(ry|dk(ryy#t$r)}t j dt |Yd }~yd }~wwxYw) aO Determine the guardrail status based on DynamoAI API response. Returns: "success": Content allowed through with no violations (finalAction is NONE) "guardrail_intervened": Content blocked (finalAction is BLOCK) "guardrail_failed_to_respond": Technical error or API failure rQrPrcrdsuccessrfguardrail_intervenedz/Error determining DynamoAI guardrail status: %sN) isinstancerTrs ExceptionrrPr\)r9r_rur`s r=rWz.DynamoAIGuardrails._determine_guardrail_statuss 1mT24  )4"/"3"3M6"JLv% (- 1 & &'XZ]^_Z` a0 1s&AAAA A6 A11A6processed_resultc|d}|d}dt|d}|D]}|d|jdz }|j|i}|jdr |d|dd z }|jd r |d |d d z }|jd r |d |d d z }|jdr |d|dd z }|jdr |d|dd z }|d z }|jS)z Create a detailed error message from processed guardrail results. Args: processed_result: Processed response with detected violations Returns: Formatted error message string rqrrzGuardrail failed: z violation(s) detected z- z: rkz Action:  rmz Method: rnz Description: roz Message: rpz Policy ID: )lenupperrsstrip)r9rrqrr error_messagerzdetailss r=_create_error_messagez(DynamoAIGuardrails._create_error_messagesF&66K%L#34G#H,S1D-E,FF`a . "K r+"3"3"5!6c: :M'++Kuser_api_key_dictcachedata call_typecKtjdddlm}tj }|j ||dur|S|jd}|ru|j|d|tj d {}tjd ||j|} | d } | r|j| } t| |||j |S7dw) zz Runs before the LLM API call Runs on only Input Use this if you want to MODIFY the input zRunning DynamoAI pre-call hookr*add_guardrail_to_applied_guardrails_headerrr@Tr?inputr?rArBr@Nz(Guardrails async_pre_call_hook result=%srqrBr) rr8)litellm.proxy.common_utils.callback_utilsrrpre_callshould_run_guardrailrsrar|rr.r) r9rrrrrr@ _messagesresultrrqrs r=async_pre_call_hookz&DynamoAIGuardrails.async_pre_call_hook s ""#CD 2E1M1M  $ $$: $ Fd RK88J/ "&"@"@"!!.77 #A#F ! & &'QSY Z'+&P&PQW&X )9:O)P #'+'A'ABR'S  // 3UYUhUhi +sAC#?A%C%cKddlm}tj}|j ||dury|j d}|ru|j |d|tjd{}tjd ||j|}|d } | r|j|} t| |||j |S7dw) z Runs in parallel to LLM API call Runs on only Input This can NOT modify the input, only used to reject or accept a call before going to LLM API rrrTNr?rrz*Guardrails async_moderation_hook result=%srqr) rrr during_callrrsrarr8r|rr.r) r9rrrrr@rrrrqrs r=async_moderation_hookz(DynamoAIGuardrails.async_moderation_hookOs 2E1P1P  $ $$: $ Fd R 88J/ "&"@"@"!!.:: #A#F ! & &'SU[ \'+&P&PQW&X )9:O)P #'+'A'ABR'S  // 3UYUhUhi +sA&C(C )A%CcdKddlm}ddlm}|j ||j duryt jd|t|tjr9d}g}|jD]}t|tjs|jjs5t|jjtsZd}|j!|jj"xsd |jjd |st j$d y|rq|j'|d ||j d{} t jd| |j)| } | d} | r|j+| } t-| |||j.y7cw)z Runs on response from LLM API call It can be used to reject a response Uses DynamoAI guardrails to check the response for policy violations rrr rTNz(async_post_call_success_hook response=%sF assistant)rolecontentz;DynamoAI: not running guardrail. No output text in responseoutputrz1Guardrails async_post_call_success_hook result=%srqr)rrlitellm.types.guardrailsrr post_callrr8rlitellm ModelResponsechoicesChoicesrorr\rtrwarningrar|rr.r) r9rrr^rrhas_text_contentdynamoai_messageschoicerrrqrs r=async_post_call_success_hookz/DynamoAIGuardrails.async_post_call_success_hook|s  A  $ $$;N;X;X $ Yae e ""#MxX h 5 5 6$ =? "** fgoo6~~--*V^^=S=SUX2Y+/()00(.(;(;(J{+1>>+A+A $$,,-jk &*&D&D.&!%2<< 'E'!%**+^`fg+/*T*TU[*\ -=>S-T#'+/+E+EFV+WM$]33 3UYUhUhi'!s&B F0F0%$F0 BF0 F. A$F0c4K|23d{}|7 6yw)z Passes the entire stream to the guardrail This is useful for guardrails that need to see the entire response, such as PII masking. Triggered by mode: 'post_call' Nr))r9rr^rBitems r='async_post_call_streaming_iterator_hookz:DynamoAIGuardrails.async_post_call_streaming_iterator_hooks$#  $J (scddlm}|S)NrDynamoAIGuardrailConfigModel)7litellm.types.proxy.guardrails.guardrail_hooks.dynamoairrs r=get_config_modelz#DynamoAIGuardrails.get_config_models ,+r>c`tjtjtjgS)N)rrrr)clss r=r5z,DynamoAIGuardrails.get_supported_event_hookss) ( (  ) )  + +  r>)rN)"__name__ __module__ __qualname____doc__r\r4r7rTrrrrarr|rrWrr rrrrrrrrr staticmethodtyperr classmethodr5 __classcell__)r<s@r=rr$s-"# " * * t* * *  * I * `!$( XtCH~&X(X X Tk X  Xt, >N, Sj, \19I1o1> %6M %RU %D-)-- - $ - S4 $ & -^++*+$ +Z@j@j*@jD)  +T1 2  ,d#784?,, $/B*C  r>r)#r,collections.abcrrtypingrrrZrlitellm._loggingrlitellm.caching.cachingr%litellm.integrations.custom_guardrailr &litellm.llms.custom_httpx.http_handlerr r litellm.proxy._typesr rr3litellm.types.proxy.guardrails.guardrail_hooks.baserrrrrlitellm.types.utilsrrrr__annotations__rr)r>r=rs] * 1-A08T WV""x x r>