tPjJUddlZddlmZddlmZddlmZmZmZmZm Z ddl Z ddl Z ddl m Z ddlmZddlmZmZddlmZmZdd lmZdd lmZdd lmZmZdd lmZmZm Z m!Z!erdd l"m#Z$dZ%ee&d<GddeZ'y)N)AsyncGenerator)datetime) TYPE_CHECKINGAnyFinalLiteralOptional)verbose_proxy_logger) DualCache)CustomGuardraillog_guardrail_information)get_async_httpx_clienthttpxSpecialProvider)UserAPIKeyAuthGuardrailEventHooks)EnkryptAIProcessedResultEnkryptAIResponse)CallTypesLiteralGenericGuardrailAPIInputsGuardrailStatusModelResponseStream)Logging enkryptaiGUARDRAIL_NAMEc peZdZ d"dededzdedzdedzffd Z d#dededzd efd Zd ed efd Z d ed e fdZ ded efdZ de dededed eezezdzf dZdede defdZdede fdZe d#dddededdedd df dZde d eded eedffdZed Zed ee fd!Z!xZ"S)$EnkryptAIGuardrailsNguardrail_nameapi_keyapi_base policy_namec ttj|_|xst j d|_|j s td|xst j dd|_|jd|_ ||_ ||_ d|_ ||_ |jdt|j!t#|Hd d |i|t'j(d |j|jy) N) llm_providerENKRYPTAI_API_KEYzdEnkryptAI API key is required. Set ENKRYPTAI_API_KEY environment variable or pass api_key parameter.ENKRYPTAI_API_BASEzhttps://api.enkryptai.comz/guardrails/policy/detectrsupported_event_hooksrzHEnkryptAI Guardrail initialized with guardrail_name: %s, policy_name: %s)rrGuardrailCallback async_handlerosgetenvr ValueErrorr api_urlr!rguardrail_provideroptional_params setdefaultlistget_supported_event_hookssuper__init__r debug)selfrrr r!kwargs __class__s /home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/guardrails/guardrail_hooks/enkryptai/enkryptai.pyr4zEnkryptAIGuardrails.__init__.s4AUAgAgh@")),?"@ ||v !`BII.BD_$` --(AB ',"- & 148V8V8X3YZ AA&A"" V       prompt request_datareturnc HKtj}d|i}d|jd}|jr|j|d<t j d|j | t j d|j ||jj|j ||d{}|j|j}tj}||z j} t j d|j ||rO|j|} |j|j||| |j|j| |S7#t j"$r} tj}||z j} t j$d t'| |rI|j|jd t'| i|d |j|j| d} ~ wwxYww) a_ Call Enkrypt AI Guardrails API to detect potential issues in the given prompt. Args: prompt (str): The text to analyze for potential violations request_data (dict): Optional request data for logging purposes Returns: EnkryptAIResponse: Response from the Enkrypt AI Guardrails API textzapplication/json)z Content-Typeapikeyzx-enkrypt-policyz(EnkryptAI request to %s with payload: %s)urljsonheadersNz+EnkryptAI response from %s with payload: %s)r.guardrail_json_responser<guardrail_status start_timeend_timedurationz EnkryptAI API request failed: %serrorguardrail_failed_to_respond)rnowrr!r r5r-r)postraise_for_statusrB total_seconds_determine_guardrail_status:add_standard_logging_guardrail_information_to_request_datar. timestamphttpx HTTPErrorrIstr) r6r;r<rFpayloadrCresponse response_jsonrGrHrEes r9_call_enkryptai_guardrailsz.EnkryptAIGuardrails._call_enkryptai_guardrailsUs%LLN  &)*< U   *.*:*:G& '"" 6 LL  8  & &:   %)$6$6$;$;LL%<%H  % % '#+==?M||~H :-<<>H & &=  *.*J*J=*Y OO'+'>'>,9!-%5)335%//1%P! =@ ||~H :-<<>H & &'I3q6 ROO'+'>'>-4c!f,=!-%B)335%//1%P % s?A$H"'A E53E34B>E52H"3E55HBHHH"rVc||jdi}|jdi}g}i}|jD]}\}}|dk(rGt|tst |dkDs+|j ||j|i||<R|dk(sX|j ||j|i||<||dS)a Process the response from the Enkrypt AI Guardrails API Args: response: The response from the API with 'summary' and 'details' keys Returns: EnkryptAIProcessedResult: Processed response with detected attacks and their details summarydetailstoxicityr)attacks_detectedattack_details)getitems isinstancer1lenappend)r6rVr[r\detected_attacksr`keyvalues r9&_process_enkryptai_guardrails_responsez:EnkryptAIGuardrails._process_enkryptai_guardrails_responses"i4!i4-/02!--/ ?JCj eT*s5zA~$++C0*1++c2*>N3'A:$++C0*1++c2*>N3' ?%5WWr:rWc t|tsy|j|}|d}|ryy#t$r)}t j dt |Yd}~yd}~wwxYw)a< Determine the guardrail status based on EnkryptAI API response. Returns: "success": Content allowed through with no violations "guardrail_intervened": Content blocked due to policy violations "guardrail_failed_to_respond": Technical error or API failure rJr_guardrail_intervenedsuccessz0Error determining EnkryptAI guardrail status: %sN)rcdictri Exceptionr rIrT)r6rWprocessed_resultr_rXs r9rOz/EnkryptAIGuardrails._determine_guardrail_statussh 1mT24'+&Q&QR_&` &67I&J - 1 & &'Y[^_`[a b0 1s-- AAAroc |d}|d}dt|d}|D],}|d|jdz }|j|i}|dk(r3|d|jd d d z }|d |jd d d z }n|dk(r|d|jdid z }n|dk(rX|jDcgc]$\}}t |t t fs|dkDs#|&} }}|ddj| d z }nG|dk(r|d|jdgd z }n(|dk(r|d|jddd z }n |d|d z }|d z }/|jScc}}w)z Create a detailed error message from processed guardrail results. Args: processed_result: Processed response with detected attacks and their details Returns: Formatted error message string r_r`zGuardrail failed: z violation(s) detected z- z: policy_violationz Policy: violating_policyzN/A z Explanation: explanationpiiz PII Detected: r]g?z Types: z, keyword_detectedz Keywords: detected_keywordsbiasz Bias Detected: bias_detectedFz Details: ) rdupperrarbrcintfloatjoinstrip) r6ror_r` error_message attack_typer\kv toxic_typess r9_create_error_messagez)EnkryptAIGuardrails._create_error_messages#33E"F 01A B,S1A-B,CC]^ + "K r+"3"3"5!6c: :M$((b9G00:gkk:Le.T-UUW!XX ?7;;}e3T2UUW!XX %#3GKKr4J3K2!NN  *-4]]_hTQ 1sTYl@[`adg`gqh h9TYY{-C,DB!GG  22< ?C>C<2C> 4C>cKddlm}tj}|j ||dury|j d}|r|D]}|j d}t |ts%|j||d{} tjd | |j| } | d } | so|j| } t| |||j |S7fw) z Runs in parallel to LLM API call Runs on only Input This can NOT modify the input, only used to reject or accept a call before going to LLM API rrrTNrrrz+Guardrails async_moderation_hook result: %sr_r)rrr during_callrrarcrTrYr r5rirr,r) r6rrrrrrrrrror_rs r9async_moderation_hookz)EnkryptAIGuardrails.async_moderation_hook=s 2E1P1P  $ $$: $ Fd R 88J/ $ 8";;y1h,#'#B#B'%)$C$F )../\^de(,'R'RSY'Z$'78J'K$((,(B(BCS(T (77# 8( 3UYUhUhi 'sA&C()C(?C&2C(34C(cKddlm}ddlm}|j ||j duryt jd|t|tjr|d}|jD]\}t|tjs|jjs5t|jjtsZd}n|st j d y|jD]}t|tjst jd ||jjsKt|jjtsp|j#|jj| d{}t jd ||j%|} | d } | s|j'| } t)| |||j*y7ew)z Runs on response from LLM API call It can be used to reject a response Uses Enkrypt AI guardrails to check the response for policy violations, PII, and injection attacks rrrrTNz)async_post_call_success_hook response: %sFz>#9#9)-(G(" -223giop,0+V+VW]+^(+;19J114$%6N$%SV$%L.).. . $ . S4 $ & .`,,*,$ ,\:j:j*:jx 6: '+''12 ' 12 ' % ''R)  +T1 2 $-- $/B*C  r:r)(r*collections.abcrrtypingrrrrr rRrlitellm._loggingr litellm.caching.cachingr %litellm.integrations.custom_guardrailr r &litellm.llms.custom_httpx.http_handlerrrlitellm.proxy._typesrrrrrrlitellm.types.utilsrrrr*litellm.litellm_core_utils.litellm_loggingrrr__annotations__rr'r:r9rsc *?? 1-08W##D /D r: