tPj]fddlmZmZddlZddlmZddlmZddlm Z m Z ddl m Z Gdde Z y) )FinalLiteralN)verbose_proxy_logger) DualCache)CustomGuardraillog_guardrail_information)UserAPIKeyAuthc eZdZfdZedededededde e zezdzf d Z edededed fd Z ededefd Z xZS) myCustomGuardrailc 2||_t|di|y)N)optional_paramssuper__init__)selfkwargs __class__s ~/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/guardrails/guardrail_hooks/custom_guardrail.pyrzmyCustomGuardrail.__init__s & "6"user_api_key_dictcachedata call_type) completiontext_completion embeddingsimage_generation moderationaudio_transcriptionpass_through_endpointrerankmcp_callanthropic_messagesreturnNcK|jd}|rS|D]N}|jd}t|ts%d|jvs8|j dd}||d<Pt j d||Sw)zz Runs before the LLM API call Runs on only Input Use this if you want to MODIFY the input messagescontentlitellmz********z-async_pre_call_hook: Message after masking %s)get isinstancestrlowerreplacerdebug)rrrrr _messagesmessage_contents rasync_pre_call_hookz%myCustomGuardrail.async_pre_call_hooks4 88J/ $ 6";;y1h, HNN$44#+#3#3Iz#J-5 *  6 ""#RT]^ s:BB1B)rrrrr responsesr"r#cK|jd}|rG|D]A}|jd}t|ts%d|jvs8t dyyw)z Runs in parallel to LLM API call Runs on only Input This can NOT modify the input, only used to reject or accept a call before going to LLM API r&r'r(z+Guardrail failed words - `litellm` detectedN)r)r*r+r, ValueError)rrrrr/r0r1s rasync_moderation_hookz'myCustomGuardrail.async_moderation_hook>sb2 88J/ $ X";;y1h, HNN$44()VWW  X s:AAAcKtjd|t|tjr|j D]}t|tj stjd||jjsKt|jjtspd|jjvstdyyw)z Runs on response from LLM API call It can be used to reject a response If a response contains the word "coffee" -> we will raise an exception z async_pre_call_hook response: %szasync_pre_call_hook choice: %scoffeez Guardrail failed Coffee DetectedN) rr.r*r( ModelResponsechoicesChoicesr0r'r+r5)rrrresponsechoices rasync_post_call_success_hookz.myCustomGuardrail.async_post_call_success_hook_s ""#ExP h 5 5 6"** Mfgoo6(../OQWX..&v~~'='=sC$(>(>>()KLL M 7sAC,C $C/CC)__name__ __module__ __qualname__rrr rdictr Exceptionr+r2r6r> __classcell__)rs@rr r s#$)$$ $  "  $" S4 $ &#$$LXX*X "  XX@MM*MMrr )typingrrr(litellm._loggingrlitellm.caching.cachingr%litellm.integrations.custom_guardrailrrlitellm.proxy._typesr r r rrrJs+!1-0jMjMr