tPjUddlmZmZmZmZddlZddlmZddlm Z ddl m Z ddl m Z ddlmZdddZeeeefed <Gd d e ZGd d e ZGdde Zy))DictFinalOptionalUnionN)verbose_proxy_logger) DualCache)CustomGuardrail)UserAPIKeyAuth)CallTypesLiteral)ABguardrail_lb_call_countc>eZdZdZdededededee e e eff dZ y) GuardrailForLBTestingAz'Guardrail A for load balancing testing.user_api_key_dictcachedata call_typereturncjKtdxxdz cc<tjdtd|Sw)Nr z0GuardrailForLBTestingA called. Total A calls: %srrinfoselfrrrrs w/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/example_config_yaml/custom_guardrail.pyasync_pre_call_hookz*GuardrailForLBTestingA.async_pre_call_hook5 $)$!!"TVmnqVrs 13N __name__ __module__ __qualname____doc__r rdictr rr ExceptionstrrrrrK1 )    $  % 3,- . r)rc>eZdZdZdededededee e e eff dZ y) GuardrailForLBTestingBz'Guardrail B for load balancing testing.rrrrrcjKtdxxdz cc<tjdtd|Sw)Nr rz0GuardrailForLBTestingB called. Total B calls: %srrs rrz*GuardrailForLBTestingB.async_pre_call_hook rrNr r(r)rr,r,r*r)r,cpeZdZfdZdededededee e e eff dZ dededefdZ dedefd ZxZS) myCustomGuardrailc 2||_t|di|y)Nr()optional_paramssuper__init__)rkwargs __class__s rr3zmyCustomGuardrail.__init__-s & "6"r)rrrrrcK|jd}|rS|D]N}|jd}t|ts%d|jvs8|j dd}||d<Pt j d||Sw)zz Runs before the LLM API call Runs on only Input Use this if you want to MODIFY the input messagescontentlitellmz********z-async_pre_call_hook: Message after masking %s)get isinstancer'lowerreplacerdebug)rrrrr _messagesmessage_contents rrz%myCustomGuardrail.async_pre_call_hook6s 88J/ $ 6";;y1h, HNN$44#+#3#3Iz#J-5 *  6 ""#RT]^ s:BB1BcK|jd}|rG|D]A}|jd}t|ts%d|jvs8t dyyw)z Runs in parallel to LLM API call Runs on only Input This can NOT modify the input, only used to reject or accept a call before going to LLM API r7r8r9z+Guardrail failed words - `litellm` detectedN)r:r;r'r< ValueError)rrrrr?r@rAs rasync_moderation_hookz'myCustomGuardrail.async_moderation_hookQsb 88J/ $ X";;y1h, HNN$44()VWW  X s:AAAcKtjd|t|tjr|j D]}t|tj stjd||jjsKt|jjtspd|jjvstdyyw)z Runs on response from LLM API call It can be used to reject a response If a response contains the word "coffee" -> we will raise an exception z async_pre_call_hook response: %szasync_pre_call_hook choice: %scoffeez Guardrail failed Coffee DetectedN) rr>r;r9 ModelResponsechoicesChoicesr@r8r'rC)rrrresponsechoices rasync_post_call_success_hookz.myCustomGuardrail.async_post_call_success_hookhs ""#ExP h 5 5 6"** Mfgoo6(../OQWX..&v~~'='=sC$(>(>>()KLL M 7sAC,C $C/CC)r!r"r#r3r rr%r rrr&r'rrDrL __classcell__)r5s@rr/r/,s#)  $  % 3,- . 6XX*X$ X.MM*Mr)r/)typingrrrrr9litellm._loggingrlitellm.caching.cachingr%litellm.integrations.custom_guardrailr litellm.proxy._typesr litellm.types.utilsr rr'int__annotations__rr,r/r(r)rrVsd//1-A/089q1AtCH~.A _  _ SMSMr)