tPj.UdZddlZddlmZmZmZmZmZmZddl m Z ddl m Z ddl mZddlmZmZddlmZmZdd lmZdd lmZdd lmZer dd lmZdd lmZdZ ee!d<dZ"ee!d<GddedZ#GddeZ$Gdde%Z&GddeZ'y)z PromptGuard guardrail integration for LiteLLM. Calls the PromptGuard Guard API to scan messages for prompt injection, PII, topic violations, and entity blocklist matches before and after LLM calls. N) TYPE_CHECKINGAnyFinalLiteralOptional TypedDict)ReadOnly)verbose_proxy_logger)GuardrailRaisedException)CustomGuardraillog_guardrail_information)get_async_httpx_clienthttpxSpecialProvider)GuardrailEventHooks)AllMessageValues)GenericGuardrailAPIInputs)Logging)GuardrailConfigModelzhttps://api.promptguard.co_DEFAULT_API_BASEz /api/v1/guard_GUARD_ENDPOINTcheZdZUdZeeed<eeed<eeed<eeed<eee ed<y)PromptGuardGuardAPIResponsezFsm#sm%5 677r'rF)totalc"eZdZUdZeeed<y)PromptGuardHTTPViewzATyped read of the untyped JSON body returned by the httpx client.guard_responseN)rrr r!r rr#r&r'r(r+r+2sK899r'r+c eZdZy)PromptGuardMissingCredentialsN)rrr r&r'r(r.r.8sr'r.c eZdZ ddedzdedzdedzdeddf fd Zededdzfd Z e de e fd Z e dd ed eeefd eddeddef dZede ede efdZxZS)PromptGuardGuardrailNapi_keyapi_baseblock_on_errorkwargsreturnc 2|xstjjd|_|js t d|xs'tjjdxst j d|_|8tjjdd}|jdv|_ n||_ ttj|_ |jd t|j!t#|Hd i|y) NPROMPTGUARD_API_KEYztPromptGuard API key is required. Set PROMPTGUARD_API_KEY in the environment or pass api_key in the guardrail config.PROMPTGUARD_API_BASE/PROMPTGUARD_BLOCK_ON_ERRORtrue)r;1yes) llm_providersupported_event_hooksr&)osenvirongetr1r.rrstripr2lowerr3rrGuardrailCallback async_handler setdefaultr%get_supported_event_hookssuper__init__)selfr1r2r3r4env __class__s r(rJzPromptGuardGuardrail.__init__=s "**.. !#  ||/( "`RZZ^^4J%K`O`hhilm  !(DfMC"%))+2#D  #1D 3-??  148V8V8X3YZ "6"r'rcddlm}|S)NrPromptGuardConfigModel):litellm.types.proxy.guardrails.guardrail_hooks.promptguardrPrOs r(get_config_modelz%PromptGuardGuardrail.get_config_modelcs &%r'cBtjtjgSN)rpre_call post_call)clss r(rHz.PromptGuardGuardrail.get_supported_event_hooksks  ( (  ) )  r'inputs request_data input_type)requestresponse logging_objLiteLLMLoggingObjc K|jdg}|jdg}|jdg}|jd}|r t|} n|r|D cgc]} d| d } } n|S|dk(rdnd } | | d } |r|| d<|r|| d<|jt} t j d | | t | t | |jj| |jd d | dd{}|jd|ji}|d}t j d|jd|jd|jdxsd}|dk(rX|jdd}|jdd}|jdd}t!|j"d|d|d |d!d"#|d$k(r6|jd%}|r#|r||d<d|vr|j%|}|r||d<|Scc} w7#t$rR}t jdt||jrt!|j"d|||cYd}~Sd}~wwxYww)&Ntextsimagesstructured_messagesmodeluser)rolecontentr[inputoutput)messages directionz,PromptGuard: %s direction=%s msgs=%d imgs=%dzapplication/json)z X-API-Keyz Content-Typeg$@)urlheadersjsontimeoutr,zPromptGuard API error: %sz3PromptGuard API unreachable (block_on_error=True): )guardrail_namemessagez"PromptGuard: decision=%s threat=%srrallowblockunknownrrgzBlocked by PromptGuard: z (confidence=z , event_id=)T)rorpblocked_contentredactr)rBr%r2rr debuglenrFpostr1raise_for_statusrm Exceptionerrorr"r3r ro_extract_texts_from_messages)rKrXrYrZr]r`rarbrcritextrjpayloadendpointr\viewresultexcrrrrredacted extracteds r(apply_guardrailz$PromptGuardGuardrail.apply_guardrailrszz'2. 8R0%+ZZ0Er%Jzz'* /0H FKLdD9LHLM&0I&=78 !"-  $GG   &GH !]]OO+<="" :   M K   $($6$6$;$;!%$6%<%H  % % '0@(--//RD !12F "" 0 JJz " JJ} % !**Z0;G w !'M9!EK$jjR8H & < =J*#223K= j\Ydemdnnop $  x $jj)<=H&4rs JJ&17969857((8)58:):  I j?jr'