tPj?HUdZddlZddlZddlZddlmZddlmZmZmZm Z ddl Z ddl m Z ddl mZddlmZmZddlmZmZdd lmZdd lmZerdd lmZd Zeed <dZeed<dZeed<GddeZy)a@Akto guardrail integration for LiteLLM proxy. Uses a two-config-entry pattern: - akto-validate (pre_call): Checks request against Akto guardrails, blocks if flagged. - akto-ingest (post_call): Sends request+response to Akto for data ingestion. For monitor-only mode, enable only akto-ingest without akto-validate. N)datetime) TYPE_CHECKINGAnyFinalLiteral) HTTPException)verbose_proxy_logger)CustomGuardraillog_guardrail_information)get_async_httpx_clienthttpxSpecialProvider)GuardrailEventHooks)GenericGuardrailAPIInputs)GuardrailConfigModelz/api/http-proxyHTTP_PROXY_PATHlitellmAKTO_CONNECTOR_NAMEDEFAULT_GUARDRAIL_TIMEOUTceZdZdZdddZededfdZede e fdZ d/d e d zd e d zd e d zd e d zde dded zdedd ffd Zeded zde de d zfdZedede fdZdee e ffdZedededee e ffdZededee e ffdZe d0deded zdee effdZe d0deded zdee effdZededee e ffdZd d!d"deded#ed$edee eff d%Zdeded&edej<fd'Zedej<de ee ffd(Z!ded)e"defd*Z#deded&edd fd+Z$e% d0deded,e d-defd.Z&xZ'S)1 AktoGuardrailzOLiteLLM guardrail hook that validates and ingests LLM traffic via the Akto API.requestresponse)pre_call post_callreturnrcddlm}|S)z?Return the Pydantic config model for YAML-based initialization.rAktoConfigModel)3litellm.types.proxy.guardrails.guardrail_hooks.aktorrs w/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/guardrails/guardrail_hooks/akto/akto.pyget_config_modelzAktoGuardrail.get_config_model-s cBtjtjgSN)rrr)clss r!get_supported_event_hooksz'AktoGuardrail.get_supported_event_hooks6s  ( (  ) )  r#N akto_base_url akto_api_keyakto_account_id akto_vxlan_idunreachable_fallback) fail_closed fail_openguardrail_timeoutkwargsc ttj|_t |_|xs t jjddjd|_ |js td|xs t jjdd|_ |js td||_ |xst|_|xs t jjdd |_|xs t jjd d |_t%|j'|d <t)|Tdi|t-j.d |j|jy)u@Initialize the Akto guardrail. Args: akto_base_url: Akto API base URL. Falls back to AKTO_GUARDRAIL_API_BASE env var. akto_api_key: Akto API key. Falls back to AKTO_API_KEY env var. akto_account_id: Akto account ID. Falls back to AKTO_ACCOUNT_ID env var, then "1000000". akto_vxlan_id: Akto VXLAN ID. Falls back to AKTO_VXLAN_ID env var, then "0". unreachable_fallback: Behavior when Akto is unreachable — block or allow. guardrail_timeout: HTTP timeout in seconds for Akto API calls. ) llm_providerAKTO_GUARDRAIL_API_BASE/zTakto_base_url is required. Set AKTO_GUARDRAIL_API_BASE or pass it in litellm_params. AKTO_API_KEYzHakto_api_key is required. Set AKTO_API_KEY or pass it in litellm_params.AKTO_ACCOUNT_ID1000000 AKTO_VXLAN_ID0supported_event_hooksz3Akto guardrail initialized: base_url=%s fallback=%sN)r r GuardrailCallback async_handlersetbackground_tasksosenvirongetrstripr( ValueErrorr)r,rr/r*r+listr'super__init__r debug) selfr(r)r*r+r,r/r0 __class__s r!rHzAktoGuardrail.__init__=s3(4-?? &)U+\rzz~~>WY[/\ddehi!!st t(NBJJNN>2,N  gh hI]!!2!O6O.^"**..ART]2^*Rbjjnn_c.R*.t/M/M/O*P&' "6""" A     % % r# request_datakeyc|ydD]Y}|j|xsi}t|ts)|s,|j|}|@t|j cSy)zALook up a metadata value from litellm_metadata or metadata dicts.N)litellm_metadatametadata)rC isinstancedictstrstrip)rLrMdict_key containervalues r!resolve_metadata_valuez$AktoGuardrail.resolve_metadata_valuelsi  8 .H$((28bI)T*y! c*$u:++--  . r#c~|jdxsi}t|tsi}|jd}|r|SdS)zPExtract the API route from request metadata, defaulting to /v1/chat/completions.rPuser_api_key_request_routez/v1/chat/completions)rCrQrR)rLrProutes r!extract_request_pathz"AktoGuardrail.extract_request_pathysE ##J/52(D)H||$@Au9#99r#c d|jdS)z)Build HTTP headers for the Akto API call.application/json) content-type Authorization)r))rJs r!prepare_headerszAktoGuardrail.prepare_headerss/!..  r# guardrails ingest_datac2dti}|rd|d<|rd|d<|S)z^Build query params that control Akto backend behavior (guardrail check and/or data ingestion).akto_connectortruerbrc)r)rbrcparamss r!build_query_paramsz AktoGuardrail.build_query_paramss.*:;N(O #)F< $*F= ! r#cddi}|jdi}t|ts|S|jd}t|trC|jD]0\}}|s |s t ||t |j <2|S)z:Build the requestHeaders field from proxy request headers.r_r^proxy_server_requestheaders)rCrQrRitemsrSlower)rLrk proxy_reqproxy_req_headersrMvals r!build_request_headersz#AktoGuardrail.build_request_headerss+9:L)M'++,BBG )T*N#,==#; ' .-335 9S303CGCHNN,- 9r#inputsc|jddxsd}d|i}|jd}|r||d<na|3|jdr"|d|d<|jdr5|d|d<n,|jdg}|r|Dcgc]}d|d c}ng|d<|jd}|r||d<n||jdr|d|d<|jd }|r||d <|Scc}w) zJBuild the LLM request body from guardrail inputs (messages, model, tools).modelr4structured_messagesmessagestextsuser)rolecontenttools tool_calls)rC) rrrLrtbody structuredrwtr{r|s r!build_request_bodyz AktoGuardrail.build_request_bodys  zz'2.4"'.&6"JJ'<= )D   %,*:*::*F+J7D ( ,W 5W !::gr2ERWN1A >N]_D zz'* !DM  %,*:*:7*C(1DM"JJ|4 !+D   Os C#c|r|jdnd}|t|dr|jS|jdg}|rd|Dcgc] }d|ddi c}iSiScc}w) zOBuild the LLM response body, preferring the actual model response if available.rN model_dumprwchoicesmessage assistant)rzry)rChasattrr)rrrLmodel_responserwrs r!build_response_bodyz!AktoGuardrail.build_response_bodysy AM 0 0 +- #'#;#;FL#QM#zz64::m3L*MN  .0BC '++,BBG ?I)UY?Zy}}Y;`b mT *""#45]9J9J;9W][]BbyXXc]1%++- L djj9  tzz*:;  f  djj&$**\2J)KL  /   "  k  CHLLN446=>?  #k*  J  c+&  t33  T//  ' k! " # $ !::c? 3&1  r#payloadcK|jt}|j||}|j}|jj |t j||||jd{S7w)z+Send an HTTP POST to the Akto API endpoint.)rbrc)urldatargrktimeoutN) r(rrhrar>postrrr/)rJrbrcrendpointrgrks r! send_requestzAktoGuardrail.send_requests"//00AB//:S^/_--/'',,G$** -    sA8B:A?;Bc|jdk7rOtjd|jtjd|j|j | |j }t|tsy |jd xsi}t|tsy |jd xsi}t|tsy t|jddt|jddfS#t jtf$rM}t|dd}tjd|ddtjd |j |d}~wwxYw)z=Parse the Akto guardrail response. Returns (allowed, reason).rzAkto returned HTTP %dz Akto returned unexpected status rrtextr4z.Akto returned non-JSON body for status 200: %rNzAkto returned non-JSON body)r)Tr4rguardrailsResultAllowedTReason)rr errorhttpxHTTPStatusErrorrrJSONDecodeErrorrEgetattr RequestErrorrQrRrCboolrS)rresulte response_textrguardrails_results r!handle_guardrail_responsez'AktoGuardrail.handle_guardrail_response,s]   3 & & &'>@T@T U''283G3G2HI ((!  $MMOF&$'jj(.B$%#'88,>#?#E2+T2 "&&y$7 8 !%%h3 4  %$$j1 #*8VR#@M & &@ds# $$- ((  s DE)AE$$E)rc|jdk(r#tjdt|||Stjdt|t dd)zDHandle Akto being unreachable based on fail_open/fail_closed config.r.z Akto unreachable (fail-open): %s)exc_infoz"Akto unreachable (fail-closed): %siz"Akto guardrail service unreachablerdetail)r,r criticalrSrr)rJrrrs r!handle_unreachablez AktoGuardrail.handle_unreachableOs\  $ $ 3 ) )2E   M""#GUT7  r#cK |j|||d{}|jdk7r!tjd|jyy75#t$r)}tjdt |Yd}~yd}~wwxYww)zPSend a request without awaiting it in the caller. Errors are logged, not raised.rbrcrNrz%Akto fire-and-forget returned HTTP %dzAkto fire-and-forget error: %s)rrr r ExceptionrS)rJrbrcrrrs r!fire_and_forget_requestz%AktoGuardrail.fire_and_forget_requestcs Q$($5$5%'%6%H ##s*$**;((+  Q & &'GQ P P Qs>BAA3ABA BB;BBB input_typercfK|jjt|j}|r||k7r|S|dk(r |j ||d} |j dd|d{}|j |\}} |s|j ||dd } tjd tjd | d i| d <tjddi| d<tj|j!dd| } |j"j%| | j'|j"j(td| xsd|S|dk(r{|j ||d}tj|j!dd|} |j"j%| | j'|j"j(|S7v#t$rtjtjf$r} |j|| cYd} ~ Sd} ~ wwxYww)a2Main entry point called by LiteLLM's guardrail framework. Pre_call (input_type="request"): - Awaits guardrail check. If blocked, fires off ingest with 403 marker and raises. Post_call (input_type="response"): - Fire-and-forget combined guardrail + ingest call. rF)rTrN)rrri)rrr}z Akto Proxy)z x-blocked-byreasonrr_r^rzBlocked by Akto Guardrailsrr) HOOK_TO_INPUTrCrS event_hookrrrrrrrrrrasyncio create_taskrr@addadd_done_callbackdiscard) rJrrrLr logging_objexpectedrrallowedrrblocked_payloadtasks r!apply_guardrailzAktoGuardrail.apply_guardrailys[ ,,00T__1EF J.M  "--flUZ-[G (,(9(9# %#):)# #'"@"@"J)-)@)@ %* # *A* 6:ZZ LTZ+[ \6 12 6:ZZ#%786 12**00#($( /1%%))$/&&t'<'<'D'DE# #!A%A$ : %--flUY-ZG&&,,# $#-D  ! ! % %d +  " "4#8#8#@#@ A u# ! &&(=(=> ..!/ sIAH1G%,G"-G%EH1"G%%,H.H)#H.$H1)H..H1)NNNNr-Nr%)(__name__ __module__ __qualname____doc__r staticmethodrr" classmethodrFrr'rSrrrrHrRrXr\rarrhrqrrrrrrResponsertuplerrrrr r __classcell__)rKs@r!rr'sY"+DMd#9: $/B*C  %)#'&*$(DQ(,- Tz- Dj- t - Tz - &&@A - :- -  - ^ TD[ s sTz  :4:C:: c3h $Td3PS8n D T#s(^  %))Tk c3h>%) ) Tk  c3h    $sCx.   !& ; ); ;  ;  ;  c3h; z        &  ENN  uT3Y?O    D )   #  (QQ Q  Q  Q,  Q)QQ12 Q # QQr#r) rrrrArtypingrrrrrfastapirlitellm._loggingr %litellm.integrations.custom_guardrailr r &litellm.llms.custom_httpx.http_handlerr r litellm.types.guardrailsrlitellm.types.utilsr3litellm.types.proxy.guardrails.guardrail_hooks.baserr__annotations__rrrr<r#r!rsm 55 !199X**&U&#$5$dOdr#