uPj/UdZddlmZmZmZmZddlmZddlm Z ddl m Z ddl m Z erddlmZddlmZdd l mZdd lmZGd d e Ziaeeee fed <deeee ffdZGdde Zy)z Pass-Through Endpoint Message Handler for Unified Guardrails This module provides a handler for passthrough endpoint requests. It uses the field targeting configuration from litellm_logging_obj to extract specific fields for guardrail processing. ) TYPE_CHECKINGAnyFinalOptional)verbose_proxy_logger)BaseTranslation)PassThroughGuardrailSettings)GenericGuardrailAPIInputs)CustomGuardrail)Logging)UserAPIKeyAuth) ProxyLoggingc eZdZdZdeddedzdedzfdZded e edzdefd Z dded d dedde fd Z dde d d dedde dzdedzde f dZ y)PassThroughEndpointHandlerz Handler for processing passthrough endpoint requests with guardrails. Uses passthrough_guardrails_config from litellm_logging_obj to determine which fields to extract for guardrail processing. litellm_logging_objLiteLLMLoggingObjguardrail_nameNreturnc\ddlm}|yt|dd}|r|sy|j||S)zW Get the guardrail settings for a specific guardrail from logging_obj. r)PassthroughGuardrailHandlerNpassthrough_guardrails_config);litellm.proxy.pass_through_endpoints.passthrough_guardrailsrgetattr get_settings)selfrrrpassthrough_configs |/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/pass_through/guardrail_translation/handler.py_get_guardrail_settingsz2PassThroughEndpointHandler._get_guardrail_settingss@   &$+,?A`bf$g!*778JN[[datafield_expressionscHddlm}|r8|j||}tjd|r |dd|Sd|Sddlm}|jDcic]\}}|jdr|d vs||!}}}tjd ||Scc}}w) z Extract text from data for guardrail processing. If field_expressions provided, extracts only those fields. Otherwise, returns the full payload as JSON. r)JsonPathExtractor)r jsonpath_expressionsz9PassThroughEndpointHandler: Extracted targeted fields: %sN) safe_dumps_)metadatarzF8#:#:D $??FWX  & &'i jK2Hxx( #F7O+=+M+M + ,N, &  & sB-B8/B60B8responseuser_api_key_dictr<cKt|tstjd|S|j}tjd||j ||}|r |j nd}|j||} | s|S|%t|tsd|in|j}n)d|vr%t|ts|n|j|d<d|vr|j|} | r| |d<t| g} t|tr|jdnd} | r| | d<|j| |d|d{} |S7w) aU Process output response by applying guardrails to targeted fields. Args: response: The response to process guardrail_to_apply: The guardrail instance to apply litellm_logging_obj: Optional logging object user_api_key_dict: User API key metadata to pass to guardrails zPassThroughEndpointHandler: Processing output for guardrail=%sNrFlitellm_metadatar6r8r:) isinstancedictrr+rrresponse_fieldsr3copy'transform_user_api_key_dict_to_metadatar r@rA)rrFr4rrGr<rrBr!rC user_metadatar;response_modelrDs rprocess_output_responsez2PassThroughEndpointHandler.process_output_responsesg"(D) & &'e fO 2 A A"" L  667JN[?G8#;#;T $??J[\ O  9CHd9SJ1YaYfYfYhL-;EhPT;U8[c[h[h[j Z( \ 1#'#O#OPa#bM3@ /02H9CHd9S W 5Y] ,F7O+=+M+M%!+ ,N, & & sD=E?EENNNN)__name__ __module__ __qualname____doc__rstrr rrKlistr3rrErQrrrrs\%&9:\d \ & , \*!,!, 9t+!, !,N>B ''.'&&9: ' 'Z>B(,$( @@.@&&9: @ : @ Tk @ @rr_PROVIDER_HANDLERSrc.ts ddlm}d|iatS)Nr"BedrockPassthroughGuardrailHandlerbedrock)r[>litellm.llms.bedrock.passthrough.guardrail_translation.handlerr^r]s r_get_provider_handlersras  ()KL rc "eZdZdZ ddedddeddefd Z dd edddedd edzd edzdef d Ze de dzde de fdZ e de dzde dzfdZ e de dzfdZe de dzde dzde fdZe deddd ddedef dZy)LlmPassthroughRouteHandlerz Dispatcher for allm_passthrough_route guardrail translation. Routes to a per-provider handler based on data["custom_llm_provider"]. Unknown providers are skipped with a debug log. Nr r4r rrrcK|jd}tj|xsd}|tjd||S|j |||d{S7w)Ncustom_llm_providerJLlmPassthroughRouteHandler: no handler for provider=%s, skipping guardrail)r r4r)r@rarr+rE)rr r4rprovider handler_clss rrEz1LlmPassthroughRouteHandler.process_input_messagess| ((#893599(.bI   & &\ K ]991 3:    sA%A.'A,(A.rFrGr<cK|xsijd}tj|xsd}|tjd||S|j |||||d{S7w)Nrerfrg)rFr4rrGr<)r@rarr+rQ)rrFr4rrGr<rhris rrQz2LlmPassthroughRouteHandler.process_output_responses(-2223HI3599(.bI   & &\ O ]::1 3/% ;    sA+A4-A2.A4rh content_typecltj|xsd}t|dd}|y||S)Nrfis_event_stream_content_typeFrar@r)rhrkridetectors ris_event_stream_responsez3LlmPassthroughRouteHandler.is_event_stream_responses<3599(.bI !+/MtT   %%rcjtj|xsd}t|dd}|y|S)Nrfevent_stream_media_typern)rhrigetters rrrz2LlmPassthroughRouteHandler.event_stream_media_type s73599(.bI  -FM >xrcVtj|xsd}t|ddS)Nrfde_anonymize_event_streamrn)rhris r#_resolve_event_stream_de_anonymizerz>LlmPassthroughRouteHandler._resolve_event_stream_de_anonymizers)3599(.bI {$?FFrendpointcttj|xsd}t|dd}|y||xsdS)Nrf(event_stream_endpoint_is_de_anonymizableFrn)rhrwriendpoint_checks r&supports_event_stream_de_anonymizationzALlmPassthroughRouteHandler.supports_event_stream_de_anonymizationsA3599(.bI ' 5_ae f  !hn"--r body_bytesproxy_logging_objrr cK|jd}tj|}|tjd||S|||||d{S7w)Nrez^LlmPassthroughRouteHandler: no event-stream handler for provider=%s, leaving stream unmodified)r|r}rGr )r@rcrvrr+)r|r}rGr rh de_anonymizes rruz4LlmPassthroughRouteHandler.de_anonymize_event_stream"sm((#898\\]ef   & &p  !!//     sAAAArRrS)rTrUrVrWrKrrrErQ staticmethodrXboolrprrrvr{bytesrurZrrrcrcs>B   . &&9:   0>B(,$(   . &&9:  :  Tk    0&3:&S&T&&#*tGcDjGG.t.sUYz.^b..  ) ,      rrcN)rWtypingrrrrlitellm._loggingrrs761X=9EW30iiX8:Dd?3349S$*?%? @e e r