tPjUdZddlZddlmZmZmZddlmZddlm Z ddl m Z ddl m Z ddlmZer dd lmZeZneZd Zeed <d Zeed <Gdde Zy)a Sensitive Data Routing Hook for LiteLLM Proxy. When a guardrail detects sensitive data and is configured with on_sensitive_data='route', this hook manages: 1. Storing the routing decision (session_id -> model) in cache 2. Checking incoming requests for existing routing overrides 3. Applying sticky routing so all subsequent requests in a session go to the same model Works across multiple proxy instances via DualCache (in-memory + Redis). N) TYPE_CHECKINGAnyFinal)verbose_proxy_logger) DualCache) get_session_id_from_request_data) CustomLogger)UserAPIKeyAuth)InternalUsageCachesensitive_routeSENSITIVE_ROUTING_CACHE_PREFIXiDEFAULT_SENSITIVE_ROUTING_TTLc eZdZdZdefdZdededefdZede d zdefd Z dede d zded zfd Z dded ede d zd ed zdd f dZ de de dededeezezd zf dZy )"_PROXY_SensitiveDataRoutingHandlera Pre-call hook that checks for existing sensitive data routing overrides and applies them to incoming requests. This hook runs early in the pre-call chain and modifies the request's model field if a routing override exists for the session. internal_usage_cachect||_ttjdt t |_y)NLITELLM_SENSITIVE_ROUTING_TTL)rintosgetenvstrrttl)selfrs o/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/hooks/sensitive_data_routing.py__init__z+_PROXY_SensitiveDataRoutingHandler.__init__+s.$8! II/12   session_idtenantreturnc"dtd|d|dS)N{:z}:model)r )rrrs r_make_cache_keyz2_PROXY_SensitiveDataRoutingHandler._make_cache_key4s231VHAj\RRruser_api_key_dictNc|y|jr |jSd|jfd|jfd|jffDcgc]\}}|r|d|}}}|rdj |SdScc}}w)a Identify the authenticated principal the routing override belongs to. API-key auth is scoped by the hashed key. JWT (and other keyless) auth has no api_key, so fall back to a stable identity claim. Without this, every keyless caller would share the ``default`` namespace and could read or overwrite another principal's session routing. defaultuserteamorgr"|)api_keyuser_idteam_idorg_idjoin)r$labelvalue principals r_resolve_tenantz2_PROXY_SensitiveDataRoutingHandler._resolve_tenant7s  $  $ $$,, ,*223*223)001! u  gQug   '0sxx ">Y> sA3cK|j||j|}|jjj |jjjj |d{}|{t |}|jjjj|d{}|jj||||n |jddd{|S |jj |ddd{}| t |Sy77s7?#t$r)}tjdt |Yd}~gd}~wwxYw7Mw)z7Get the model this session should be routed to, if any.N)keyTr5r1rlitellm_parent_otel_span local_onlyzLSensitiveDataRoutingHandler: Redis GET failed, falling back to in-memory: %s)r5r7r8) r#r3r dual_cache redis_cacheasync_get_cacher async_get_ttlasync_set_cacher Exceptionrwarning)rrr$ cache_keyresult routed_model remaining_ttles r_get_routed_modelz4_PROXY_SensitiveDataRoutingHandler._get_routed_modelPsu// D5D53D34D59#E,E*E,/D51D53D55 E'>E"E,"E''E,modelguardrail_namec4K|j||j|}tjd||||j|j j jE |j j jj|||jd{|j j|||jddd{y77#t$r)}tjdt|Yd}~bd}~wwxYw7<w)a  Store a routing override for a session. Called by guardrails when they detect sensitive data and want to route the session to a specific model. The override is scoped to the requesting principal so sessions from different tenants cannot collide. z_SensitiveDataRoutingHandler: Setting session routing session_id=%s model=%s guardrail=%s ttl=%sN)r5r1rzLSensitiveDataRoutingHandler: Redis SET failed, falling back to in-memory: %sTr6) r#r3rinforrr9r:r=r>r?r)rrrFr$rGr@rDs rset_session_routingz6_PROXY_SensitiveDataRoutingHandler.set_session_routingqs // D     %W ((:.4"5912rTrrrr"s  -? S#SsSsS?>D+@?S??0#.[_J_dgjndnJ48%) + + + *D0 + d +  + Z&)&& &  & S4 $ & &rr)rXrtypingrrrlitellm._loggingrlitellm.caching.cachingr%litellm.integrations.custom_guardrailr"litellm.integrations.custom_loggerr litellm.proxy._typesr litellm.proxy.utilsr _InternalUsageCacher __annotations__rrr[rrres\  ,,1-R;/M,):9'+u+bbr