uPjUdZddlZddlmZmZddlmZmZddlmZm Z m Z m Z m Z m Z mZmZmZddlmZddlmZddlmZdd lmZmZmZmZmZmZmZmZm Z m!Z!erdd l"m#Z#d Z$e e%d <Gd deZ&GddedZ'Gdde Z(Gdde Z)Gdde Z*ddde*fdZ+d$dZ,de(defdZ-Gd d!Z.da/e.dze%d"<de.fd#Z0y)%z Policy Registry - In-memory storage for policies. Handles storing, retrieving, and managing policies. Policies define WHAT guardrails to apply. WHERE they apply is defined by policy_attachments (see AttachmentRegistry). N)MappingSequence)datetimetimezone) TYPE_CHECKINGAnyFinalLiteralOptionalProtocol TypedDictUnioncast)verbose_proxy_logger) TableActions)PolicyRepository) GuardrailPipeline PipelineStepPolicyPolicyConditionPolicyCreateRequestPolicyDBResponsePolicyGuardrailsPolicyUpdateRequestPolicyVersionCompareResponsePolicyVersionListResponse) PrismaClientpolicy_POLICY_VERSION_ID_PREFIXceZdZUeed<y)_RawPipelineStep guardrailN)__name__ __module__ __qualname__str__annotations__p/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/policy_engine/policy_registry.pyr!r!0sNr)r!c2eZdZUeed<eeedfed<y)_RawPipelineConfigmoder!stepsN)r#r$r%r&r'rrrr(r)r*r,r,4s I E,(::; <z!_PolicyVersionSourceRow.conditionds>Ar)cyrMr(rNs r*r?z _PolicyVersionSourceRow.pipelinegs=@r))r#r$r%propertyr&r2r3rDr4r:r;rr<r=rrHr>r?r(r)r*rJrJNs #3## %S%% ((( (t(( ,S4Z,, 9  499 <8C=4#7<< A73;/#5<AA @'#v+.4t;@@r)rJceZdZdeeefdefdZdeeefdedzfdZ d deeefdzdeeefdzde efdZ deeefdeeefdefd Z deeefdeeefde fd Z deeefdedzfd Zdeeefde fd Zy)_PolicyTableClientdatarKc KywrMr()rOr\s r*createz_PolicyTableClient.createlwhereNc KywrMr(rOras r* find_uniquez_PolicyTableClient.find_uniquenr_r`orderc KywrMr()rOrares r* find_manyz_PolicyTableClient.find_manyps  #r`c KywrMr(rOrar\s r*updatez_PolicyTableClient.updatevr_r`c KywrMr(ris r* update_manyz_PolicyTableClient.update_manyxr_r`c KywrMr(rcs r*deletez_PolicyTableClient.deletezr_r`c KywrMr(rcs r* delete_manyz_PolicyTableClient.delete_many|r_r`NN)r#r$r%rr&rHr1r^rdrrgrjrDrlrnrpr(r)r*r[r[ksIf!5I*IVwsF{';V T@QV.2*.#sF{#d*#sCx 4'# *  # g'#v+"6fgc6k>RfWafdwsF{';d73PV;CWd\_dQ'#v+"6Q:;LQHwsF{';HHr)r[ prisma_clientrrKcDt|j}td|S)Nr[)rtablerrrrts r* _policy_tablervs$#M288E e r)c0t|j}|SrM)rrtrus r*_policy_version_source_tablerxs:J=:Y:_:_E Lr)rowc tdid|jd|jdt|dddt|dddt|ddd t|d d d t|d dd t|d dd |jd|j d|j xsgd|jxsgd|jd|jd|jd|jd|jd|jS)z=Build PolicyDBResponse from a Prisma LiteLLM_PolicyTable row.r2r3r4r5 productionr6Nr7Tr8r9r:r;r<r=r>r?r@rArBrCr()rr2r3getattrr:r;r<r=r>r?r@rArBrC)rys r*_row_to_policy_db_responser~s8  -- OO s$4a8 s$4lC   "#':DA   #{D1  S.$7 c?D9   OO ))/R //52 --  >>  >>! ">># $>>% r)c eZdZdZdZdeeeeeffddfdZ dedeee fde fd Z e d ed dedzfd Zdede dzfd Zdeee ffdZdeefdZdedefdZdefdZd2dZdededdzfdZdeee ffdZd3dede dedddfdZdedefdZ d4dedddedzdefdZ d4dede!ddd edzdef d!Z"dedddeeeffd"Z#dedddedzfd#Z$dede%ee fdzfd$Z& d4ddd%edzdeefd&Z' d5d'Z(dedddeefd(Z)deddde*fd)Z+ d6deddd*edzdedzdef d+Z, d4ded,eddd edzdef d-Z-d.ed/eddde.fd0Z/dedddeeeffd1Z0y)7PolicyRegistryaT In-memory registry for storing and managing policies. This is a singleton that holds all loaded policies and provides methods to access them. Policies define WHAT guardrails to apply: - Base guardrails via guardrails.add/remove - Inheritance via inherit field - Conditional guardrails via condition.model cJi|_i|_i|_i|_d|_y)NF) _policies_config_policies_sources_policies_by_id _initializedrNs r*__init__zPolicyRegistry.__init__s(,.68?A >@"'r)policies_configrKNc.i|_i|_i|_i|_|j D]=\}} |j ||}||j|<t jd|?t|j|_|jDcic]}|dc}|_d|_ t jdt|jy#t$r.}t jd||td|d||d}~wwxYwcc}w) z Load policies from a configuration dictionary. Args: policies_config: Dictionary mapping policy names to policy definitions. This is the raw config from the YAML file. zLoaded policy: %szError loading policy '%s': %szInvalid policy 'z': NconfigTzLoaded %s policies)rrrritems _parse_policyrdebug Exceptionerror ValueErrorrGrinfolen)rOrr3 policy_datapolicyes r* load_policieszPolicyRegistry.load_policiess " !(7(=(=(? P $K P++KE.4{+$**+> L  P!%T^^ 4BF..Q;h.Q  !!"6DNN8KL P$**+JKYZ[ #3K=A3!GHaO P Rs7C D D!)D  Dr3rc|jdi}t|tr,t|jd|jd}nt|r|nd}d}|jd}|rt |jd }t j |jd }t|jd |jd ||| S)z Parse a policy from raw configuration data. Args: policy_name: Name of the policy policy_data: Raw policy configuration Returns: Parsed Policy object guardrailsaddremoverrN)rr>model)rr?r:r;r:r;rr>r?)get isinstancerGrrr_parse_pipeliner)rOr3rguardrails_datarr>condition_datar?s r*rzPolicyRegistry._parse_policys"-r!B ot ,)#''.&**84J *oVZ[J + < 'n.@.@.IJI)889TUOOI.# 6!   r) pipeline_datar,c|y|jdg}|Dcgc]}t|tr tdi|n|!}}t |jdd|Scc}w)z-Parse a pipeline configuration from raw data.Nr.r-pre_call)r-r.r()rrrGrr)r steps_data step_datar.s r*rzPolicyRegistry._parse_pipelinesq  GTGXGXY`bdGe jtu]fjD.I* *yXuu ""6:6  vs$Ac8|jj|S)z Get a policy by name. Args: policy_name: Name of the policy to retrieve Returns: Policy object if found, None otherwise )rrrOr3s r* get_policyzPolicyRegistry.get_policy s~~!!+..r)c6|jjS)zz Get all loaded policies. Returns: Dictionary mapping policy names to Policy objects )rcopyrNs r*get_all_policieszPolicyRegistry.get_all_policiess~~""$$r)cHt|jjS)zb Get list of all policy names. Returns: List of policy names )rFrkeysrNs r*get_policy_nameszPolicyRegistry.get_policy_namessDNN'')**r)c||jvS)z Check if a policy exists. Args: policy_name: Name of the policy to check Returns: True if policy exists, False otherwise )rrs r* has_policyzPolicyRegistry.has_policy'sdnn,,r)c|jS)z Check if the registry has been initialized with policies. Returns: True if policies have been loaded, False otherwise )rrNs r*is_initializedzPolicyRegistry.is_initialized3s   r)c<i|_i|_i|_d|_y)z7 Clear all policies from the registry. FN)rrrrrNs r*clearzPolicyRegistry.clear<s" " !r))dbrc8|jj|S)zS Return the provenance of an in-memory policy, or None if unknown. )rrrs r* get_sourcezPolicyRegistry.get_sourceEs}}  --r)c,t|jS)zT Return the policies loaded from config.yaml, keyed by policy name. )rGrrNs r*list_config_policiesz#PolicyRegistry.list_config_policiesKsD))**r)rsourcec||j|<i|j||i|_|dk(ri|j||i|_d|_t j d|y)z Add or update a single policy. Args: policy_name: Name of the policy policy: Policy object to add source: Provenance of the policy ("db" or "config") rTzAdded/updated policy: %sN)rrrrrr)rOr3rrs r* add_policyzPolicyRegistry.add_policyQsd'-{#>4==>+v> X $Rt'<'<$Rk6$RD ! ""#={Kr)c||jvry|jj|}|=||j|<i|j|di|_t j d|y|j|=|jj Dcic]\}}||k7s ||c}}|_t j d|ycc}}w)a: Remove a policy by name. If a config-defined policy shares the name, it is restored immediately instead of waiting for the next DB sync. Args: policy_name: Name of the policy to remove Returns: True if policy was removed, False if it didn't exist Frz3Removed policy: %s; restored config-defined versionTzRemoved policy: %s)rrrrrrr)rOr3config_fallbacknamers r* remove_policyzPolicyRegistry.remove_policyas dnn ,!%!6!6!:!:;!G  &*9DNN; 'Dt}}Dk8DDM & &'\^i j NN; ':>--:M:M:Og,$SW[fSfvg ""#7Ehs  C"Cpolicy_requestrrrrBc <K tjtj}|jddd||j xsg|j xsg||d }|j|j|d<|j|j|d<| ||d<||d <|j0tj|jj|d <|j;tdi|j}tj|j|d <t|j!| d{}|j#|j|j|j|j |j d |jr|jjnd|jd}|j%|j|t'|S7#t($r)} t+j,d| t)d| d} ~ wwxYww)a' Add a policy to the database. Args: policy_request: The policy creation request prisma_client: The Prisma client instance created_by: User who created the policy Returns: PolicyDBResponse with the created policy r{r|T) r3r4r5r7r9r<r=r@rANr:r;rBrCr>r?r\rrzError adding policy to DB: %szError adding policy to DB: r()rnowrutcr3r<r=r:r;r>jsondumps model_dumpr?rrvr^rrr~rr exception) rOrrrrBrr\validated_pipelinecreated_policyrrs r*add_policy_to_dbzPolicyRegistry.add_policy_to_db}s"2 ?!hll3C .99"#".!!$"0"?"?"E2%3%E%E%K!! .D%%1"0"8"8Y))5&4&@&@]#%%/\"%/\"''3$(JJ~/G/G/R/R/T$U[!&&2,=,X@W@W,X"#'::.@.K.K.M#NZ *7 *F*M*MSW*M*X$XN!..**-55#1#=#=-<<"0"B"B#LZKcKc.":":"E"E"Gim . 7 7  F OON66 ?-n= =%%Y& ? * *+JA N9!=> > ?s<HD8G'<G%=B'G'$H%G'' H0$HHHr2rCcK t|jd|id{}|td|dt|dd}|dk7rtd |d t j t j|d }|j|j|d <|j|j|d <|j|j|d<|j|j|d<|j|j|d<|j0tj|jj!|d<|j";t%di|j"}tj|j!|d<t|j'd|i|d{} t)| S77#t$r)} t+j,d| td| d} ~ wwxYww)a Update a policy in the database. Only draft versions can be updated. Args: policy_id: The ID of the policy to update policy_request: The policy update request prisma_client: The Prisma client instance updated_by: User who updated the policy Returns: PolicyDBResponse with the updated policy Raises: Exception: If policy is not in draft status (only drafts are editable). r2raNPolicy with ID not foundr5r|draftzr?rar\zError updating policy in DB: %szError updating policy in DB: r()rvrdrr}rrrrr3r:r;r<r=r>rrrr?rrjr~rr) rOr2rrrrCexistingr5 update_datarupdated_policyrs r*update_policy_in_dbz"PolicyRegistry.update_policy_in_dbs ,( A$1-$@$L$LT_ajSk$L$llH/)J GHH$+H6F $UN("^_m^nnp qrr'll8<<8(5K ))5-;-G-G M*%%1)7)?)? I&))5-;-G-G M*,,80>0M0M ,-//;3A3S3S /0''3+/::n6N6N6Y6Y6[+\ K(&&2,=,X@W@W,X"*.**5G5R5R5T*U J'*7 *F*M*M"I. +N+%N.n= =Im:% A * *+La P;A3?@ @ AsKG6 GF<FG,F?-G;G6<G?G G3 $G..G33G6cK t|jd|id{}|td|dt|dd}|j}t|j d|id{dd |d i}|dk(r1|j ||j|d k(rd |d <|Sd|d <|S77F#t$r)}tjd|td|d}~wwxYww)a Delete a policy version from the database. If the deleted version was production, it is removed from the in-memory registry. No other version is auto-promoted; admin must explicitly promote. Args: policy_id: The ID of the policy version to delete prisma_client: The Prisma client instance Returns: Dict with "message" and optional "warning" if production was deleted. r2rNrrr5r|messagePolicy z deleted successfullyrz]Production version was deleted. The config-defined policy with the same name is active again.warningzProduction version was deleted. No other version was promoted. Promote another version to production if this policy should remain active.z!Error deleting policy from DB: %szError deleting policy from DB: ) rvrdrr}r3rnrrrr)rOr2rrrr5r3resultrs r*delete_policy_from_dbz$PolicyRegistry.delete_policy_from_dbs1$ C"/ ">"J"JR]_hQi"J"jjF~/)J GHH$+F4Dl$SN!'!3!3K .55[)"J"JR]_hQi"J"jjF~-f5 5 k  B * *+Mq Q to execute a specific version (e.g. published or draft). The cache is populated by sync_policies_from_db, which loads draft and published versions keyed by policy_id. Args: policy_id: The policy version ID (raw UUID, no prefix) Returns: (policy_name, Policy) if found, None otherwise )rr)rOr2s r*get_policy_by_id_for_requestz+PolicyRegistry.get_policy_by_id_for_requestNs##'' 22r)r5cK i}|||d<t|j|r|ndddid{}|Dcgc] }t|c}S7cc}w#t$r)}t j d|td|d}~wwxYww)ak Get all policies from the database, optionally filtered by version_status. Args: prisma_client: The Prisma client instance version_status: If set, only return policies with this status ("draft", "published", "production"). Returns: List of PolicyDBResponse objects Nr5r@descrarez"Error getting policies from DB: %sz Error getting policies from DB: )rvrgr~rrr)rOrrr5rapoliciesprs r*get_all_policies_from_dbz'PolicyRegistry.get_all_policies_from_db^s D+-E)*8&'$1-$@$J$J$e$#V,%K%H qcBC C DsIB .AAAA AB AA B  $BB  B c K |j|dd{}|Dcic]n}|j|j|j|j|j|j |j d|j|jdp}}t|t|jzD]}tjd||jDcic]}|d}}|Dcic]}|d}}i|j||_ i|||_i|_t!|j#d d d d giid did{} | D]} |j| j| j| j| j xsg| j xsgd| j| jd} | j| f|j| j$<d|_tj(dt+|t+| t+|jy7cc}wcc}wcc}w7#t,$r)} tj.d| t-d| d} ~ wwxYww)a Sync policies from the database to in-memory registry. - Production versions are loaded into _policies (by policy name) for resolution. - Config-loaded policies are preserved; on a name conflict the DB version wins. - Draft and published versions are loaded into _policies_by_id so request-body policy_ overrides can be resolved without DB access in the hot path. r|r5NrrzVPolicy '%s' is defined in both config.yaml and the DB; the DB version takes precedencerrr5inr publishedr@rrTzSynced %s production policies and %s draft/published (by ID) from DB to in-memory registry (%s config-defined policies preserved)z"Error syncing policies from DB: %sz Error syncing policies from DB: )rr3rr:r;r<r=r>r?setrrrrrrrvrgr2rrrrr) rOrrr|policy_response db_policiesr3rconfig_sources db_sourcesnon_productionryrrs r*sync_policies_from_dbz$PolicyRegistry.sync_policies_from_db}s: D&*&C&CMbn&C&o oJ(2"$ ++T-?-?#//#2#:#:'6'B'B#2#A#A&5&G&G'&5%>%>$3$<$<  . "K" #;/#d6K6K2LL  $,,l  ae`u`uDvX\T8^DvNDv_jGkW[d GkJGkE 5 5EEDN<~<qcBC C DsqI4H?H+H?A3H.A H?" H3,H?2 H8r?resolve_policy_guardrailssortedrrrr) rOr3rrrr temp_policiesrrresolved_policyrs r*resolve_guardrails_from_dbz)PolicyRegistry.resolve_guardrails_from_dbs#" O H$($A$A-`l$A$mmH$&M#+ D++#//#2#:#:'6'B'B#2#A#A&5&G&G'&5%>%>$3$<$<  >D o99: D"&4%M%M'&&N&O /445 57n8 H * *+SUV WB1#FG G Hs9C>C CB%C C>C C;$C66C;;C>c2K t|jd|iddid{}|Dcgc] }t|}}t||t |S73cc}w#t $r)}t jd|t d|d}~wwxYww) a, Get all versions of a policy by name, ordered by version_number descending. Args: policy_name: Name of the policy prisma_client: The Prisma client instance Returns: PolicyVersionListResponse with policy_name and list of versions r3r4rrN)r3versions total_countzError getting versions: %szError getting versions: )rvrgr~rrrrr)rOr3rrrowsrrrs r*get_versions_by_policy_namez*PolicyRegistry.get_versions_by_policy_names < -m < F F$k2'0!G!DGKK9!<KHK,'!M  L  < * *+G K6qc:; ; r?rzError creating new version: %szError creating new version: )rxrdrr3 find_firstr4rrrrrvrlr2r:r;r<r=r>rrGrrr?r^r~rr) rOr3rrrrBrprodlatestnext_numrr\createdrs r*create_new_versionz!PolicyRegistry.create_new_versions(@ @+;MJVV&(89 W >#n5E4Fj$QRR%%4#&:6;M;M:NN`al`mmn$opp%A$O$Z$Z'2*6%[% <#&N{m[\$]^^#?}"M"X"X$k2'0#Y#F>Dv44q8H!hll3C .::$k2!5);   +"*")%+%5%5! $!%!>>%11"("7"7"=2%+%=%=%C!!((.D$+4>v?O?OQU4VDJJv//0\b\l\l[!*BLV__^bBc4::foo#>ioixixZ #0#?#F#FD#F#QQG-g6 6w <R @ * *+KQ O:1#>? ? @sJ "IIA!II  :IIAI!I"DI8I9IJ I IIII J$JJJ  new_statusc >K |dvrtd|dt|jd|id{}|td|dt|d d }|j}t j tj}|d k(rJ|d k7rtd |dt|jd|id |||dd{} t| S|dvrtd|d|d k(r tdt|j|d dd ||dd{t|jd|id |||dd{} |j||j|| j| j| j xsg| j"xsgd| j$| j&d} |j)|| t| S7777#t$r)} t+j,d| td| d} ~ wwxYww)a Update a policy version's status. Valid transitions: - draft -> published (sets published_at) - published -> production (sets production_at, demotes current production to published, updates in-memory) - production -> published (demotes, removes from in-memory) - draft -> production: NOT allowed (must publish first) - published -> draft: NOT allowed Args: policy_id: The policy version ID new_status: "published" or "production" prisma_client: The Prisma client instance updated_by: User who updated Returns: PolicyDBResponse for the updated version )rr|zInvalid status 'z#'. Use 'published' or 'production'.r2rNrrr5r|rrz7Only draft versions can be published. Current status: 'r)r5r8rArCr)rrzJOnly draft or published versions can be promoted to production. Current: 'zGCannot promote draft directly to production. Publish the version first.r)r5rArC)r5r9rArCrrz!Error updating version status: %szError updating version status: )rrvrdr}r3rrrrrjr~rlrrr:r;r<r=r>r?rrr) rOr2rrrrCrycurrentr3rupdatedrrs r*update_version_statusz$PolicyRegistry.update_version_statusms0O C!<<"2:,>a bcc,];GG{\eNfGggC{/)J GHH$S*:LIG!$K!hll3C[(g%#&]^e]ffh$ijj -m < C C& 2*5(+&)&0 !D!2'::44`ah`iikl'! ijj .::#.&2 '2"%", ;   *-8??"I.&2%("%", @G   { + ..&#*#6#6&55;")";";"Ar#")!2!2 ' 0 0  F OOK 0-g6 6Qh* 8 C * *+NPQ R=aSAB B Cs}H3G(GBG(G! G(HA G(!G$"*G( G& BG(HG(!G($G(&G(( H1$HHH policy_id_a policy_id_bcK t|jd|id{}t|jd|id{}|td|d|td|dt|}t|}d}i} |D](} t || } t || } | | k7s!| | d| | <*t ||| S77}#t$r)} t jd | td | d} ~ wwxYww) aT Compare two policy versions and return field-by-field diffs. Args: policy_id_a: First policy version ID policy_id_b: Second policy version ID prisma_client: The Prisma client instance Returns: PolicyVersionCompareResponse with both versions and field_diffs r2rNrr)r:r;r<r=r>r?) version_a version_b)rr field_diffszError comparing versions: %szError comparing versions: )rvrdrr~r}rrr)rOrrrrabresp_aresp_bcompare_fieldsrfieldval_aval_brs r*compare_versionszPolicyRegistry.compare_versionss9"" >*=9EE[ZeLfEggA*=9EE[ZeLfEggAy'+j ABBy'+j ABB6q9F6q9F%N@BK' R..E>7<5)QK&  R 0  ' 5hg< > * *+I1 M8<= = >sQC> C C$C C A"C -C C>C C C;$C66C;;C>c,K t|jd|id{|j|d|d}|j|dk(r|ddSd |iS78#t$r)}t j d |t d |d}~wwxYww) a8 Delete all versions of a policy. Also removes from in-memory registry. Args: policy_name: Name of the policy prisma_client: The Prisma client instance Returns: Dict with "message" and optional "warning" if a config-defined policy took over. r3rNzAll versions of policy 'z' deleted successfullyrz[All DB versions were deleted. The config-defined policy with the same name is active again.)rrrzError deleting all versions: %szError deleting all versions: )rvrprrrrr)rOr3rrrrs r*delete_all_versionsz"PolicyRegistry.delete_all_versions s A .::-Q\A]:^ ^ ^   { +7 }DZ[G{+x7&u w' ' _ A * *+La P;A3?@ @ AsDB AA3ABABA B($B  BB)rKN)rrM)rrrrKNrq)1r#r$r%__doc__rrr&rGrHrrrr staticmethodr rrrrrFrrErrrr rrrrrrrrrrrtuplerrrrrrr rrr!r#r(r)r*rrs (MWS$sF{:K5K-LMQUM6% % 4S>% f% N   45  T !     /c /ftm /%$sF{"3%+$s)+ -c -d -!!".c.gn.E.L. +gc6k&:+ LcL6L7>CZLfjL @"& C?+C?&C?$J C?  C?T"& >A>A,>A& >A $J >A  >A@0C0C&0C c  0CdBB&B D B43c3eCK>PSW>W3&&*D%Dd D   D>ED%ED EDN3H3H&3H c 3Hj<<&< # 3>3>& 3> & 3>jAA&A c  Ar)r_policy_registryc.t tatS)zk Get the global PolicyRegistry singleton. Returns: The global PolicyRegistry instance )r'rr(r)r*get_policy_registryr)/s)+ r))rrrrKz%TableActions[_PolicyVersionSourceRow])1r$rcollections.abcrrrrtypingrrr r r r r rrlitellm._loggingr%litellm.repositories.prisma_protocolsr'litellm.repositories.table_repositoriesr!litellm.types.proxy.policy_enginerrrrrrrrrrlitellm.proxy.utilsrrr'r!r,r1rJr[rvrxr~rr'r)r(r)r*r1s -'   2>D   0#,%+y=%= *AhA:II(4F J3C0EAEAR+/.4'. ^ r)