tPj3U `UdZddlZddlmZddlmZmZddlmZm Z m Z m Z ddl m Z ddlmZmZmZmZddlmZdd lmZdd lmZdd lmZdd lmZmZmZmZm Z er dd l!m"Z#ddl$m%Z%eZ&ee'd<dddedfdZ(de)de*fdZ+dede,fdZ-dedee*e)fdzfdZ.dddefdZ/dAdZ0de*de1de*de fd Z2dddddeddfd!Z3ddded"e*de,fd#Z4de1de,fd$Z5ded%e*dzd&e*dzde6e*dze*dzffd'Z7e&jqd(d)ge ege*e efd+edefd,Z9e&jud(d)ge ege*e dd-.e dd/.e d0d01e d2d0d34e efd5e*dzd6e*dzd7e;d8e;def d9Ze&jud=d)ge ege*e efd5e*defd>Z?e&jd=d)ge ege*e efd5e*d+e defd?ZAe&jd=d)ge ege*e efd5e*defd@ZCy)Ba MEMORY MANAGEMENT CRUD endpoints for user/team-scoped memory entries. POST /v1/memory - Create a memory entry GET /v1/memory - List memory entries visible to the caller GET /v1/memory/{key} - Get a single memory entry by key PUT /v1/memory/{key} - Upsert (create or update) a memory entry by key DELETE /v1/memory/{key} - Delete a memory entry by key Scoping: - Rows carry both `user_id` and `team_id` (each optional). - Visibility: PROXY_ADMIN sees all rows. Non-admin callers see rows whose `user_id` matches their own OR whose `team_id` matches their own. - On create, `user_id`/`team_id` default to the caller's identity unless the caller is a PROXY_ADMIN who explicitly supplies a different scope. N)Mapping) TYPE_CHECKINGFinal) APIRouterDepends HTTPExceptionQuery)verbose_proxy_logger)CommonProxyErrorsLitellmUserRolesUserAPIKeyAuthuser_api_key_has_admin_view)user_api_key_auth) TableActions)MemoryRepository)TeamRepository)LiteLLM_MemoryRowMemoryCreateRequestMemoryDeleteResponseMemoryListResponseMemoryUpdateRequest)models) PrismaClientrouter prisma_clientrreturnz!prisma_models.LiteLLM_MemoryTablec,t|jSN)rtablers j/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/memory/memory_endpoints.py _memory_tabler"5s M * 0 00metadatac,tj|S)u Encode a `metadata` payload for the `Json?` column. `metadata` is typed `Optional[Any]`, so callers may send dicts, lists, or JSON scalars (including plain Python strings like `"hello"`). prisma-client-python rejects raw Python values on `Json?` columns (`MissingRequiredValueError` / `DataError`), and Postgres `jsonb` rejects bare-word strings as invalid JSON — so always `json.dumps`, regardless of input type. Roundtrip on read deserializes back to the original Python value. )jsondumps)r$s r!_serialize_metadata_for_prismar(9s ::h r#user_api_key_dictc<|jtjk(Sr) user_roler PROXY_ADMIN)r)s r! _is_adminr-Hs  & &*:*F*F FFr#ct|ryd|jfd|jffDcgc] \}}|r||i }}}|sddiSd|iScc}}w)z} Prisma `where` fragment restricting rows to those the caller can see. Returns None for admins (no restriction). Nuser_idteam_id memory_id __no_match__OR)rr/r0)r)fieldvalueorss r!_visibility_filterr7Lsv ##45():)B)BCiQbQjQjEkl E5  C ^,, #;sA rowc t|j|j|jt |dd|j |j |j|j|j|j S)Nr$) r1keyr5r$r/r0 created_at created_by updated_at updated_by) rr1r:r5getattrr/r0r;r<r=r>)r8s r! _row_to_modelr@^sZ -- GGiij$/  >>>>>>>>  r#c`ddlm}|%tdtjj |S)Nrr  status_codedetail)litellm.proxy.proxy_serverrrr db_not_connected_errorr5r s r!_require_prismarHms+84E4\4\4b4bcc r# log_messageexcdefault_detailcHtj||td|S)z Build a 500 HTTPException with a generic, caller-safe `detail` while logging the actual exception server-side. Avoids leaking internal Prisma / DB details (table names, columns, connection metadata) to API callers. rBrC)r exceptionr)rIrJrKs r!_internal_errorrNus! "";4 S @@r#cKt|ryt|dd}t|dd}|r||jk(ry||t|||d{ryt dd7w)u Enforce ownership for mutations (PUT/DELETE). The visibility filter uses an OR (`user_id == caller OR team_id == caller`) so team members can READ each other's team-scoped rows. That's intentional for list/get. For writes, broader visibility != broader authority — without this check, any team member could overwrite or delete a teammate's personal row whenever both `user_id` and `team_id` are stamped on it. Rules (mirroring how key/team management endpoints gate team-scoped writes): - PROXY_ADMIN: always allowed. - Personal ownership (`row.user_id == caller.user_id`): allowed. - Pure team row (`row.user_id is None`, `row.team_id` set): caller must be a team admin of `row.team_id` (members_with_roles entry with `role == "admin"`), or an org admin for that team's organization. Plain team members can only READ team rows, not modify them — same pattern as `_validate_team_member_add_permissions` etc. - Anything else: 403. Nr/r0z7You do not have permission to modify this memory entry.rC)r-r?r/_is_team_admin_forr)rr8r) row_user_id row_team_ids r!_assert_write_accessrTs,"# i6K i6K{&7&?&??{6#M3DkR R R  H  SsA A$A"A$r0chKddlm}m} t|j |dd{}|y|||ry |||d{ry y7(#t $r!}t jd||Yd}~yd}~wwxYw76#t $r!}t jd ||Yd}~yd}~wwxYww) aQ True if the caller is a team admin of `team_id`, or an org admin for the team's organization. Mirrors the auth pattern used by team-management endpoints (`_is_user_team_admin` + `_is_user_org_admin_for_team`). Imported lazily to avoid a circular import with proxy_server during the memory router's module load. r)_is_user_org_admin_for_team_is_user_team_adminr0)id_fieldNz8Error loading team for write-auth check (team_id=%s): %sF)r)team_objTz:Org-admin check skipped during write-auth (team_id=%s): %s) /litellm.proxy.management_endpoints.common_utilsrVrWr find_by_id Exceptionr rMdebug)rr)r0rVrWrYes r!rQrQs  .} = H H[d H ee->R m,?P[cd d d e 'f &&'acjlmn e m""#_ahjkll ms~ B2AAAB2 B B BB2B2A BA;6B2;BB2B B/B*%B2*B//B2cjt|dd}|dk(ryt|}d|vxsd|vxs d|vxsd|vS)a Detect a Prisma unique-constraint violation. Prefer the typed error code `P2002` from `PrismaClientKnownRequestError`; fall back to string matching so we stay robust across Prisma versions where the typed class may be unavailable or differently named. codeNP2002TUniqueuniqueUniqueViolation)r?str)rJr`msgs r!_is_unique_violationrgsM#vt,D wSC c> [X_ [C [CTX[C[[r#requested_user_idrequested_team_idc2t|r$||n |j}||n |j}||fS|||jk7r tdd|||jk7r tdd|j}|j}|s|s tdd||fS)a Resolve the (user_id, team_id) to stamp on a new row. - PROXY_ADMIN: may override either dimension via the request body. - Everyone else: the requested values must match their own (or be omitted). Also rejects identity-less creation: a row with both user_id and team_id NULL is invisible to every non-admin caller (the visibility filter would never match it), so we refuse to create orphan rows unless the caller is a PROXY_ADMIN who is explicitly stamping a global/shared row. rPz6Only proxy admins may set user_id to a different user.rCz6Only proxy admins may set team_id to a different team.zCannot create a memory entry without a user_id or team_id. Authenticate with a key that has a user_id or team_id, or call as a proxy admin.)r-r/r0r)r)rhrir/r0s r!_resolve_scoperls "#'8'D#J[JcJc'8'D#J[JcJc$):>O>W>W)WK  $):>O>W>W)WK   ''G''G 7$   G r#z /v1/memoryzmemory management)tags dependenciesresponse_modelbodycKt}t||j|j\}}|j|j |||j|jd}|j t|j |d< t|j|d{}t|S7#t$r8}t|rtdd|jdtd |d d}~wwxYww) zECreate a new memory entry for the caller (or, for admins, any scope).r:r5r/r0r<r>Nr$dataMemory with key '' already exists.rCzError creating memory: %sz%Internal error creating memory entry.)rHrlr/r0r:r5r$r(r"creater\rgrrNr@)rpr)rr/r0 create_datar8r^s r! create_memoryrz s+,M%&7t||TGW xx'//'// -K }} "@"O J  (7>>K>PP  Q    "*488*4EF  ' 3    s<BC;B7%B5&B7* C;5B77 C83C33C88C;zFilter by exact key match.) descriptionzzFilter by key prefix (Redis-style namespace scan). Mutually exclusive with `key`; if both are provided, `key_prefix` wins.)ge2rB)r}ler: key_prefixpage page_sizecKt}i}|d|i|d<n|||d<t|}||}n |s|}nd||gi} t|j|d{} t|j |ddi|dz |z| d{} t| D cgc] } t| c} | S7V7*#t $r} t d | d d} ~ wwxYwcc} ww) z*List memory entries visible to the caller.N startsWithr:ANDwherer=descr|)rorderskiptakezError listing memory: %sz&Internal error listing memory entries.)memoriestotal) rHr7r"count find_manyr\rNrr@) r:rrrr)r key_filtervisrrrowsr^rs r! list_memoryr:s(+,M,.J):6 5  5#$56C { S)* g*=9??e?LL)-8BB((i' C   $'GQ a(8'Gu UUM g8!=effg(HsX9CB5B1-B5B3 B5 CC( C1B53B55 C> C  CCcKd|i}t|}||nd||gi}t|j|dddid{}|stdd |d  |d S7w) z?Look up a memory row by key, scoped to the caller's visibility.r:Nrr|r=r)rrrrv ' not foundrCr)r7r"rr)rr:r)rrrrs r!_find_memory_for_callerrrs05clJ#$56C7:{Q[]`PaHbE}-77e!T`bhSi7j jD 6GuK4XYY 7N ks9A9>Az/v1/memory/{key:path}cbKt}t|||d{}t|S7w)z7Get a single memory entry by key, scoped to the caller.N)rHrr@)r:r)rr8s r! get_memoryrs3+,M.}cCTUUC  Vs /-/cKt}|j}d|v}i}|j|j|d<|rt|j|d<|s t dd|j |d< t|||d{}|Ft|||d{t|jd|ji| d{}n|j t dd t||j |j\} } ||j| | |j |j d } |jt|j| d< t|j| d{}|t dd|dt%|S7777*#t$r} t!| st|||d{7} | t d d|dt|| |d{7t|jd| ji| d{7}Yd} ~ d} ~ wwxYw#t $rt$r} t#d| dd} ~ wwxYww)z Upsert a memory entry by key within the caller's scope. If no row exists for (key, caller.user_id, caller.team_id), create one. If one exists, update the value/metadata fields that were provided. r$Nr5rkz;Request body must include at least one of: value, metadata.rCr>r1)rrtz5Cannot create a new memory via PUT without a 'value'.rrrsrurvrwzError upserting memory: %sz%Internal error updating memory entry.rr)rHmodel_fields_setr5r(r$rr/rrTr"updater1rlr0rxr\rgrNr@)r:rpr)r fields_sentmetadata_in_payloadrtexistingr8r/r0ryr^existing_after_races r! upsert_memoryrs"+,M..K!+{!:%'D zz W 9$--HZ P  +22D:h <]CQb cc   '}h@QR R R%m4;;"H$6$67<C zz!# #R ..?t||\ GW ""/77/77 5K}}(*H*W J' )-8??[?QQ4 {6GuK4XYY  {d S4R ,A.3OP]_bdu3v-v-v#&.($'!23%7HI +=:MO`aaa)-8??&(;(E(EF@! (  h:A?fgghsA0I3H6FH6F/H6 F  B H6F$7F"8F$<IH6H6 H6"F$$ H3-H. G  (H.2G530H.#H&$H.)H6.H33H66I IIIcZKt}t|||d{}t|||d{ t|j d|j id{}|tdd|d t|d S7i7V7(#t $r}td|dd}~wwxYww) z3Delete a memory entry by key, scoped to the caller.Nr1rzError deleting memory: %sz%Internal error deleting memory entry.rrvrrCT)r:deleted) rHrrTr"deleter1r\rNrr)r:r)rr8rr^s r! delete_memoryr s+,M.}cCTUUC }c3D EEEg,];BB+WZWdWdIeBff6GuK4XYY C 66VEf g91>effgsTB+BB+B B+*B "B #B '!B+ B+ B B( B##B((B+)rr)D__doc__r&collections.abcrtypingrrfastapirrrr litellm._loggingr litellm.proxy._typesr r r r$litellm.proxy.auth.user_api_key_authr%litellm.repositories.prisma_protocolsr'litellm.repositories.table_repositoriesr$litellm.repositories.team_repositoryrlitellm.types.memory_managementrrrrrprismar prisma_modelslitellm.proxy.utilsrr__annotations__r"objectrer(boolr-r7r@rHr\rNrTrQrgtuplerlpostrzgetintrrrrputrrrr#r!rs& #'<<1 C>D?.0 11LAd4e1  V    GGDG.WS&[=QTX=X$ : ?P AA9AcAmA'!'(K'`n' 'T"N"~"hk"pt"J \i \D \,%,Tz,Tz, 3:sTz !" ,^  +,-$  )00A(B% %%%  %P  +,-%  D.JK"  VaA2!,(/0A(B/V t/Vd /V /V/V&/V  /Vd ! (+ @N (  ! (+ @N /   +,-$  )00A(B %    +,-$  )00A(Bf f f&f  fR  +,-' )00A(B7 7%7  7r#