tPjJhUdZddlZddlZddlZddlmZmZmZddlmZddl m Z ddl m Z m Z mZmZmZmZddlmZmZmZmZmZmZddlmZmZmZmZmZdd lm Z dd l!m"Z"dd l#m$Z$dd l%m&Z&m'Z'm(Z(m)Z)m*Z*m+Z+m,Z,dd l-m.Z.m/Z/m0Z0m1Z1m2Z2m3Z3m4Z4m5Z5m6Z6m7Z7m8Z8m9Z9m:Z:m;Z;ddlm?Z?m@Z@ddlAmBZBddlCmDZDddlEmFZFddlGmHZHmIZImJZJddlGmKZLddlMmNZNddlOmPZPmQZQddlRmSZSmTZTddlUmVZVddlWmXZXddlYmZZZddl[m\Z\ddl]m^Z^ddl_m`Z`maZambZbmcZcmdZdmeZemfZfmgZgddlhmiZimjZjmkZkmlZlmmZmddlnmoZompZpdd lqmrZrmsZsmtZtmuZumvZvdd!lwmxZxe rdd"lymzZ{eZ|ee}d#<d$ZKGd%d&eZ~Gd'd(eZGd)d*eZGd+d,eZGd-d.eZGd/d0eZGd1d2eZGd3d4eeZd5eSd6efd7Zd5eSd6efd8Zd5eSd6efd9Zd5eSd6d:fd;Zdetdzd?etdzd6edzfd@Zd>etdzd?etdzd6dfdAZdBZee}dC<dDZee}dE<dFetdGed6dfdHZedIdJhZee}dK<dLeudzd6eefdMZdNesdOevd6eeeffdPZdQeeefd6dfdRZdLeeefd6dfdSZe)Zee}dT<e'Zee}dU<e iej9edVej9edWZeeeeedWzfe}dX<e iZeeeeedWzfe}dY<eZeeeefe}dZ<e&Zee}d[<e*Zee}d\<e+Zee}d]<d^ed6efd_Zd^ed6efd`Zd^ed6efdaZdLeeefdbeeefd6dfdcZdLeeefdFeeefdbeeefd6eeeedWzeeefzffddZdeeeefdLeeefdFeeefdfevd6eeeeedWzeeefzfeeff dgZdhesd6esfdiZdNesdjevd6e5fdkZe|j[dldmgee=gnee=fdD( )/^wsF{3] .SWBW8X]PGCK$8PYs^PrqrceZdZUeed<y)_TxModelTableslitellm_proxymodeltableN)rhrirjrrnrprqr`rrs--rqrcBeZdZedeeeffdZdddedefdZ y)_ExistingModelRowrtcyrvrprws r`litellm_paramsz _ExistingModelRow.litellm_paramss69rqFr~rcyrvrprs r`rz!_ExistingModelRow.model_dump_jsonrrqN) rhrirjrrrmrrrrrprqr`rrs. 9V 4996;HtHHrqrc>eZdZedeefdZdeeeffdZ y)_TeamRowrtcyrvrprws r`rZz_TeamRow.modelss'*rqcyrvrprws r` model_dumpz_TeamRow.model_dumprrqN) rhrirjrrrmrZrrrrprqr`rrs* * **5GCK05rqrc2eZdZdeeefdeedzfdZy)_TeamLookupTablerrtNcyrvrprs r`rz_TeamLookupTable.find_uniquerrq) rhrirjrrmrrrrrprqr`rrs"\GCK$8\YxRV=W\rqrc HeZdZdeeefdeeefdeeefdeefdZ y) _TeamTablerrincludertcyrvrp)rxrrrs r`rz_TeamTable.updates'*rqN) rhrirjrrmrrrr&rrprqr`rrsK+V ,+4;CK4H+SZ[^`d[dSe+ $ %+rqr prisma_clientrtc,t|jSrv)r@tablers r`_proxy_model_tablers = ) / //rqc,t|jSrv)rCrrs r`_repo_team_tablers - ( . ..rqc.|jjSrv)dblitellm_teamtablers r`_db_team_tablers    - --rqz.TableActions[prisma_models.LiteLLM_ModelTable]c,t|jSrv)rBrrs r`_model_alias_tablers  . 4 44rqrycKt|jd|id{}|sytdi|jd}|S7$w)NryrTr~rp)rrrUr)ryrdb_modeldeployment_pydantic_objs r` get_db_modelrsW.}=IIQ[]ePfIggH %/%Y(2E2ESW2E2X%Y "" hs!A A%A incoming_paramsexisting_paramscytj}||StfdtD}t j |rt j}||Sj ytj |S)aReject writes that would corrupt a strategy router's pseudo-model. An auto-router deployment's ``litellm_params.model`` (``auto_router/...``) is the discriminator the router loads it by; a write that mangles it makes the router drop the deployment silently under ``ignore_invalid_deployments``. Only writes that supply ``litellm_params.model`` are judged on the naming contract, against the merged (stored + incoming) params, so partial patches and restores of an already-corrupted row stay legal. A config is judged only when the write carries one, for the same reason: a rename must not be held hostage by a stored config it does not touch. Returns the violation, or None. N)complexity_router_configc3RK|]}fD]}|t||d| ywrvgetattr).0fieldsourcerrs r` z3_strategy_router_write_violation..sG& &8&   '&%">"J & &s$')modelpresent_fields) rPr frozensetrMrNrrO model_extrarQ)rrconfig_violationrplacement_violations`` r` _strategy_router_write_violationrsE!0!I!I#%&1&N*/*?*?P%PQ`QlQl%m  *& &$ /o6K6K\j kkrqct||}|yt|tjjt j d)Nrrzlitellm_params.modelmessagetypecodeparam)rr,r+validation_errorvaluerHTTP_400_BAD_REQUEST)rr violations r`)_raise_on_strategy_router_write_violationrsE1bqrI   - - 3 3  ( ($  rqenforce_rpm_tpm_on_model_add$ENFORCE_RPM_TPM_ON_MODEL_ADD_SETTING)rpmtpm_REQUIRED_RATE_LIMIT_FIELDSrenforcedc|sytfdtD}|sytdj|dtdt j jtjd|d) aRequire both rpm and tpm (each a positive value) when the operator opts in via config.yaml. Off by default, so deployments keep adding models without limits. When ``enforce_rpm_tpm_on_model_add: true`` is set under general_settings, a model added without both rpm and tpm set to a positive value is rejected rather than stored unbounded (or effectively excluded from routing by a zero/negative limit). Nc3HK|]}t|xdkr|ywNrr)rrrrs r`rz=_raise_if_rate_limits_required_but_missing..s1 ^U3 3E <  s"z and z' must be set to a positive value when 'z ' is enabled in general_settingszlitellm_params.rr) tuplerr,joinrr+rrrr)rrmissingrs` @r`*_raise_if_rate_limits_required_but_missingr s 0G  ||G$%&455U W - - 3 3  ( ( |, rq ptu_countcost_per_ptu_per_hour_PTU_PRICED_PAIRr}c` ts tStfdtDS)a The PTU fields a patch sends as an explicit null, which update_db_model drops. Empty while the feature is off, so disabling pauses PTU rather than letting a client that round-trips a model_info blob erase a configuration set up during an earlier opt-in. c3VK|] }|jvrt||"ywrv)model_fields_setr)rrr}s r`rz1_explicitly_cleared_ptu_fields..4s3  J// /GJ4N4V s&))r=rrr}s`r`_explicitly_cleared_ptu_fieldsr,s3 !@!B{ * rqr patch_datac\|jr|jjdnt}|jr|jjdnt}t|j}t i||j Dcic] \}}||vs ||c}}Scc}}w)zThe model_info a patch would store, which is the stored blob updated by the patch. A PTU invariant holds over the deployment as it will exist, not over whichever subset of fields a caller happened to send. Tr~)r}r_EMPTY_MODEL_INFOrritems)rrstoredincomingclearedkvs r`_merged_ptu_model_infor;s JRI\I\H''222EbsF?I?T?T ((d(;Zk 4J4I4IJG .D.D8.D.J.J.LadaPQY`P`QTa bbas  B( B( incoming_model_infoctrytfdtD}|sytdddj |dt d) aReject PTU model_info fields unless the operator opted into PTU cost attribution. Takes the incoming request's model_info rather than the merged deployment, so an unrelated patch of a model that still stores PTU config from an earlier opt-in is left alone. The fields are rejected rather than dropped so a caller never believes a flat cost was configured while the rollup that would price it is not running. Only a value is rejected. An explicit null reaches the clear loop, which is gated on the same flag, so a disabled proxy neither writes PTU config nor erases what an earlier opt-in stored. Disabling pauses the feature rather than discarding its setup. Nc3FK|]}j||ywrvget)rrrs r`rz:_raise_if_ptu_cost_attribution_disabled..Ws#seH[H_H_`eHfHrEs!!z%PTU cost attribution is disabled, so , z cannot be set. Set z=true to enable it. status_codedetail)r=rrrrr<)rsupplieds` r`'_raise_if_ptu_cost_attribution_disabledrIs['(s/DssH  3DIIh4G3HI/00C E rqc8t|}| td|y)aAEnforce the PTU cross-field invariant on the effective model_info. The rules live in litellm_core_utils.ptu_pricing so that config.yaml registration refuses the same deployments this endpoint does, for the same reason. Per-field bounds (positive count, non-negative rate) are enforced by ModelInfo itself. Registration additionally requires an operator-declared ``model_info.id``, which this endpoint does not: a stored deployment already holds a stable primary key, where a config-declared one is otherwise keyed by a hash of its own parameters. Nrr)r"r)r}errors r`_validate_ptu_model_infor cs&$J/E E::rq_PTU_ZEROED_PRICING_FIELDS_PTU_EMPTIED_PRICING_FIELDSrp_PTU_ZEROED_PRICING_NO_PRICING_OVERRIDEr_CUSTOM_PRICING_FIELDS_PTU_ZEROED_TABLE_FIELDS_SEARCH_CONTEXT_SIZESrcbt|ttfxrt|t xr|dk7Sr) isinstancerfloatrrs r`_is_nonzero_raters, ec5\ * Y:eT3J/J YuXYzYrqcxt|tr td|jDSt |S)Nc32K|]}t|ywrv)r)rrates r`rz$_is_nonzero_price..sEd#D)Es)rdictanyvaluesrrs r`_is_nonzero_pricers.%EellnEEE E ""rqct|trt|xr t| St|tt fr| St|t tfxrt|t xr|dk(Sr)rrrrrlrrrrs r`_is_zero_pricersd%E{;#4U#;;;%$'y ec5\ * Y:eT3J/J YuXYzYrqrc ,tsy|jd|jdytttfdtDtfdt Dz}|syt dddj|d  ) a4Refuse a rate the caller supplies for a deployment that bills reserved capacity. Separate from the zeroing so the team-model path can run it before it touches the team, whose ACL write autocommits: a refusal raised after it would leave the team changed and the deployment row never written. Nrrc3XK|]!}tj|s|#ywrvrrrrrs r`rz5_raise_if_ptu_deployment_is_priced..s&fE?PQYQ]Q]^cQd?e%fs**c3FK|]}j|s|ywrvrr#s r`rz5_raise_if_ptu_deployment_is_priced..sZehllSXFYEZrrz0A PTU deployment bills by reserved capacity, so rzu cannot be charged on top of it. Send 0 or no value, or remove ptu_count and cost_per_ptu_per_hour to bill per token.r)r=rrsortedrr rr)r}rpriceds ` r`"_raise_if_ptu_deployment_is_pricedr's + ,~~k"*jnn=T.U.] f%;f fZ'BZZ [ F  >tyy?P>QRn n rqc tstSjdjdtSt|t fdt D}t ittjttjtdtj|tz dS)aThe pricing a PTU deployment must carry, empty unless one is being stored. Reserved capacity is already billed by the flat cost the rollup writes, so charging the traffic it serves bills the same tokens twice. Left unset the rate falls back to the public cost map, which makes the double charge the default rather than an opt-in. Only a price the caller supplies is refused. A non-zero price already on the row is zeroed instead, so a deployment priced through a path this rule does not cover heals on its next save rather than rejecting every later edit of a field that has nothing to do with pricing. ``supplied`` is the caller's litellm_params alone, because that is the blob a price is authored on. model_info's copy is written by the server, both by the mirror in ``Deployment.__init__`` and by the cost-map defaults /model/info fills in, so a client that round-trips a model_info blob sends back prices it never chose. rrr}rc3K|]:}tj|stj|r|<ywrvr"rrrr}s r`rz&_ptu_zeroed_pricing..s>  Z^^E2 37HI[I[\aIb7c AAr ) r=rrr'rrrr rfromkeysrr)r}rrrs`` r`_ptu_zeroed_pricingr.s* + ,##~~k"*jnn=T.U.]##&*xP+F  ! mm4dmmDY[^6_` mmF%==sC  rqstored_model_infopatchc|jr|jjdnt}t|}|r |t fSt fdt D}|rt|jt zstt fStt fdtjttDfS)aUThe pricing a patch must write into both blobs, and the pricing it must drop from them. A patch that takes the deployment off PTU takes the zeroed pricing with it, since the zeros exist only to stop the double charge. Left behind they would serve the deployment for free. Reading the stored row rather than the patch alone keeps that release off a deployment that never carried PTU config, whose zero price is a rate its operator chose. A zero the patch itself carries is released with the rest, because the dashboard echoes the whole stored blob on every save, so a supplied zero cannot be told apart from the one this rule wrote. The release spans every field the zeroing could have written, not just the mirrored ones, or a rate zeroed on the way in (per-second, per-character tiers) would bill nothing forever. Tr~r}rrc3DK|]}j|duywrvr)rrr/s r`rz%_ptu_pricing_delta..s"`e*..u5TA`s c3K|]:}tj|stj|r|<ywrv)rrr+s r`rz%_ptu_pricing_delta..s=+  *../ 0N>CUCUV[C\4] +r,)rrrr.rrrrr}rrunionr r )r/r}rr0rzeroedwas_ptus``` r`_ptu_pricing_deltar8s&MRL`L`e**5545HfwH':ngopF y{""`O_``G 89I9IJM]]#Y[00 ++112LNij+" rq model_paramsc |jjd}|jjd}t|||}|s|St |j Dcic]\}}|t |trgn|c}}}|jt |jj||jj|dScc}}w)zO``model_params`` with PTU pricing applied, or itself when it configures no PTU.Tr~r2)r)rr}) r}rrr.rrrr model_copy)r9r}roverridekeyrrs r`_ptu_priced_deploymentr>s$//:::MJ(77BBPTBUN)ZP^iwxH %JR..JZ[JCJue,b% 7[F  " ""."="="H"HPV"H"W*55@@@O   #  \s#C updated_patchc|j%t|jjd|jxs |j}|jjd}|jjd}|jrW|jjdj Dcic]\}}|t |}}}|j||jr+|j|jjd|jr_|jjD]F}|tvs t|j|#|j|d|j|dH|jr|jjD]F}|tvs t|j|#|j|d|j|dHt|jD]}|j|dt|t|jr|jjdnt|||\} } |j| |j| | D]&}|j|d|j|d(|j D]3\} } t!| t"j"s!| j%|| <5t'|t)j*|t)j*|} |j,|j,| d<| Scc}}w)NTr~)r/r}rr0)r{rr}blocked)r}rrr{rrr4rrrTrpoprr r8rrdatetime isoformatr*jsondumpsrA)rr?merged_model_namemerged_litellm_paramsmerged_model_inforrencrypted_paramsr ptu_pricing ptu_releasedr=rprisma_compatible_model_dicts r`update_db_modelrNs'+/ 0H0H0S0Sae0S0fg,77N8;N;N#+#:#:#E#ESW#E#X'22==4=P##4A3O3O3Z3Zhl3Z3m3s3s3u# +/1aA#A& &# #  $$%56  !9!9!D!DRV!D!WX##"11BB 3E11gm>Z>Z\a6b6j%))%6!%%eT2 3"-->> 7E11gm>V>VX]6^6f!%%eT2%))%6 74M4L4LM /E  ! !% . /./ 2   #--88d8K $, !K[)  -/eT*!!%./ (--/7 U eX.. /%*__%6 c "7+H$zz"78::/0+ (2?2G2G$Y/ ''}# s=M z/model/{model_id}/updatezmodel management)tags dependenciesuser_api_key_dictc Kddlm}m}m}m}m} |'t ddtjji|s5tdtjjtjdt|| d{}|x|rG|j!| 5td tjjtjdtd |d tj"tj$dt&j)||||d{|j*R|j,t.j0k7r5tdtj2jtj4dt7|j8|j8t;||||d{} |j<xs|| d<t?t@tC| d<tE|jGd|i| d{} | /td |d tj"tj$dtI} tKd{} tMjNtQ|d|tRjT|jWd| jWd|j<tXt[| |t]| ddfgd| j^| j`| S7m77B77#tb$ra} tejfd| ti| t tfr| td| tjjtjldd} ~ wwxYww) a* PATCH Endpoint for partial model updates. Only updates the fields specified in the request while preserving other existing values. Follows proper PATCH semantics by only modifying provided fields. Args: model_id: The ID of the model to update patch_data: The fields to update and their new values user_api_key_dict: User authentication information Returns: Updated model information Raises: ProxyException: For various error conditions including authentication and database errors r)litellm_proxy_admin_name llm_router premium_userrstore_model_in_dbNrr1Model updates only supported for DB-stored modelsrryrryGCannot edit config-based model. Store model in DB via /model/new first.Model  not found on proxy.r9rQrrU4Only proxy admins can change a model's blocked flag.rAr)rrrQr updated_by updated_atryrrupdatedTr~ object_idactionrQ table_name before_value after_valuelitellm_changed_byrSr}rbeforewritten_modelsrf still_desired live_afterzError in patch_model: %szError updating model: )7litellm.proxy.proxy_serverrSrTrUrrVrr$db_not_connected_errorrr,r+rrrrget_deploymentnot_found_errorHTTP_404_NOT_FOUNDModelManagementAuthCheckscan_user_make_model_callrA user_roler( PROXY_ADMIN auth_errorHTTP_403_FORBIDDENrr_update_team_model_in_dbuser_idr rmrYrrlive_model_ids_snapshot clear_cacheasyncio create_taskr;r'PROXY_MODEL_TABLE_NAMErr raise_if_reload_degraded_servingrrnro Exceptionr exceptionrinternal_server_errorHTTP_500_INTERNAL_SERVER_ERROR)ryrrQrSrTrUrrVr update_data updated_modellive_before_reloadreload_outcomees r` patch_modelrhsj6{  !2!I!I!O!OP  ! K$55;;00  !-hm \\  j777JV$e(99??44  !  *>?$44..  (@@!/'% A       ).?.I.IM]MiMi.i N$//55..   2&55$33 $<!/' $  %6$=$=$YAY L!$(.>.@$A L!&8 %F%M%Mx(&N&      *>?$44..  %<$=&1m 3  #" "3,CC%5545H)99t9L#4#<#<)A   )%%w}lD'QRS(66%00  {]$ 0  !44   &&'A1E a-8 9G,QC0 6666    sM)A0K<K/BK<K2BK<3K54AK<K8A K<K:BK<.M)/K<2K<5K<8K<:K<< M&AM!!M&&M)rrArf)rA unblockedrjc (Kddlm}m}m}m} |'t ddt jji|dur5tdtjjtjd|jtj k7r5td tj"jtj$d t'|j(| d{} | |rQ|j+|j( 5td tjjtjdtd|j(dtj,tj.dt1|j2j5d|j(i||j6xs|t9t:t=dd{} t?} tAd{} tCjDtG|j(||tHjJ| jMdtO| tPr| jMdnd||tS| |j(tU| ddfg|| jV| jX| S777#tZ$rb} t]j^d|| tO| t tfr| td| tj`tjbdd} ~ wwxYww)Nr)rSrTrrVrWrrTrXrr_rArYrZr[r\r]ry)rAr`rarbr~rdr}rkzError in model %s: %sz%Error updating model blocked status: )2rprSrTrrVrr$rqrr,r+rrrrwr(rxryrzrryrrrsrtr@rrr|r rmrYr}r~rrr;r'rrrrrrrnrorrrrr)rrQrArfrjrSrTrrVrrrrrs r`_set_model_blocked_statusr s[  !2!I!I!O!OP  D ( K$55;;00    & &*:*F*F F N$//55..  !-]]'!    j777O[$e(99??44  ! /CD$44..  &5]%C%I%I%P%Pt}}-"/77S;S"3(8(:;&Q&  %<$=&1m 3 #--"3,CC%5545HHRS`bkHlM11t1Drv#5)A   )%!]]GMJ a-8 9G;A3? 6666    sb LCJ$JC/J$J J$*J"+B1J$LJ$ J$"J$$ L-AL  LLz /model/blockzThe litellm-changed-by header enables tracking of actions performed by authorized users on behalf of other users, providing an audit trail for accountabilityrc http_requestc>Kt||dd|d{S7w)z Block a DB-stored model deployment from serving requests. Parameters: - model_id: str - The model deployment id to block. TrArrQrArfrjNrrrrQrjs r` block_modelrus.(+ +-    z/model/unblockc>Kt||dd|d{S7w)z Unblock a DB-stored model deployment so it can serve requests again. Parameters: - model_id: str - The model deployment id to unblock. FrrNrrs r` unblock_modelrs.(+ +-   rnew_encryption_keyshould_create_model_in_dbzFprisma_models.LiteLLM_ProxyModelTable | LiteLLM_ProxyModelTable | NonecK|jjd}|jj}|jD]!\}}t ||} | |j|<#|j j |j|jjd|j jd|jxst|jxstd} |j j |j j | d<td| } |r/t|jj| d{} | Stdi| } | S7w) NTr~)rr)ryr{rr} created_byr`ryzMapping[str, object])rrp)rrrrr4r}idr{rr|rr r@rcreater%) r9rQrrr_litellm_params_dict_original_litellm_model_namerrencrypted_value_data _create_datamodel_responses r`_add_model_to_dbrs[#/"="="B"BPT"B"U*6*E*E*K*K $**,91.QK]^)8 ##A&9!++.."--&55EESWEX"--==4=P'//K3K'//K3K E!!-(3366j5u=L .}=CCJJP\J]] 1959 ^sE E# E!E#cTK|jj}|y|j}|r||j_d|dt j }||_t |||d{}|r.tt||gtddi| d{|S767w) z If 'team_id' is provided, - generate a unique 'model_name' for the model (e.g. 'model_name_{team_id}_{uuid}) - store the model in the db with the unique 'model_name' - add the public model name to the team's allowed models list N model_name__r9rQrteam_idrZrhttpscoperrrQ) r}rr{team_public_model_nameruuid4rr8r.r)r9rQr_team_idoriginal_model_nameunique_model_namers r`_add_team_model_to_dbrs#--55H".!8!8 9L 6"-XJa ~F/L#3!+##N $ +,!'78/     ! s$A+B(-B$./B(B&B(&B(c,Kddlm}tj||||d{|j;t |jj dtt||tt|||jr|jj dnt|jr|jjnd}| t|| St|| }|jdd lm}||_||j_|jr|jjnd}||k7} | rt%|||| d{nt'|||||| d{t|| S7h7.7w)z Handle team model updates with proper alias management. If patch_data contains a team_id: - Creates unique internal model_name and team alias - Adds model to team object - Preserves team_public_model_name for external reference r)rUr^NTr~)rrr))rr?)rr)rW)rpublic_model_namerrQ)rrrrrQr)rprUruallow_team_model_actionr}rrr rr'rrrrN_get_public_model_namelitellm.types.routerrWr _setup_new_team_model_assignment&_update_existing_team_model_assignment) rrrQrrU patch_team_idrrW db_team_idis_new_team_assignments r`r{r{s8 # ; ;+#! < (/ 0E0E0P0P^b0P0cd !7V`!ab&)8 SGQG`G`J % % 0 0d 0 Cfw=G._is_internal_shapezs% ?$WIQ788rq)r}rrmrr{r)rrrrrs @r`rr[s68B7L7Lj++33RV'/':':## 9t99 !++H*84XEXEX9Xx22II""999   rqrrcKd|dtj}||_tt ||gt ddi|d{y7w) z=Set up a new team model with unique name and team membership.rrrrrrrN)rrr{r8r.r)rrrrQrs r`rrs^"-WIQtzz|nE-J  %& FF#34+  sA A AArcKd|d}|xs t|}|jdd|iid{}|sgSg}|D]@}t|j}||j d|k(s0|j |B|S7Qw)aG Fetch all deployments for a given team_id from the database. Centralizes team deployment queries to ensure consistent filtering and error handling. This is the established helper pattern for team deployment DB access in this module. Note: prisma-client-py 0.11.0 does not support JSON path filtering, so we filter by the model_name prefix (team models use "model_name_{team_id}_*") and confirm team_id in model_info with Python-side filtering. Pass ``table`` (a transaction's proxy-model table) to run the read inside an existing transaction. rrr{rrNr)rrmodel_info_as_mappingr}rappend)rrrprefixresponseresultrowr}s r`_get_team_deploymentsrs "'!,F  6' 6E!OO <0 ,H  F*3>>:  !jnnY&?7&J MM#  Ms/BB&BB.Bteam_idsrTcKg}|jj4d{}|}|D]w}t|||jd{}|Dcgc]}|j} }| s?|jj dd| iid{|j | ydddd{|rttdd{|>:  !$..)ABK  - . MsA)A'*A)A)A)user_api_key_cacheproxy_logging_objc K|jj}|yduxr|jjv}|rgnt |j|d{}|D chc] \}} ||k(s | } }} |jj | |jj hzn| } | syt ||d{} tfd| Dn t} | | z | z }|syt|jd|id{}|yt|jd|id|jDcgc] }||vs| c}idd i d{}t||| d{y7cc} }w77qcc}w7-7w) a Strip a deleted team model's public name(s) from team.models and refresh the cache. Must be called after the deployment row is deleted: a public name is removed only when no remaining team deployment still backs it, so a load-balanced replica isn't revoked while siblings serve it, and concurrent deletes can't leave a ghost. Legacy team models (created before team_public_model_name existed) store a ``{public_name: "model_name_{team_id}_{uuid}"}`` entry in the team's model_aliases, so the alias scan runs for every team model; skipping it for internal-shaped names left stale aliases that rewrote requests to deployments that no longer exist. Aliases are scrubbed only when the deleted deployment's name no longer resolves in the router, so deleting one replica of a load-balanced group never breaks aliases that still route to the surviving replicas (in any team). A public name that still resolves to a live router deployment (e.g. a gateway-level model group shared with the team) is kept in team.models, so deleting a per-team duplicate does not revoke the team's access to the shared deployment. N)rr)rrc3@K|]}|jvs|ywrv) model_name_to_deployment_indices)rrrTs r`rz/_remove_unbacked_team_models..4sj4dj>i>i6i$jsrrrZobject_permissionT)rrr)team_rowrr) r}rr{rdelete_team_model_aliasrrrrrrrZr7)r9rrrrTrdeleted_name_still_servedremoved_model_aliases alias_team_idaliasremoved_alias_namescandidate_namesteam_backed_namesrouter_served_namesnames_to_removeexisting_team_rowrupdated_team_rows ` r`_remove_unbacked_team_modelsrs4",,44G $i<#:#:j>i>i#i % **55'  EZ!v,@M5]jnu]u%!v!v  " " 9 9 E |66MMNN  %A'an%oo  ! j?jj [ -/@@CVVO %3M%B%N%NV_ahUi%N%jj 7Em7T7[7['",=,D,De5UdHde f$d+8\82 !-+ C "w p k f2 sAF E4 F # E71E75AF =E=>AF  E?-F ; F F F FF .F/F 7F ?F F F cKdtdtdzfd}|jr|jjnd}|r||k7rd|_|t j dyt||d{}|D cgc]2} | j|jk7r|| j|k(r| 4} } tt||gtddi | d{| shtt||gtddi | d{d|_y|s0|r.tt||gtddi | d{d|_y7cc} w7}7O7w) aUpdate an existing team model if the public name changed. Note on DB scan: Prisma's JSON filtering does not support compound AND conditions across multiple JSON paths, so we fetch all deployments for the team and filter team_public_model_name in Python. For teams with many deployments this scan grows linearly; if team deployment counts become large this should be revisited. r}rtNcht|}|y|jd}t|tr|SdS)Nr)rrrrm)r}parsedrs r`_get_team_public_model_namezK_update_existing_team_model_assignment.._get_team_public_model_name\s9.j9 >zz":;"5#.u8D8rqz]prisma_client not initialized; skipping public name update entirely to avoid orphaned entriesrrrrr) rrmr}rr{rwarningrr8r.rr9r/) rrrrrQrrold_public_nameteam_deploymentsdother_deployments_with_old_names r`rrLs 99 t9LTK^K^X00GGdhO,?!%   ( (o  )>g}(U"U&2 ||x2227RSTS_S_7`ds7s 2 '2 $)*!'78/    /#+#+,%FF+;<"3   0!J!!2$)*!'78/    !JU#V2    sTA-E/E0E87E/+EE/E E 9EE EEEEceZdZdZe ddedededzdede df d Z ed e e zded e dede df d Ze dd e ded e ded ede df dZy)ruz; Common auth checks for model management endpoints NrrQteam_objrUrtTc  |dur'tddtjji|jr|jt j k(ry| t||s tddd|d|jd iy) NFrrT)rQrzTeam ID=z& does not match the API key's team ID=z^, OR you are not the admin for this team. Check `/user/info` to verify your team admin status.) rr$not_premium_userrrwr(rxr6rrrQrrUs r`can_user_make_team_model_callz7ModelManagementAuthChecks.can_user_make_team_model_calls 5 !2!C!C!I!IJ   & &+<+F+FJZJfJf+f  %8K\go%pxy0VWhWpWpVqrPQ  rqr9rc<K|j|jjy|jj+|dur'tddtjj it |jd|jjid{}|'tddd|jjd itj|j}tj|jj||| y7~w) NTrrrrrrTeam id= does not exist in dbr) r}rrr$rrrrr&model_validaterrur)r9rQrrU_existing_team_rowrs r`rz1ModelManagementAuthChecks.allow_team_model_actions'  " " *l.E.E.M.M.U  " " * * 6+V+ %   %8L,C,C,K,K+LLa!bc $5#C#CDVDaDaDc#d!?? ++33/&% @ #% sBDDA?Dallow_missing_teamcK|j|jjt|jd|jjid{}|V|r-|jt j k(rytddditddd |jjd itj|j}tj|jj||| S|jt j k7rtddd |jd iy7w)NrrTrrzBOnly a proxy admin can delete a model whose team has been deleted.rrr r rzAUser does not have permission to make this model call. Your role=z. You can only make model calls if you are a PROXY_ADMIN or if you are a team admin, by specifying a team_id in the model_info.) r}rrrrwr(rxrr&r rrur)r9rQrrUr  team_obj_rowrs r`rvz2ModelManagementAuthChecks.can_user_make_model_callsj  " " .<3J3J3R3R3^(8(G(S(S ,"9"9"A"AB)T)#L#&(226F6R6RR#'$' ')mn$ ##x 0G0G0O0O/PPe%fg0>>|?V?V?XYH,JJ$//77"3!) K  ( (,<,H,H H`ara|a|`}~}~ G#sAEEC(E)NF)F)rhrirjrk staticmethodrmr0r&rr rrUrXr>rrvrprqr`rurus.2" )$d*   , #33)$   B $) . .).$. . ! .  ..rqruz /model/deletez;Allows deleting models in the model list in the config.yaml)rdrOrPc Kddlm} ddlm}m}m}m}m}m}m}|tdddit|jd|ji d{} | td dd |jd itd!i| j} tj| |||d d{|d ur$ t|j!d|ji d{} | td dd |jd i|7|4d{|j#|jdddd{| j$j&t)| ||||d{t+j,t/|jd|t0j2| j5d d|j6t8dd| j:diStdddi77@777#1d{7swYxYw7#t<$r} t?j@d| tC| trPtEtG| dd| dtHjJtG| ddtG| dtLjNtC| tDr| tEd tQ| ztHjJtG| ddtLjNd} ~ wwxYww)"NrrT)rrTrUrrrVrrWrVNo DB Connected. Here's how to do it - https://docs.litellm.ai/docs/proxy/virtual_keysrryrrzModel with id=z not found in dbT)r9rQrrUr r)r9rrrrTdeletedr~rdrzModel: z deleted successfullyCSet `'STORE_MODEL_IN_DB='True'` in your env to enable this feature.z)Failed to delete model. Due to error - %srAuthentication Error()rNonerrrrrAuthentication Error, rp))rprTrrUrrrVrrrrrrUrrurvrrr}rrrrr;r'rrr|rryrrrrr,rr+ryrrrm) r}rQrTrrUrrrVr model_in_dbr9rrs r` delete_modelrs16r       u $6m#D#P#PXbdndqdqWr#P#ss  >*--@P!QR  )D;+A+A+CD '@@%/'%# A     $  #5]"C"J"JR\^h^k^kQl"J"mmF~# ##~jmm_DT%UV%/CC00JMM0BCC&&..:2!-"/'9&7)    '(mm$&70GG!'!7!7T!7!J $'8'@'@-E  (99NOP P!fg Gt n CCCCC 8  &&'RTUV a ' 8/DQCq-IJ$//a&1Q v/J/JK   > *G,s1v5 ++!Wf-,,    sK.AHG/AH2G234H'G5(+HG8HG<4 H?G:-H-H.A1HK. H2H5H8H:H<HH H H K+C K&&K++K.c Kt|jddid{}g}g}|D]}td|j}|j}||j vs8t |jt |j j|}|j'|j|jj|f||=|jt|jd|idtj|itj |d{|S77 w) z Delete a team model alias Iterate through all team model aliases and delete the one that matches the model_id Returns: - List of team id + model alias pairs that were removed teamT)rNzdict[str, str]r model_aliasesrb)rrr rrrrlkeysindexrrrrrErFrgather) rrteam_model_aliasestasksrteam_model_aliasrrr=s r`rrsB'9&G&Q&Q[acgZh&Q&i iE:<. .<<    4 4 6 6}))+,T-2F2F2H-I-O-OPa-bcC$$0%,,.>.C.C.K.KS-QRc" LL"=188*)4::m+DE9 " ..%    -!j(!s)!ED>AE&CE7E8EEz /model/newz=Allows adding new models to the model list in the config.yamlc Kddlm}m}m}m}m}m} |tddditj||||d{t|jd t|jt|jtd  d}|j j#d } t%| t'| t)|} |d ur t+} t-dd} |j.} |j j0t3| ||d{}nt5| ||d{}|j7||d{} |jdgxsg}d|vr:|j8j;| j.| | j d{ntdddi|tddditCjDtG|jHd|tJjLdtO|tPr|jSd nd|jTtVtY| |jHt[|ddfgd| j\| j^|S777[7G7/7#t<$r }t?j@d|Yd}~d}~wwxYw#t<$r}t?j@d|tO|trPtat[|dd|dtbjdt[|d d!t[|d"tfjh#tO|t`r|tad$tk|ztbjdt[|d d!tfjh#d}~wwxYww)%a Add a new model to the proxy. Parameters: - model_name: str - The name users will use to call this model (required) - litellm_params: dict - LiteLLM-specific parameters (required) - model: str - The actual model identifier, e.g., "azure/my-deployment-name" (required - this is the only required field in litellm_params) - api_key: str - API key for the provider (optional) - api_base: str - API base URL (optional) - Other optional params: api_version, timeout, max_retries, etc. - model_info: dict - Additional model metadata returned in /v1/model/info (optional) Example curl: ```bash curl -L -X POST 'http://0.0.0.0:4000/model/new' -H 'Authorization: Bearer LITELLM_VIRTUAL_KEY' -H 'Content-Type: application/json' -d '{ "model_name": "my-azure-model", "litellm_params": { "model": "azure/my-deployment-name", "api_key": "my-azure-api-key", "api_base": "https://my-endpoint.openai.azure.com" }, "model_info": { "my_custom_key": "my_custom_value" } }' ``` Returns: - The created model entry with model_id r)general_settingsrUr proxy_configrrVNrWrrrr^rF)rrTr~rnrorrralertingslack)r{litellm_model_namepassed_model_infozException in add_new_model: %srzCFailed to add model to db. Check your server logs for more details.createdrdr}rrkzBlitellm.proxy.proxy_server.add_new_model(): Exception occured - %srrrrrrrr)6rpr'rUrr(rrVrrurvrrrrrrr}rrr r>r}r-r{rrradd_deploymentslack_alerting_instancemodel_added_alertrrrrrr;ryr'rrrrr|rrrrnror,r+ryrrrm)r9rQr'rUrr(rrVrrpriced_model_paramsrrr _alertingrs r` add_new_modelr5sX}  u (@@%/'% A    2(77  3'66*../SUZ[\ bf%1%<%<%G%GUY%G%Z/0CD !45%;L%I  $  )@(A /?d_c/dN T6B6M6M,**22:+;%8*;&3,&N ,A%8*;&3,&N (4'B'B"/CT(C("$4#7#7 B#G#M2 i'+CCUU#6#A#A+G*=*H*HV !fg   !!fg   #(11 "3,CC!ISTbdmInN222Etx#4#<#<)A   )%+44gnl\`6abc(66%00  C F& & "  T$../OQRSS TR  &&'kmno a ' 8/DQCq-IJ$//a&1Q v/J/JK   > *G,s1v5 ++!Wf-,,    sN -J2I8B*J2-3J I;!J7I>8JJAJ&J'J+C J27N 8J2;J>JJJ J/J*%J2*J//J22 N ;C NN  N z /model/updatezEdit existing model paramsc Kddlm}m}m}m}m} |t dddid}t|dd}| td |j}| td t|jjd |i d{} | .|!|j| t ddditdtd'i| j} t j#| |||d{t%|j&| j&|durt)d| } t+| j&} |j& td|j&j+d} | j-D] \}}t/|}||j&|<"i}|j&j+}|j-D]\}}||||<|| vr| | | |||< !t1j2||j4xs|d}t7|j9d |i|d{}t;}t=d{}t?j@tC|d|tDjFtI| tJr| jMdndtI|tJr|jMdnd|j4|tO||t|ddfgd|jP|jR|Sy77"77#t$r}tUjVd|tI|t rPtYt|dd |d!tZj\t|d"d#t|d$t^j`%tI|tXr|tYd&tc|ztZj\t|d"d#t^j`%d}~wwxYww)(z Old endpoint for model update. Makes a PUT request. Use `/model/{model_id}/update` to PATCH the stored model in db. r)rrTrUrrVNrWrrrr}zmodel_info not providedzmodel_info.id not providedryrrZrzOCan't edit model. Model in config. Store model in db via `/model/new`. to edit.zmodel not foundr^rTrzlitellm_params not providedr~r)rr`rbrcrdrrkzAlitellm.proxy.proxy_server.update_model(): Exception occured - %srrrrrrrrrp)2rprrTrUrrVrrrrr@rrrrrUrrurvrrr rrr4rErFr|rrr}r~rrr;r'rrrrrrnrorrr,r+ryrrrm)r9rQrrTrUrrV _model_id _model_info_existing_litellm_params deploymentexisting_model_row_existing_litellm_params_dict_new_litellm_params_dictrrrmerged_dictionary_mpr=rrrrrrs r` update_modelr@msOB  u !% /6|\SW/X  56 6NN  89 9)8)G)M)M)Y)Yakmv`w)Y)x#x # +%**C*CY*C*W*c# ##%vw  122&O)A)L)L)NO '@@#/'% A    2(77&55  $(,#%=) 488J8Y8Y3Z )**2 =>>.:.I.I.N.N\`.N.a $1668 A1"6Q"?1@ ++A. A (* %4499;C!iik  U$-2%c*99>[\_>`>l-J3-O%c*  #'**->"?/77S;S,E+=]*K*R*R!9-+S+%N )@(A *5-$7N   ''$&70GG&&8)D+:::M!&ni@'66D6I!'8'@'@-E! * -)!*GNLRV,W XY,::)44  " !M %3$y Z%%8@  &&'jlmn a ' 8/DQCq-IJ$//a&1Q v/J/JK   > *G,s1v5 ++!Wf-,,    suO0A0LL A)L,L-EL3L4LLB9L O0 LLLL O-C O((O--O0z/model_group/make_publicz$Update which model groups are publicrequestcK ddl}ddlm}m}|jt j k7rtddd|ji|durtd dd i|jd{}d |vri|d <|j|d d <|j| d{|j|_ tjd|j|jd|j|jdS77\#t$r[}tj d|t#|tr|t%d|t&j(t*j,dd}~wwxYww)a Update which model groups are public. This endpoint allows admins to specify which model groups should be publicly accessible. Public model groups are visible via the /public/model_hub endpoint. Args: request: Request containing list of model group names to make public user_api_key_dict: User authentication information Returns: Success message with updated public model groups Raises: ProxyException: For various error conditions including authentication errors rN)r(rVrrR>RTeTmTm B#*#7#7+33  '8 :   &&'OQRS a 'G:1#> 6666    sOE*A+D/C?04D$D%AD>E*?DD E' AE""E''E*z/model_hub/update_useful_linkszUpdate useful linkscK ddl}ddlm}|jtj k7rt ddd|ji|jd{}d|vri|d<|j|dd <|j| d{|j|_ tjd |j|jd |j|jd S77\#t$r[}tjd|t!|t r|t#d|t$j&t(j*dd}~wwxYww)z Update useful links. rN)r(rrrCrrDpublic_model_groups_linksrFz'Updated useful links to: %s by user: %sz!Successfully updated useful links)r useful_linksr`rHrIr)rJrpr(rwr(rxrrKrRrLrQrrMr|rrrr,r+rrr)rArQrJr(rNrs r`update_useful_linksrSasf4 ;  & &*:*F*F F[\m\w\w[xy +5577 V +)+F% &BIBVBV!"#>?&&&&999-4,@,@)"" 5w7K7KM^MfMf ;#00+33  '8 :   &&'OQRS a 'G:1#> 6666    sOEAC.C*4C.C,AC.)E*C.,C.. E7AE  EE tier_labels.c|sy ttj|jS#tt f$r4}t d|tjtjd|d}~wwxYw)a(Resolve the tier_labels query param into the labeled tiers the rubric is built from. Validated through ComplexityRouterConfig so the editor prefills what the router would send: the same field validators that reject a blank, duplicated, or canonical-name-stealing label on the write path reject it here, rather than this returning a rubric no router could be configured to use. A malformed value is the caller's error, so it surfaces as a 400. None when unset, letting classification_system_prompt apply its own default names. N)rTz@tier_labels must be a JSON object of tier name to display name: rTr) rGrEloads labeled_tiersrrr,r+bad_request_errorrr)rTrs r`_labeled_tiers_from_queryrYst %$**[2IJXXZZ _ -VWXVYZ 22,,    s,2A5/A00A5c|eZdZUdZeedfed<eZe e e dfed<dZ e dzed<edeZy) (AutoRouterClassifierPromptPreviewRequestzA POST rather than query params: classification_prompt is the operator's own text, which must not reach access logs through a URL..tier_definitionsr)gecontext_window_sizeNclassification_prompt)rhrirjrkrrIrnrEr^r rrr_rmrrL_normalize_promptrprqr`r[r[sU,NC/007]3 #34](,3:,@(?@A`arqr[z&/auto_router/classifier/default_promptzRGet the system prompt an auto-router's LLM classifier sends for an edited tier setctKtt|j|j|jSw)a! Get the classifier system prompt an edited tier set sends, so the dashboard can show it. Built by the same function the live classifier uses, so the preview cannot drift from what the router sends. Payload validity beyond a renderable definition stays the dry-run's job.  system_prompt)rRrKr\r_r^)rAs r`%preview_auto_router_classifier_promptrds6 57  $ $g&C&CWE`E`  s68zFGet the built-in system prompt used by an auto-router's LLM classifierr^classification_rubriccK|dkr+tdtjtjdt |}t |t||St|||Sw)aZ Get the classifier system prompt a router would send, so the dashboard can show it. The prompt's closing line depends on whether prior conversation turns are quoted to the classifier, its tier bullets are named by the router's tier_labels, and its calibration examples come from the router's classification rubric, so the caller passes all three to get the text that router would actually send rather than a rubric it does not use. An edited tier set replaces the whole rubric; POST to this path for that prompt, which carries the operator's own instructions and so must not ride in a query string. Parameters: - context_window_size: int - The router's classifier_context_window_size. Defaults to the built-in default. - tier_labels: str | None - The router's tier_labels as a JSON object of canonical tier name to display name, e.g. `{"SIMPLE": "Cheap"}`. Omit or pass an empty object for the default names. - classification_rubric: ClassificationRubric | None - The router's classifier_llm_config.classification_rubric. Omit for the default. rz(context_window_size must be non-negativer^r)re)rWrerb)r,r+rXrrrYrRrJ)r^rTrerWs r`)get_auto_router_classifier_default_promptrgs<Q> 22,,'   5[AM 4$ ))  HH$<   ' LL " # rqct|tr|St|tsy tj|}t|tr|SdS#t t f$rYywxYw)aEA DB row's model_info column arrives as a dict or as its JSON string depending on the query path, and every consumer needs the mapping. Single owner of that parse: returns None when no usable mapping exists (None, an unparseable string, or JSON that is not an object), and callers choose what None means for them.N)rrrmrErV TypeError ValueError)r}rs r`rr$ sc *g& j# & :. 06:d: z "sAA A cRddlm} |t|S#t$rYywxYw)Nr)$model_info_is_active_for_environmentrT)litellm.routerrprrn)r}rps r`_expects_liveness_on_this_podrr4 s.C3?TU_?`aa s  &&cXddlm}| tSt|jS)zThe ids this pod's router is currently serving, read fresh from the module global because a reload can rebind it. The empirical ground truth every verdict below is computed from; an absent router serves nothing.rr)rprTr get_model_idsrs r`r}r}= s)6{ Z--/ 00rqrlrmwritten_must_servernroc | tn| td|D}|rt fd|D}nt fd|D} z |z }tt||n||z}||fS)aJudge a write-triggered reload by diffing the router's serving state instead of trusting any layer of the reload stack to report its own failure. The full cell matrix, per id: - written, must-serve (the write's purpose is this model's serving state): live now is fine; not live is reported unless the row is deliberately inactive for this pod's LITELLM_ENVIRONMENT; a row whose model_info cannot be read counts as expecting to serve, so its drop is still reported - written, metadata-only (must_not_degrade): live before and gone now is reported; a row that was already not serving stays silent, because its deadness predates this write and blaming it would block unrelated metadata fixes - not written but live before and gone now: collateral degradation of this pod caused by the reload this request triggered (a wholesale re-add failure, or a newly introduced conflict), reported only when the db still wants that id ``still_desired`` is the db + config id set the reload just reconciled against. An id absent from it was deleted on purpose, most often by another pod this one had not yet polled, so the reload dropping it is the reconcile working rather than damage. Without it (no reconcile ran) every drop is reported, which is the safe direction. ``live_after`` is the router's serving state captured by the reload itself, while it still held MODEL_RECONCILE_LOCK. Pass it whenever the caller has it: re-reading the router here instead means sampling it after the lock was released, where the NEXT reconcile's leading wipe (clear_cache un-serves every db model before reloading them) shows up as this reload having dropped them. Falling back to a fresh read is only correct when no reconcile ran and there is nothing to be concurrent with. Returns (written ids violating their obligation, collateral ids no longer served). c3&K|] \}}| ywrvrp)rryrs r`rz)reload_serving_verdict..m s"N !8"Nsc3FK|]\}}|vrt|r|ywrv)rr)rryr}nows r`rz)reload_serving_verdict..o s- $*s"'DZ'P  s!c3<K|]\}}|vs |vs|ywrvrp)rryrrlrys r`rz)reload_serving_verdict..u s&q[XqhRXFX]emp]pqs )r}rrr%) rlrmrurnro written_idsrdropped collateralrys ` @r`reload_serving_verdictr~H sH/9.@(*jC""N~"NNK (6   qNqqc\K/Gf 0EW7UbKbcdJ Z  rqct||d||\}}|s|sy|rdt|dnd}|rdt|dnd }td |d ||d tjt j d )aFThe caller-visible error this pod's model-write endpoints owe their caller when the model they wrote is not being served after the reload they triggered. The DB write is durable either way and every other pod reloads on its own interval; this speaks only for the handling pod. Callers hold a ReconcileOutcome from the reload; pass BOTH of its fields. Supplying still_desired without live_after mixes a snapshot taken under the reconcile lock with one taken after it was released, which is what makes a concurrent model write look like collateral damage.T)rlrmrurnroNzthe model id(s) zY are not live in this pod's router after the reload and are not being served by this pod.z:the reload it triggered degraded this pod's serving state.z Previously served model id(s) z- are also no longer being served by this pod.r\z was saved to the database, but z Other pods reload on their own interval. Check server logs for 'Error upserting deployment' or 'Error creating deployment' for the cause.r)r~rlr,r+rrr) rlrmrfrnrorr}missing_clausecollateral_clauses r`rr{ s 1%# GZ :  4=/*$ $J   *$z*:);;hi  VH<^$>$@N#%M"$L%(UO' 0"YY|R8 >>*e4 '' t(<="'*6&88O8L"((/! 0f. A ''++J=--11*dC++// DA**..z4@  A$0#F#F+?P$G$G ' & &Esr?%litellm.repositories.model_repositoryr@%litellm.repositories.prisma_protocolsrA'litellm.repositories.table_repositoriesrB$litellm.repositories.team_repositoryrCrqrD)litellm.router_strategy.complexity_routerrErFrGrHrIrJrKrL-litellm.router_utils.auto_router_model_namingrMrNrOrPrQClitellm.types.proxy.management_endpoints.model_management_endpointsrRrSrrTrUrVrWrX litellm.utilsrYprismarZ prisma_modelsr[rnrbrsrrrrrrrrrrrmrrrrrrrrrrrrrr r r rr-r rrrrrrrrrrr'r.r8r>rNr0rrpostrrrrr{rrrrlrrrrrrurrr5r@rOrSrYr[rdrrrgrkrrrr}r~rr~rprqr`rs  88 "KKNNSS16 CRIO P;A>H?!   +. 6.Y. IX I Qx Q.X.II6x6]x]+!8+ 0l07G0/L/5E/.,.:.5l57g5##\#jSWFW##l)D0#l)D0#l 4Z#lL )D0 )D0   /M$eL%3U3BVbfko8$[2I$JK%K y4/? IcN  c c@P cU\]`bh]hUi cfAUZ^4 ;f)= ;$ ;.%>E=%?U?>N --2C 8 --3R 8?U73b (9#9:; @PPR?SeGCr):$:;<S1E5f-.E!65 #:%93u3ZFZtZ#V## Z&ZTZgc6k6JV]^aci^iVjos8%V $%CK(%c6k" %  S%%)#gc5j&99 9: %PsF{+V $CK(     73b )GCJ,??? @)C. PQ B ,H(jH(9IH(NkH(V  +,-)00A(BY Y  Y &Y  Y xi i %i i  * + i d i t# i X  +,- )00A(B%+ t&  &d t#  0  +,- )00A(B%+ t&  &d t#  D&*&* % d  $  N >//%/ /N /dRHRH RH&RH RH # RHj+ ++ +\ !&   *QU   !- 6F6M  n F'3i'' ' #Y 'T  X6!% III(I$ I  I  IXP! P!P!P!! P! & P!  $& P! P!fmmbM  +,-  )00A(Bx x %x  x v"!"!"! %S/"!LO  +,-  )00A(Bl l %l  l `,  +,-  )00A(BS "S %S  S l6  +,-  )00A(BO +O %O  O d$%  +,-  )00A(B; %; %;  ; |3:%nVYFY@Z\_@_:`cg:g.byb,d  +,-    5 .    ,X  +,-   F"9=))t)0$6)/ )  )XtDzd4j* ;f ;f1E1L ; f131,0(, 0! cN0!U3;/00!0!S>D( 0! #% 0!  5c?E#s(O +, 0!n,0(, - cN-U3;/0- -S>D( - #% -  -`kI+kIrq