tPjU :UddlZddlZddlmZddlmZmZddlZddlm Z m Z m Z ddl m Z ddlmZddlmZddlmZdd lmZed d hZeeeed <d edefdZd edefdZd edefdZde dzdefdZde dzdedzfdZ de dzdefdZ!de dzdeddfdZ"de dzdefdZ#dede deedefdZ$de deeeffdZ%deeefdeeeffdZ&de deeeffd Z'd'deeefd!edeeeffd"Z(d#ede)efd$Z*dede defd%Z+dede ddfd&Z,y)(N) Collection)AnyFinal)Request UploadFilestatus)verbose_proxy_logger)"MAX_REQUEST_BODY_SIZE_TO_REPAIR_MB)ProxyException)&get_metadata_variable_name_from_kwargs) Deploymentz!application/x-www-form-urlencodedzmultipart/form-data_FORM_CONTENT_TYPES content_typereturncj|sy|jdddjjS)zGReturn the bare media type per RFC 7231: strip params, trim, lowercase.;r)splitstriplowerrs r/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/common_utils/http_parsing_utils.py_normalize_media_typers2    c1 %a ( . . 0 6 6 88c$t|tvS)a9 True iff Starlette's ``request.form()`` will actually parse this body. Substring matching ``"form"`` is unsafe: ``request.form()`` returns empty ``FormData`` for non-canonical types without consuming the body, leaving the auth-time pre-read and the handler's read seeing different payloads. )rrrs r_is_form_content_typers ! .2E EErct|dk(S)z+True iff the body should be parsed as JSON.zapplication/json)rrs r_is_json_content_typer&s  .2D DDrrequestcK |iSt|}||St|}|jdd}t|rW |j d{}t|}d |vrbt|d trOtj|d |d <n3|j!d{}|si}n t#j|}t3|||S7#t $r;}t jd|td|ddtj d}~wwxYw7w#t"j$$r}t&d zd z}|d kDrDt)||kDr6t jd |td|ddtj t|t*r|j-dn|} t/j0dd| } t/j0dd| } tj| }nM#tj$$r7t jd |td|ddtj wxYwYd}~~d}~wwxYw#tj$t"j$tf$r}t jd |d}~wt $r"}t j4d|icYd}~Sd}~wwxYww)z Safely read the request body and parse it as JSON. Parameters: - request: The request object to read the body from Returns: - dict: Parsed request data as a dictionary or an empty dictionary if parsing fails N)r content-typerzInvalid form payload: %szInvalid form payload: invalid_request_error request_body)messagetypeparamcodemetadatairz!Invalid JSON payload received: %szInvalid JSON payload: zutf-8z"[\uD800-\uDBFF](?![\uDC00-\uDFFF])z#(?2F  . )0#7 y/K[(Z J8OQT-U*.**[5L*M J'!( .D $"(,,t"4KL &g;OE$8 %**+EqI$4QC80(44  &/--"1SUY0Y\`0`&)A-#d)>P2P,223VXYZ,&9J J>J93J>4K9J>>Kc|yt|drQd|jvrCt|jdtr&|jd\}}|Dcic]}||| c}Sycc}w)Nscoper*)hasattrrIr3tuple)r accepted_keysr*keys rr+r+smw ]gmm%C SZS`S`anSoqvHw%,]]=%A" {1>?#[%%?? @s A"c|iS t|drt|jSiS#t$r"}t j d|icYd}~Sd}~wwxYw)N query_paramsz2Unexpected error reading request query params - %s)rJr2rOr/r debug)r rDs r_safe_get_request_query_paramsrQsX  7N +,,- - ""#WYZ[ s )) AA AAr*c |yt|j|f|jd<y#t$r }t j d|Yd}~yd}~wwxYw)Nr*z1Unexpected error setting request parsed body - %s)rKkeysrIr/r rP)r r*rDs rr?r?sX[ ? (-k.>.>.@(A;'O m$ [""#VXYZZ[s.(. AAAcd|iSt|dd}t|dd}t|tr|S|tjdt | t|j } |||_|S#t$r"}tjd|i}Yd}~2d}~wwxYw#t$rY|SwxYw)u [Non-Blocking] Safely get the request headers. Caches the result on request.state to avoid re-creating dict(request.headers) per call. Warning: Callers must NOT mutate the returned dict — it is shared across all callers within the same request via the cache. Nstate_cached_headersz+Unexpected cached request headers type - %sz-Unexpected error reading request headers - %s) getattrr3r2r rPr&headersr/rV)r rUcachedrXrDs rr,r,s 7GT2EE#4d;F&$  ""#PRVW]R^_w'  $+E ! N ""#RTUV   N s*A4) B"4 B=BB" B/.B/ request_datafilerouter_model_namesclddlm}m}m}m}|j xsd}|dz }d|vri|d<||dd<d} |W|d|vrP |j |d} | r8| j,| jj| jj} | ptjd || |s1|d |jjt j"d d || kDr!|d|d| dt j"d d y#t$r)} tjd t| Yd} ~ d} ~ wwxYw)z Check if any files passed in request are under max_file_size_mb Returns True -> when file size is under max_file_size_mb limit Raises ProxyException -> when file size is over max_file_size_mb limit or not a premium_user r)CommonProxyErrorsr llm_router premium_userir)file_size_in_mbNmodel)model_group_namez%Got error when checking file size: %sz=Checking file size, file content size=%s, max_file_size_mb=%sz:Tried setting max_file_size_mb for /audio/transcriptions. bad_requestr[)r%r(r&r'zGFile size is too large. Please check your file size. Passed file size: z MB. Max file size: z MBT)litellm.proxy.proxy_serverr^r r_r`size"get_deployment_by_model_group_namelitellm_paramsmax_file_size_mbr/r r0r4rPnot_premium_uservaluerr1) rZr[r\r^r r_r`file_contents_sizefile_content_size_in_mbri deploymentrDs rcheck_file_size_under_limitros!% Q%7;%G%#% Z 2IL./,w"7;M"M Z3=3`3`!-g!64a4J--9-->>J#-#<#<#M#M #"" K #   TUfUwUwU}U}T~00"   #%5 5 abyaz{OP`Oaade00"   1 Z & &'NQTUVQW Y Y ZsAD D3 D..D3cK|jd{}i}|jD]B\}}|jdr'|dd}|j|gj |>|||<D|S7]w)z Read form data from request Handles when OpenAI SDKs pass form keys as `timestamp_granularities[]="word"` instead of `timestamp_granularities=["word", "sentence"]` Nz[])r. multi_itemsendswith setdefaultappend)r r.parsed_form_datarMrk clean_keys r get_form_datarxs  &D.0&&(* U << CRI  ' ' 2 6 = =e D$) S ! * 'sA6A4AA6rCcKi}|jD]\}}t|trf|r^t|ddrOg}|D]B}|j d{}|j |j ||jfD|||<v|||<|t|dr6|j d{}|j ||jfg||<|||<|S77-w)a Convert FastAPI UploadFile objects to file data tuples for litellm. Converts UploadFile objects to tuples of (filename, content, content_type) which is the format expected by httpx and litellm's HTTP handlers. Args: form_data: Dictionary containing form data with potential UploadFile objects Returns: Dictionary with UploadFile objects converted to file data tuples Example: ```python form_data = await get_form_data(request) data = await convert_upload_files_to_file_data(form_data) # data["files"] is now [(filename, content, content_type), ...] ``` rreadN)itemsr3listrJrzrufilenamer)rCdatarMrkfilesf file_contents r!convert_upload_files_to_file_datars,Doo' U eT "q62MA)*>LLL!**lANN!KLM"S !S UF #!&-L..,8J8JKLDIDI%& K$2.s%AC CAC 0C1,C C cK|jdk(rf|jjdd}t|rt |d{St |rt |d{Std|iS727w)z5 Read the request body and parse it as JSON. POSTr"rNzUnsupported content type: )methodrXr-rrGrrx ValueError)r rs rget_request_bodyrLsw~~%oo11."E  .+G44 4 "< 0&w// /9,HI I I 5/s$AA>A:A>%A<&A><A>prefixc|siSi}|jD]\}}t|tr|j|s)t|trt j d|P |j|djd}|jd}|r|dst j d||}|ddD]<}t|tst j d |nC|j|i}>t|tr |||d<nt j d ||S#t$r"} t jd || Yd} ~ Ad} ~ wwxYw) aK Extract nested metadata from form data with bracket notation. Handles form data that uses bracket notation to represent nested dictionaries, such as litellm_metadata[spend_logs_metadata][owner] = "value". This is commonly encountered when SDKs or clients send form data with nested structures using bracket notation instead of JSON. Args: form_data: Dictionary containing form data (from request.form()) prefix: The prefix to look for in form keys (default: "litellm_metadata[") Returns: Dictionary with nested structure reconstructed from bracket notation Example: Input form_data: { "litellm_metadata[spend_logs_metadata][owner]": "john", "litellm_metadata[spend_logs_metadata][team]": "engineering", "litellm_metadata[tags]": "production", "other_field": "value" } Output: { "spend_logs_metadata": { "owner": "john", "team": "engineering" }, "tags": "production" } z6Skipping UploadFile in metadata extraction for key: %sr]z][rz,Invalid metadata key format (empty path): %sNzCCannot create nested path - intermediate value is not a dict at: %sz3Cannot set value - parent is not a dict for key: %sz#Error parsing metadata key '%s': %s)r{r3r4 startswithrr warningreplacerstriprr2rtr/r0) rCrr)rMrk path_stringpartscurrentpartrDs rextract_nested_form_metadatar[sgF  &(Hoo') U#s#3>>&+A  eZ ( ( ()acf g  ++fb188=K %%d+Ea$,,-[]`aGcr m!'40(00]_c!,,T26 mgt,).GE"I&(001fhklK)V O   & &'LcST U  s (AD28A5D22 E;EEr$ct|}|j|}t|tr#ddlm}||}t|t r|ni}nt|t si}|jdg}|jdg}g}t|tr|j|t|tr|j||Dcgc]}t|ts|c}Scc}w)z Extract tags from request body metadata. Args: request_body: The request body dictionary Returns: List of tag names (strings), empty list if no valid tags found r)safe_json_loadstags) r r-r3r4*litellm.litellm_core_utils.safe_json_loadsrr2r|extend) r$metadata_variable_namer)rparsedtags_in_metadatatags_in_request_body combined_tagstags rget_tags_from_request_bodyrs%K<$X 67H(C N'1'562 $ '#+<<#;'3'7'7'C&(M "D)-.&-12( ACJsC,@C AA As C+$C+ct|}|r*|jD]\}}|j||t|dd}t |t r|r|jD]l\}}|dk(rP|jd||j d}t |tr||vr|j|n|g|d<[|j||ntjd|j d|St|||S)a  Copy FastAPI path params and query params into the request payload so downstream checks (e.g. vector store RBAC, organization RBAC) see them the same way as body params. Since path_params may not be available during dependency injection, we parse the URL path directly for known patterns. Args: request_data: The request data dictionary to populate request: The FastAPI Request object Returns: dict: Updated request_data with path parameters and query parameters added path_paramsNvector_store_idvector_store_idszIpopulate_request_with_path_params: Found path_params, vector_store_ids=%s)rZr ) rQr{rtrWr3r2r-r|rur rP_add_vector_store_id_from_path)rZr rOrMrkr existing_idss r!populate_request_with_path_paramsrs 9AL&,,. 0JC  # #C / 0 !->K+t$%++- 0JC''''(95A+//0BC lD1L0$++E28=wL!34  # #C / 0 "" W   / 0 # gN rcddlm}||}tjd|}|r|j d}t j d|||jd||jd}t|tr||vr|j|n|g|d<t j d|jdy t j d |y ) a Parse the request path to find /vector_stores/{vector_store_id}/... segments. When found, ensure both vector_store_id and vector_store_ids are populated. Args: request_data: The request data dictionary to populate request: The FastAPI Request object r)get_request_routez/vector_stores/([^/]+)/rzLpopulate_request_with_path_params: Extracted vector_store_id=%s from path=%srrzPpopulate_request_with_path_params: Updated request_data with vector_store_ids=%szHpopulate_request_with_path_params: No vector_store_id present in path=%sN) litellm.proxy.auth.auth_utilsrr=searchgroupr rPrtr-r3r|ru)rZr rpathvector_store_matchrrs rrrs@#G,D " *Dd K!3!9!9!!<"" Z\kmq   1?C*../AB lD )l2##O40?/@L+ ,"" ^   / 0 ""#mostr)zlitellm_metadata[)-r5r=collections.abcrtypingrrr8fastapirrrlitellm._loggingr litellm.constantsr litellm.proxy._typesr )litellm.proxy.common_utils.callback_utilsr litellm.types.routerr frozensetrr4__annotations__rboolrrr2rGr+rQr?r,rorxrrrr|rrrrrrs) & //1@/,-68[]r7s-tU9S>*t999FFFEEE cgnccL7T>dTk GdN t  [ t^ [ [  [w~$:<< <#3< <~T#s(^"*CH~* #s(^*Z G S#X SDcNSCSbfgjlogobpSl!BT!Bd3i!BH-D-7-t-` u u uD ur