tPj"UdZddlmZddlZddlmZddlmZddlm Z ddl m Z ddl m Z mZmZmZdd lmZd Zd ed <d Zd ed<dZded<dZded<dZded<dZded<dZd ed<dZd ed<dZd ed<Gddee ZGd d!ee ZGd"d#ee Z Gd$d%ee Z!ed&d&'Gd(d)Z"eGd*d+eZ#ed&d&'Gd,d-Z$ed&d&'Gd.d/Z%ed&d&'Gd0d1Z&e%e&zZ'd2ed3<ed&d&'Gd4d5Z(ed&d&'Gd6d7Z)e(e)zZ*d2ed8<e ejVd9ejXd:iZ-d;ed<<e ejVd=ejXd>iZ.d;ed?<dMd@Z/dNdAZ0dNdBZ1dNdCZ2dNdDZ3dOdEZ4dPdFZ5dQdGZ6dRdHZ7edI dSdJZ8dTdKZ9dUdLZ:y)VaSecurity controls for vector-store file uploads. Content is classified by inspecting its actual bytes (magic signatures and a strict UTF-8 decode), never by trusting the client-supplied filename or content-type. Uploads are restricted to an allowlist of non-executable formats, capped in size, screened for archives, and passed through a dependency-injected malware scanner before they are accepted. Accepted uploads are given a server-generated filename so the client-controlled name never reaches storage. ) annotationsN)Mapping) dataclass)Enum)MappingProxyType)FinalProtocol TypeAliasruntime_checkable) assert_neveri rMAX_UPLOAD_SIZE_BYTESsDX5O!P%@AP[4\PZX54(P^)7CC)7}$EICAR-STANDARD-ANTIVIRUS-TEST-FILE!$H+H*EICAR_TEST_SIGNATURE) sPKsPKsPKss7zXZs7z'sRar!sRar!s"Ms(/zFinal[tuple[bytes, ...]]_ARCHIVE_MAGIC_PREFIXES)sBZh'_ARCHIVE_MAGIC_PREFIXES_ASCII_AMBIGUOUS)sELFssssssasm_EXECUTABLE_MAGIC_PREFIXES)sMZsdex *_EXECUTABLE_MAGIC_PREFIXES_ASCII_AMBIGUOUSsustar_TAR_USTAR_MAGICi_TAR_USTAR_OFFSETs _UTF8_BOMceZdZdZdZy)DetectedFormatpdftextN)__name__ __module__ __qualname__PDFTEXTp/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/rag_endpoints/upload_security.pyrr;s C Dr rceZdZdZdZdZy)DisallowedKindarchive executableunknown_binaryN)rrrARCHIVE EXECUTABLEUNKNOWN_BINARYrr r!r#r#@sGJ%Nr r#c(eZdZdZdZdZdZdZdZdZ y) RejectionReason empty_filefile_too_largearchive_not_allowedexecutable_not_allowedunsupported_formatmalware_detectedmalware_scan_errorN) rrr EMPTY_FILEFILE_TOO_LARGEARCHIVE_NOT_ALLOWEDEXECUTABLE_NOT_ALLOWEDUNSUPPORTED_FORMATMALWARE_DETECTEDMALWARE_SCAN_ERRORrr r!r+r+Fs*J%N/5-)-r r+ceZdZdZdZdZy) ScanVerdictcleaninfectederrorN)rrrCLEANINFECTEDERRORrr r!r;r;Ps EH Er r;T)frozenslotsc&eZdZUded<dZded<y) ScanResultr;verdictNz str | None signature)rrr__annotations__rGrr r!rErEVs  Iz r rEceZdZddZy)MalwareScannercyNrselfcontents r!scanzMalwareScanner.scan^sr NrObytesreturnrE)rrrrPrr r!rJrJ\s5r rJceZdZdZddZy)EicarTestMalwareScanneraUPlaceholder scanner that only flags the EICAR anti-malware test file. It exists to prove the scan hook is wired end to end and to satisfy the EICAR retest; it provides no real protection. Inject a scanner backed by a real engine through the ``scanner`` parameter of :func:`validate_upload` to screen production uploads. c|t|vrttjdSttjS)Nz"EICAR-STANDARD-ANTIVIRUS-TEST-FILE)rFrG)rF)rrEr;r@r?rMs r!rPzEicarTestMalwareScanner.scanks/ 7 *k&:&:Fjk k+"3"344r NrQ)rrr__doc__rPrr r!rUrUas 5r rUceZdZUded<y)AllowedContentrformatNrrrrHrr r!rYrYqs r rYceZdZUded<y)DisallowedContentr#kindNr[rr r!r]r]vs r r]r ContentInspectionc6eZdZUded<ded<ded<ded<y) SecuredUploadstr safe_filename content_typerdetected_formatint size_bytesNr[rr r!rara~s##Or rac"eZdZUded<ded<y)RejectedUploadr+reasonrbmessageNr[rr r!riris  Lr riUploadValidationrtxtz#Final[Mapping[DetectedFormat, str]]_SAFE_EXTENSIONzapplication/pdfz text/plain_SAFE_CONTENT_TYPEc,tfd|DS)Nc3@K|]}j|ywrL) startswith).0prefixrOs r! z#_starts_with_any..sAfw!!&)As)any)rOprefixess` r!_starts_with_anyrxs AA AAr ct|trytttz}t||k\r|t|tk(ryt|t xr t | SNT)rxrrlenrr _is_utf8_text)rO tar_magic_ends r! _is_archiver~s\!89,s3C/DDM 7|}$1B=)QUe)e G%L M lVcdkVlRllr cPd|vry |jdy#t$rYywxYw)NFzutf-8T)decodeUnicodeDecodeErrorrOs r!r|r|s7'w  s  %%c`t|tryt|txr t| Srz)rxrrr|rs r!_is_executable_binaryrs-!;< G%O P oYfgnYoUoor cj|jtj}|jdS)Ns#!) removeprefixrlstriprr)rObodys r!_looks_like_shebangrs*&&y188:D ??5 !!r ct|rttjS|j drt t jSt|rttjSt|rttjSt|rt t jSttjS)Ns%PDF-)rr]r#r(rrrYrrr~r'rr|rr)rs r!inspect_contentrs7# !:!:;;(#n00117 !7!788W% !:!:;;Wn1122 ^:: ;;r cVtjjdt|S)N.)uuiduuid4hexrn)res r!generate_safe_filenamers&jjl q!A B CCr c,|xtjk(rttjdSxtj k(rttj dStjk(rttjdSt|y)Nz Archive uploads are not allowed.z#Executable uploads are not allowed.z/Only PDF and UTF-8 text documents are accepted.) r#r'rir+r5r(r6r)r7r )r^s r!_reject_disallowedrs}  #^ # #!332 '^ & &!665  * *!22A r ch|j|}|jxtjk(ryxtjk(r-t t jd|jxsddStjk(rt t jdSt|jy)Nz/Uploaded file was flagged by malware scanning (zunknown signaturez).z5Malware scanning could not complete; upload rejected.) rPrFr;r?r@rir+r8rGrAr9r )rOscannerresults r!_scan_rejectionrsLL)F .. [   ![ ! !!00A&BRBRBiViAjjlm   !22G  r )max_size_bytesct|}|dk(rttjdS||kDr!ttjd|d|dSt |}t |trt|jSt||}||Stt|jt|j|j|S)NrzUploaded file is empty.zUploaded file is z bytes, exceeding the z -byte limit.)rcrdrerg)r{rir+r3r4r isinstancer]rr^rrarrZro)rOrrsize inspectionscan_rejections r!validate_uploadrs g,D qyo88:STT n  * *v%;N;K< X  (0J*/0!*//22+GW=N! ,Z->->?' (9(9:"))  r cZdjd|Dj}|xsdS)Nc3*K|] }|dvs| yw)z"\ Nr)rschars r!ruz,_sanitize_header_filename..sQt4y;PdQs download)joinstrip)filenamestrippeds r!_sanitize_header_filenamers*ggQxQQWWYH  !z!r c8tdt|dddS)Nzattachment; filename=""nosniff)zContent-DispositionzX-Content-Type-Options)rr)rs r!safe_download_headersrs, %;rs# #!"@@*0u0fef 51 EN')AM84HY*,DX"%"5" 5"S$ &S$& .c4.#t  $d#!!$! 6X66 $d# 5 5$ 5 $d#$ $d#$ .0AA9A $d#$ $d#$ ,n<)<7GEU84;K-\;7Bmp " <D(!,0     >" r