uPjhdxUdZddlZddlZddlZddlZddlZddlmZmZm Z ddl m Z ddl m Z ddlmZmZmZddlZddlZddlmZddlmZdd lmZdd lmZdd lmZmZm Z m!Z!dd l"m#Z#dd l$m%Z&ddl'm(Z(ddl)m*Z*m+Z+e#Z,e GddZ-e GddZ.hdZ/ee0d<de1de e1e2fde1dzde1dzde3ejhzdzde1dzde5e1e2fdzde5e1e2fde-fdZ6d e-de7fd!Z8d e-d"ee1ge1dzfde5e1e2ffd#Z9d e-d"ee1ge1dzfde1dzfd$Z:d e-d%ee1ge1dzfde.fd&Z;d e-d%ee1ge1dzfde dzfd'Zej~d*Z@ee0d+<d,d-d.d.d/d0d1d1d2d3 ZAee0d4<d5e1de1fd6ZBde5e1efde5e1e1ffd7ZCe+ d9de1de e1e2fde1dzde1dzde3ejhzdzde1dzde5e1e2fdzde2de ee2e2e fzfd8Z%y):z Main OCR function for LiteLLM. N)Callable CoroutineMapping) dataclass)IOBase)AnyFinalcast)verbose_logger)request_timeout)Logging)$is_azure_document_intelligence_model)OCR_REQUEST_FORMAT_PARAM BaseOCRConfig OCRResponseparse_ocr_request_format)BaseLLMHTTPHandler)ocr)GenericLiteLLMParams)ProviderConfigManagerclientceZdZUeed<eeefed<edzed<edzed<eed<eeefdzed<eed<eeefed <eeefed <e e jzed <e ed <y) _PreparedOCRRequestmodeldocumentNapi_keyapi_basecustom_llm_provider extra_headersprovider_configoptional_paramslitellm_paramseffective_timeoutlitellm_logging_obj) __name__ __module__ __qualname__str__annotations__dictrobjectrfloathttpxTimeoutLiteLLMLoggingObjU/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/ocr/main.pyrr(s| J38n 4ZDjV $t++""#v+&&f%%u}},,**r1rcVeZdZUedzed<edzed<eeefed<eeefed<y)_PreparedRustOCRCallNrrheadersr!)r%r&r'r(r)r*r+r0r1r2r4r47s4 4ZDj #v+ #v+&&r1r4>mistralazure_ai vertex_ai_RUST_OCR_PROVIDERSrrrrtimeoutrrkwargsreturncNtt|jd}ttdz|j dd} t |t stdt||j d} | dk(rt|}|j d} | dvrtd| d|du} tj|||| \}}} } | xr|d k(xr t|}| r| }| r|s| }tj|tj| }|td |t!j"d ||t%j&|}|j)|}|j t*}|H t-|}t*|vr4|dk(r/tj.j1dt*d|d|||i}|D]}||vs|j|||<|j3|i|}t!j"d||xst4}|j7|||| |d|t9|||||||tt tt:f|t ||| S#t$r)}tj.j1||||d}~wwxYw)Nr$litellm_call_idzr)r;rr!r"r) rrrrrrr r!r"r#r$)r r/popr(get isinstancer* ValueErrorr?%convert_file_document_to_url_documentlitellmget_llm_providerrrget_provider_ocr_config LlmProvidersr debugrmodel_validateget_supported_ocr_paramsrr exceptionsUnsupportedParamsErrormap_ocr_paramsr update_from_kwargsrr+)rrrrr:rrr;r$r>doc_typecaller_supplied_api_basedynamic_api_keydynamic_api_basesuppress_dynamic_api_baseocr_provider_configr"supported_paramsrequested_format parsed_formaterHparamr!r#s r2_prepare_ocr_requestrdFs8"&&7DY9Z![!#*fjj9JD.QRO h %WX\]eXfWghii||F#H68B<<'4428*?R>STUU=uFYZ0??GN1JJQVJW$jj)AB# #;O, -  &1@O- . r1c|j |jS|jdk(r%t|jr|dS|dSy)Nr7$AZURE_DOCUMENT_INTELLIGENCE_ENDPOINTAZURE_AI_API_BASE)rrrr)rerhs r2_rust_bridge_api_baserusT  ,(((++z9 /0@0F0F G!"HI I122 r1resolve_api_keyc f|j}|j}|jxs |||nd}|j|jxsi|j ||j |j}|j|j |j |j|j}t||}t||}|jjd||j |jd|||dt||t!t"t$t&f||S)N)r5rrrr")rrr!r"zOCR document processing)rr)complete_input_dictrr5)inputradditional_args)rrr5r!)r get_api_key_env_varrvalidate_environmentrrrr"get_complete_urlr!rurqr$pre_callrr4r r*r(r+) rervr api_key_env_varresolved_api_keyresolved_headersresolved_complete_url rust_api_baserust_optional_paramss r2_prepare_rust_ocr_callrsZ.==O,@@BO.66,;,G(T.BB ..4"$$ !**'66 C$3#C#C!**$$(88'66 $D$ 11A?SM">?OQ`"a((11' *//,55$'$ .' 2   T#v+&(89,  r1c Ptjyt||}tj|j|j |j |j|j|j|j|j}|ytj|SNrerv)rrrrrrr!r:)rust_ocr_bridge load_rust_ocrrrrrrrrr5r!r#rrSrervprepared rust_responses r2 _run_rust_ocrrs$$&.,)'H+..$$!**  "",@@&& 00 22 M  % %m 44r1c lKtjyt||}tj|j|j |j |j|j|j|j|jd{}|ytj|S7wr)rload_rust_aocrraocrrrrrrr5r!r#rrSrs r2_run_rust_aocrr2s%%'/,)'H"1!5!5$$!**  "",@@&& 00 22 " M  % %m 44 sBB4B2B4c&K||||||||d} t||||||||} | j}| j}|j||dt | rIt j r5ddlm} t| | d{} | tjdn| Stj| j| j| j| j | j"| j$| j&| jd| j(| j*| j, } t/j0| r | d{} | t3d | | S77#t4$r} t7j8||| || d} ~ wwxYww) ar Async OCR function. Args: model: Model name (e.g., "mistral/mistral-ocr-latest") document: Document to process in Mistral format: {"type": "document_url", "document_url": "https://..."} for PDFs/docs, {"type": "image_url", "image_url": "https://..."} for images, or {"type": "file", "file": } for local files api_key: Optional API key api_base: Optional API base URL timeout: Optional timeout custom_llm_provider: Optional custom LLM provider extra_headers: Optional extra headers **kwargs: Additional parameters (e.g., include_image_base64, pages, image_limit) Returns: OCRResponse in Mistral OCR format with pages, model, usage_info, etc. Example: ```python import litellm # OCR with PDF response = await litellm.aocr( model="mistral/mistral-ocr-latest", document={ "type": "document_url", "document_url": "https://arxiv.org/pdf/2201.04234" }, include_image_base64=True ) # OCR with image response = await litellm.aocr( model="mistral/mistral-ocr-latest", document={ "type": "image_url", "image_url": "https://example.com/image.png" } ) # OCR with base64 encoded PDF response = await litellm.aocr( model="mistral/mistral-ocr-latest", document={ "type": "document_url", "document_url": f"data:application/pdf;base64,{base64_pdf}" } ) # OCR with local file response = await litellm.aocr( model="mistral/mistral-ocr-latest", document={"type": "file", "file": "/path/to/document.pdf"} ) ``` rrrrr:rrr;rrrget_secret_strrNz>Async Rust OCR bridge unavailable; falling back to Python pathT rrr!r: logging_objrrrrr5r r"z2Got an unexpected None response from the OCR API: rroriginal_exceptioncompletion_kwargs extra_kwargs)rdrrupdatergrrust_ocr_enabledlitellm.secret_managers.mainrrr rRbase_llm_http_handlerrrr!r#r$rrrr r"asyncio iscoroutinerL ExceptionrNexception_type)rrrrr:rrr;rrrrresponserbs r2rrKsL2& 38 . 3'  &::  5I\!]^ x (_-M-M-O C)7!) .*$M$$$%ef$$(,,..&&$44.. 44$$&& ( < <**$44#22-     x (%~H  QRZQ[\] ]=$2&  $$ 3 /    sZ FA4E&E"E&!F"B)E& E$ E&!F"E&$E&& F/F  FFz^[\w.+-]+/[\w.+-]+$ _MIME_PATTERNzapplication/pdfz image/pngz image/jpegz image/gifz image/webpz image/tiffz image/bmp) z.pdfz.pngz.jpgz.jpegz.gifz.webpz.tiffz.tifz.bmp_MIME_TYPE_MAP file_pathctjj|dj}tj |}|r|St j|\}}|xsdS)z Determine MIME type from file path extension. Falls back to mimetypes.guess_type, then to 'application/octet-stream'. application/octet-stream)ospathsplitextlowerrrJ mimetypes guess_type)rextmimeguessed_s r2 get_mime_typers^ !!),Q/557C $$S)D  %%i0JGQ  000r1c|jd}| tdd}d}t|tr tdt|tj rt|}tj j|std|t|}tj j|}t|d5}|j}dddnt|tr|}nt|ts t|drXt|d rt!|d d}|r t|}|j}t|tr*|j#d }ntd t%|d s td d|vr|d}t&j)|std|t+j,|j/d }d|d|}|j1dr&t3j4d|t7||d|dSt3j4d|t7||d|dS#1swYxYw)u Convert a file-type document dict to a document_url-type document dict with an inline base64 data URI. Accepts document dicts like: {"type": "file", "file": Path("/path/to/doc.pdf")} # pathlib.Path {"type": "file", "file": } # file-like object (BinaryIO) {"type": "file", "file": b"raw bytes"} # raw bytes Bare ``str`` paths are not accepted — pass a ``pathlib.Path`` or ``open(path, "rb")`` instead. See the str check below for the rationale. Returns: {"type": "document_url", "document_url": "data:;base64,"} or {"type": "image_url", "image_url": "data:;base64,"} r@Nzkdocument with type='file' must include a 'file' field containing a pathlib.Path, file-like object, or bytesrzOCR file input does not accept bare str values. Pass bytes, a pathlib.Path, or a file-like object. To OCR a local file from a path, call open(path, 'rb') yourself.zFile not found: rbreadnamezutf-8zUnsupported file input type: z6. Expected pathlib.Path, bytes, or a file-like object.z"File is empty or could not be read mime_typezInvalid MIME type: zdata:z;base64,zimage/zVOCR file input: Converted file to image_url data URI (mime=%s, size=%s bytes, name=%s)rB)r?rBzYOCR file input: Converted file to document_url data URI (mime=%s, size=%s bytes, name=%s)rA)r?rA)rJrLrKr(rPathLikerisfileFileNotFoundErrorrbasenameopenrbytesrhasattrgetattrencoder?rmatchbase64 b64encodedecode startswithr rRlen) r file_inputr file_namerf file_bytes base64_datadata_uris r2rMrMsD"! V,J 9  0I I*c" ;  *bkk*z? ww~~i(#&6yk$BC C!), GG$$Y/ )T " "aJ " " J & J '7:v+F :v & FD9I))4 __& j# &#**73J+D,<+==s t   =>>h[)   y ).yk:;;))*5<HH% d   O   $(;;c J  #H ==Y " "s II c ||||||||d} |jdddu} | |d<t||||||||} | j}| j}|j ||dt | rAt jr-ddlm } t| | } | tjd n| Stj| j| j| j | j"| j$| j&| j(| j| | j*| j,| j. } | S#t0$r}t3j4||||| d }~wwxYw)a Synchronous OCR function. Args: model: Model name (e.g., "mistral/mistral-ocr-latest") document: Document to process in Mistral format: {"type": "document_url", "document_url": "https://..."} for PDFs/docs, {"type": "image_url", "image_url": "https://..."} for images, or {"type": "file", "file": } for local files api_key: Optional API key api_base: Optional API base URL timeout: Optional timeout custom_llm_provider: Optional custom LLM provider extra_headers: Optional extra headers **kwargs: Additional parameters (e.g., include_image_base64, pages, image_limit) Returns: OCRResponse in Mistral OCR format with pages, model, usage_info, etc. Example: ```python import litellm # OCR with PDF response = litellm.ocr( model="mistral/mistral-ocr-latest", document={ "type": "document_url", "document_url": "https://arxiv.org/pdf/2201.04234" }, include_image_base64=True ) # OCR with image response = litellm.ocr( model="mistral/mistral-ocr-latest", document={ "type": "image_url", "image_url": "https://example.com/image.png" } ) # OCR with base64 encoded PDF response = litellm.ocr( model="mistral/mistral-ocr-latest", document={ "type": "document_url", "document_url": f"data:application/pdf;base64,{base64_pdf}" } ) # OCR with local file response = litellm.ocr( model="mistral/mistral-ocr-latest", document={"type": "file", "file": "/path/to/document.pdf"} ) # Access pages for page in response.pages: print(f"Page {page.index}: {page.markdown}") ``` rrFT)rrrrr;rrr:rrrrNz8Rust OCR bridge unavailable; falling back to Python pathrr)rIrdrrrrgrrrrrr rRrrrr!r#r$rrrr r"rrNr)rrrrr:rrr;r _is_asyncrrrrrbs r2rrUsT2& 34 !::fe4< $-&!. 3'  &::  5I\!]^ x (_-M-M-O C#0!) .$M$$$%_`$$/33..&&$44.. 44$$&& ( < <**$44#224    $$ 3 /    sB#E1BE E* E%%E*)NNNNN)D__doc__rrrrrecollections.abcrrr dataclassesriortypingrr r r-rNlitellm._loggingr litellm.constantsr *litellm.litellm_core_utils.litellm_loggingr r/&litellm.llms.azure_ai.ocr.common_utilsr(litellm.llms.base_llm.ocr.transformationrrrr*litellm.llms.custom_httpx.llm_http_handlerrlitellm.rust_bridgerrlitellm.types.routerr litellm.utilsrrrrr4r9r)r(r+r,r.r*rdboolrgrqrurrrrcompilerrrrMr0r1r2rs^  88!## +-S J657+,  + +  + '' 'Uv vc6k"v4ZvDj v U]] "T ) v t vV $t+v f vvrG*=G$G )cUC$J./ #v+4 ) cUC$J./  4Z *)*seS4Z/0**Z5)5seS4Z/054525)5seS4Z/05452,0&*.2F F c6k"F 4ZF Dj F U]] "T ) F t F V $t+F F F F Z"rzz"89 u9            1S 1S 1\>DcN\>tCQTH~\>~,0&*.2F F c6k"F 4ZF Dj F U]] "T ) F t F V $t+F F 9VV[899F F r1