uPj+UdZddlmZddlmZddlmZmZddlm Z m Z ddl m Z ddl mZddlmZd Zeed <Gd d e Zy )z6 Vertex AI Mistral OCR transformation implementation. )Final)verbose_logger)async_convert_url_to_base64convert_url_to_base64) DocumentTypeOCRRequestData)MistralOCRConfig)get_vertex_base_url) VertexBaseVERTEX_AI_API_KEYVERTEX_AI_OCR_API_KEY_ENV_VARc eZdZdZdfd ZdedzfdZ ddedededzd edzd edzdef d Z dd edzded ed edzdef d Z dedefdZ dedefdZ dede d edede f fd Zdede d edede f fd ZxZS)VertexAIOCRConfiga Vertex AI Mistral OCR transformation configuration. Vertex AI uses Mistral's OCR API format through the Mistral publisher endpoint. Inherits transformation logic from MistralOCRConfig since they use the same format. Reference: Vertex AI Mistral OCR documentation Important: Vertex AI OCR only supports base64 data URIs (data:image/..., data:application/pdf;base64,...). Regular URLs are not supported. returnNc@t|t|_yN)super__init__r vertex_base)self __class__s n/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/ocr/transformation.pyrzVertexAIOCRConfig.__init__!s %<ctSr)r )rs rget_api_key_env_varz%VertexAIOCRConfig.get_api_key_env_var%s,,rheadersmodelapi_keyapi_baselitellm_paramsc | d|dd|S|xsi}tj|}tj|}|jj ||\} } d| dd|}|S)z Validate environment and return headers for Vertex AI OCR. Vertex AI uses Bearer token authentication with access token from credentials. zBearer zapplication/json) Authorizationz Content-Typer ) credentials project_id)r safe_get_vertex_ai_projectsafe_get_vertex_ai_credentialsrget_access_token) rrrrrr kwargsvertex_projectvertex_credentials access_tokenr%s rvalidate_environmentz&VertexAIOCRConfig.validate_environment(s  #*7)!4 2 (-2 * E EUc d$.$M$M]k$l$(#3#3#D#D*%$E$  j '|n5.   roptional_paramsc |xsi}tj|}tj|}| td|d}| t |}|j d}|d|d|d|dS) a$ Get complete URL for Vertex AI OCR endpoint. Vertex AI endpoint format: https://{location}-aiplatform.googleapis.com/v1/projects/{project}/locations/{location}/publishers/mistralai/ocr Args: api_base: Vertex AI API base URL (optional) model: Model name (not used in URL construction) optional_params: Optional parameters litellm_params: LiteLLM parameters containing vertex_project, vertex_location Returns: Complete URL for Vertex AI OCR endpoint r#zcMissing vertex_project - Set VERTEXAI_PROJECT environment variable or pass vertex_project parameterz us-central1/z /v1/projects/z /locations/z/publishers/mistralai/models/z :rawPredict)r r&safe_get_vertex_ai_location ValueErrorr rstrip)rrrr.r r)r*vertex_locations rget_complete_urlz"VertexAIOCRConfig.get_complete_urlRs0(-2 * E EUc d$@@P^_  !u   "+O  *?;H??3'=(8 OCTTqrwqxyDE Erurlctjd|t|}tjdt||S)a' Synchronously convert a URL to a base64 data URI. Vertex AI OCR doesn't have internet access, so we need to fetch URLs and convert them to base64 data URIs. Args: url: The URL to convert Returns: Base64 data URI string z;Vertex AI OCR: Converting URL to base64 data URI (sync): %sr65Vertex AI OCR: Converted URL to data URI (length: %s))rdebugrlenrr6data_uris r_convert_url_to_data_uri_syncz/VertexAIOCRConfig._convert_url_to_data_uri_syncs? Z\_`0C8TVYZbVcdrcKtjd|t|d{}tjdt||S7%w)a( Asynchronously convert a URL to a base64 data URI. Vertex AI OCR doesn't have internet access, so we need to fetch URLs and convert them to base64 data URIs. Args: url: The URL to convert Returns: Base64 data URI string zrtransform_ocr_request rrrAr.rr)doc_typetransformed_documentrEr=rHrs rrPz'VertexAIOCRConfig.transform_ocr_requests+0 PQ(D);DN;KLM M#,,v.&.mmo ~ %"*,,~r"BLL$;$;G$D$$%gh==,=O7?$^4  $'||K$$%de==)=L4<$[1w, )+     rcrKtjd|t|tst dt ||j d}|j}|dk(rZ|j dd}|r|jdstjd|j|d {} | |d<n^|d k(rY|j d d} | rE| jds4tjd |j| d {} | |d <t |,d ||||d |S7|7w)a Transform OCR request for Vertex AI, converting URLs to base64 data URIs (async). Vertex AI OCR doesn't have internet access, so we automatically fetch any URLs and convert them to base64 data URIs asynchronously. Args: model: Model name document: Document dict from user optional_params: Already mapped optional parameters headers: Request headers **kwargs: Additional arguments Returns: OCRRequestData with JSON data z5Vertex AI OCR async_transform_ocr_request - model: %srCrDrErFrGzAVertex AI OCR: Converting document URL to base64 data URI (async)r8NrHz>Vertex AI OCR: Converting image URL to base64 data URI (async)rIrJ) rr:rKrLr2rDrMrNrOr@rrPrQs rasync_transform_ocr_requestz-VertexAIOCRConfig.async_transform_ocr_requestsE0 TV[\(D);DN;KLM M#,,v.&.mmo ~ %"*,,~r"BLL$;$;G$D$$%hi!%!D!D!D!VV7?$^4  $'||K$$%ef!%!D!D!D!SS4<$[1w, )+     WTs%B3D76D37AD7D5D75D7)rN)NNNr)__name__ __module__ __qualname____doc__rstrrrLr-r5r>r@rrrPrU __classcell__)rs@rrrsS (-S4Z-##&* (((t ( * ( t ( (^'+ .E*.E.E .E t .E .E`..7 7 7  7  7  7 r7 7 7  7  7  7 7 rrN)rYtypingrlitellm._loggingr:litellm.litellm_core_utils.prompt_templates.image_handlingrr(litellm.llms.base_llm.ocr.transformationrr'litellm.llms.mistral.ocr.transformationr #litellm.llms.vertex_ai.common_utilsr &litellm.llms.vertex_ai.vertex_llm_baser r __annotations__rrJrrrds@+RDC=':u:L (L r