uPj"#ddlZddlZddlZddlZddlmZmZddlmZm Z ddl m Z ddl Z ddl mZddlmZmZddlmZmZmZddlmZdd lmZdd lmZmZdd lmZdd lm Z d dl!m"Z"GddeZ#y)N) CoroutineMapping)AnyFinal)unquote) LlmProviders) GCSBucketBaseGCSLoggingConfig)VERTEX_AI_MANAGED_GCS_PREFIX"should_allow_legacy_cloud_file_idsvalidate_managed_cloud_file_id)Logging)get_async_httpx_client)FileContentRequestHttpxBinaryResponseContent)VERTEX_CREDENTIALS_TYPES)StandardCallbackDynamicParams)VertexAIFilesConfigcveZdZdZfdZdeeefdzdedzde edzedzffdZ dded ede dzde eeffd Z dd e dedzd edzd edzdeej zdedzde dzdefdZ dded e dedzdedzd edzd edzdeej zdedzde dzdeeeeefzfdZxZS)VertexAIFilesHandlerz~ Handles Calling VertexAI in OpenAI Files API format v1/files/* This implementation uploads files on GCS Buckets c`t|ttj|_y)N) llm_provider)super__init__rr VERTEX_AIasync_httpx_client)self __class__s i/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/files/handler.pyrzVertexAIFilesHandler.__init__(s$ "8%//# litellm_paramsNvertex_credentialsreturnc~|xsi}|jdxs|jd}t|tr|ntjd}|jdxs|}t|t rt j|}||fSt|tr|}||fStjd}||fS)aP Resolve the GCS bucket and service-account credentials for the read/content path. Sources them from the deployment's ``litellm_params`` (``gcs_bucket_name`` / ``bucket_name`` and ``vertex_credentials``), mirroring the write path in ``VertexAIFilesConfig._get_configured_bucket_name``, and falls back to the global ``GCS_BUCKET_NAME`` / ``GCS_PATH_SERVICE_ACCOUNT`` env vars. This lets Vertex batch run entirely at the model-group level, so output written to a per-model bucket is readable without setting the global env vars. gcs_bucket_name bucket_nameGCS_BUCKET_NAMEr#GCS_PATH_SERVICE_ACCOUNT)get isinstancestrosgetenvdictjsondumps)rr"r#paramsbucket_candidateconfigured_bucket_name credentialspath_service_accounts r _resolve_read_gcs_configz-VertexAIFilesHandler._resolve_read_gcs_config.s/=.B"(**->"?"\6::mC\5?@PRU5V!1\^\e\efw\x#ZZ(<=SAS k4 (/3zz+/F &';;;  S )#. &';;;$&99-G#H %';;;r!file_idr4c >t|d|tft|S)aE Validate and extract bucket name and object path from file_id. Expected format: gs://bucket-name/litellm-vertex-files/path/to/file Returns: tuple: (bucket_name, object_path) - bucket_name: "bucket-name" - object_path: "litellm-vertex-files/path/to/file" zgs://)r8schemer4allowed_object_prefixesallow_legacy_cloud_file_ids)r r r )rr8r4r"s r '_extract_bucket_and_object_from_file_idz(Z   r!file_content_requestvertex_projectvertex_locationtimeout max_retriesc K|jd}|s td|j||\} } t| | } |j d| id{} |j || d| \} }d| | d di}|j dd |i|d{}t|}|td |tjd |dtt|dtjd|}t}tdgddtjdd}|j!||iS77w)a Download file content from GCS bucket for VertexAI files. Args: file_content_request: Contains file_id (URL-encoded GCS path) vertex_credentials: VertexAI credentials vertex_project: VertexAI project ID vertex_location: VertexAI location timeout: Request timeout max_retries: Max retry attempts Returns: HttpxBinaryResponseContent: Binary content wrapped in compatible response format r8z+file_id is required in file_content_request)r"r#)r&gcs_path_service_account standard_callback_dynamic_params)kwargsNr')r8r4r"r6 object_namez"Failed to download file from GCS: zapplication/octet-stream)z content-typezcontent-lengthGET)methodurl) status_codecontentheadersrequestF afile_content)modelmessagesstream call_type start_timelitellm_call_id function_id) raw_response logging_objr")r* ValueErrorr7rget_gcs_logging_configr=download_gcs_objectrhttpxResponser,lenRequestrrtimetransform_file_content_response)rr>r#r?r@rArBr"r8r4r6dynamic_paramsgcs_logging_configr' object_pathdownload_kwargs file_contentdecoded_file_id mock_responseconfigrZs r rQz"VertexAIFilesHandler.afile_contentcs0.11)<JK K7;7T7T)18U8 4 4!>2%9! =A?U,V1" %=D$<$<$h$hXg$hh !(!1  A/ARST T$~~ :"%c,&7"8MMOD ,-%%yy{ 55&KPR6  ]7 is%AEE?EEB%EE _is_asyncapi_basec |r|j||||||| Stj|j||||||| S)a Download file content from GCS bucket for VertexAI files. Supports both sync and async operations. Args: _is_async: Whether to run asynchronously file_content_request: Contains file_id (URL-encoded GCS path) api_base: API base (unused for GCS operations) vertex_credentials: VertexAI credentials vertex_project: VertexAI project ID vertex_location: VertexAI location timeout: Request timeout max_retries: Max retry attempts Returns: HttpxBinaryResponseContent or Coroutine: Binary content wrapped in compatible response format )r>r#r?r@rArBr")rQasynciorun) rrmr>rnr#r?r@rArBr"s r riz!VertexAIFilesHandler.file_contentso: %%%9#5- /'-& ;;"")='9#1$3# +#1#  r!)N)__name__ __module__ __qualname____doc__rrr,objectrtupler7r/r=rfloatr_TimeoutintrrQboolrrri __classcell__)rs@r rr!s  <V ,t3<5t;< sTz3:% & rsV .  ?IB=/J=Jr!