uPj:(vddlmZmZddlmZddlmZddlmZm Z ddl m Z m Z ddl ddlmZGdd Zy ) )AnyFinal)unquote)uuid) VertexAIError+_convert_vertex_datetime_to_openai_datetime)BatchJobStatusCreateBatchRequest)*) LiteLLMBatchcheZdZdZededefdZedede fdZ ede e e fde e e ffdZedede fdZedede fd Zedede fd Zededefd Zed e de fd Zede de fdZede de dzfdZed e dzdefdZede de fdZy)VertexAIBatchTransformationz Transforms OpenAI Batch requests to Vertex AI Batch requests API Ref: https://cloud.google.com/vertex-ai/generative-ai/docs/multimodal/batch-prediction-gemini requestreturnc(dtj}|jd}| tdt t |gd}|j |}tdt|j|}t|||| S) zN Transforms OpenAI Batch requests to Vertex AI Batch requests zlitellm-vertex-batch- input_file_idz+input_file_id is required, but not provided)urisjsonl) gcsSourceinstancesFormat)outputUriPrefix)predictionsFormatgcsDestination) inputConfig outputConfigmodel displayName) ruuid4get ValueError InputConfig GcsSource_get_model_from_gcs_file OutputConfigGcsDestination_get_gcs_uri_prefix_from_fileVertexAIBatchPredictionJob)clsrrequest_display_namer input_configr output_configs r/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/batches/transformation.py9transform_openai_batch_request_to_vertex_ai_batch_requestzUVertexAIBatchTransformation.transform_openai_batch_request_to_vertex_ai_batch_requests)>djjl^&L&{{?;  JK K$/)-:Ykr$s 88G-9%)#:[:[\i:jk. *$&,   responsec t|j|dt|jddd|j |d|j |d|j | S)N24h createTime)vertex_datetimebatch) idcompletion_window created_atendpointrobjectstatus error_file_idoutput_file_id)r +_get_batch_id_from_vertex_ai_batch_responserr0_get_input_file_id_from_vertex_ai_batch_response3_get_batch_job_status_from_vertex_ai_batch_response1_get_output_file_id_from_vertex_ai_batch_response)r(r/s r,;transform_vertex_ai_batch_response_to_openai_batch_responsezWVertexAIBatchTransformation.transform_vertex_ai_batch_response_to_openai_batch_response.sn>>xH#BS[S_S_`lnpSqrNNxXJJ8TPPQYZ  r.c6|jdgxsg}|Dcgc]}|j|}}t|dkDr|djnd}t|dkDr|djnd}|jd}d|||t ||dScc}w)z` Transforms Vertex AI batch list response into OpenAI-compatible list response. batchPredictionJobsrN nextPageTokenlist)r:datafirst_idlast_idhas_morenext_page_token)rrBlenr6bool)r(r/ batch_jobsjobrHrIrJrLs r,?transform_vertex_ai_batch_list_response_to_openai_list_responsez[VertexAIBatchTransformation.transform_vertex_ai_batch_list_response_to_openai_list_response>s%LL)>CIr gqr`csVVWZ[rr(+D A $q'**4(+D A b4!)o!> _-.   ssBc`|jdd}|sy|jd}|r|dS|S)z Gets the batch id from the Vertex AI Batch response safely vertex response: `projects/510528649030/locations/us-central1/batchPredictionJobs/3814889423749775360` returns: `3814889423749775360` namer3/rE)rsplit)r(r/_namepartss r,r>zGVertexAIBatchTransformation._get_batch_id_from_vertex_ai_batch_responseVs; ||FB/{{3'!uRy,u,r.cd}|jd}||S|jd}||S|jdd}t|dk(r|S|dS)zJ Gets the input file id from the Vertex AI Batch response r3rrrr)rrM)r(r/rr* gcs_sourcers r,r?zLVertexAIBatchTransformation._get_input_file_id_from_vertex_ai_batch_responsefsi %' &ll=9   (,,[9    nnVR0 t9> Awr.cd|jdxs t}|jdd}|r|jddz}|r|dk7r|S|jd}||S|jd}||S|jdd}|jdr|S|jddzS) zK Gets the output file id from the Vertex AI Batch response outputInfogcsOutputDirectoryr3rTz/predictions.jsonlrrr)r OutputInforstripendswith)r(r/ output_infor=r+gcs_destinationoutput_uri_prefixs r,rAzMVertexAIBatchTransformation._get_output_file_id_from_vertex_ai_batch_responsezs &\\,7G:< )oo.BBG +2237:NNN n0DD! !'||N;  ! !!.!2!23C!D  "! !#2#6#67H"#M  % %&: ;$ $ '',/CCCr.c Nddddddddddddd }|jd d }||S) z Gets the batch job status from the Vertex AI Batch response ref: https://cloud.google.com/vertex-ai/docs/reference/rest/v1/JobState failed validating in_progress completed cancelling cancelledexpired) JOB_STATE_UNSPECIFIEDJOB_STATE_QUEUEDJOB_STATE_PENDINGJOB_STATE_RUNNINGJOB_STATE_SUCCEEDEDJOB_STATE_FAILEDJOB_STATE_CANCELLINGJOB_STATE_CANCELLEDJOB_STATE_PAUSEDJOB_STATE_EXPIREDJOB_STATE_UPDATINGJOB_STATE_PARTIALLY_SUCCEEDEDstaterk)r)r(r/ state_mapping vertex_states r,r@zOVertexAIBatchTransformation._get_batch_job_status_from_vertex_ai_batch_responsesM&. ,!-!.#. ($0#. -!*"/-8 ; 'll74KL \**r.rc0|jdd}|dS)aK Gets the gcs uri prefix from the input file id Example: input_file_id: "gs://litellm-testing-bucket/vtx_batch.jsonl" returns: "gs://litellm-testing-bucket" input_file_id: "gs://litellm-testing-bucket/batches/vtx_batch.jsonl" returns: "gs://litellm-testing-bucket/batches" rTr)rsplit)r(r path_partss r,r&z9VertexAIBatchTransformation._get_gcs_uri_prefix_from_files *00a8 !}r. gcs_file_uricN|j|}|tdd|d|S)aW Extracts the model from the gcs file uri When files are uploaded using LiteLLM (/v1/files), the model is stored in the gcs file uri Why? - Because Vertex Requires the `model` param in create batch jobs request, but OpenAI does not require this gcs_file_uri format: gs://litellm-testing-bucket/litellm-vertex-files/publishers/google/models/gemini-1.5-flash-001/e9412502-2c91-42a6-8e61-f5c294cc0fc8 returns: "publishers/google/models/gemini-1.5-flash-001" Raises a 400 `VertexAIError` when the uri carries no parseable model path. izPVertex AI batch creation requires the model to be part of `input_file_id`, but 'a6' contains no 'publishers//models/' path segment. Either upload the input file through LiteLLM (POST /v1/files with custom_llm_provider=vertex_ai), which encodes the model into the returned file id, or pass a uri of the form gs:////publishers//models//) status_codemessage)_parse_model_from_gcs_filer)r(r~rs r,r#z4VertexAIBatchTransformation._get_model_from_gcs_filesF 55lC =$~&ZZ   r.Nct|jd\}}}|sy|jd}t|dks |ddk7s|dsyddj |ddS)z Returns the `publishers//models/` path from a gcs uri, or None if the uri does not contain one. z publishers/NrTr{models)r partitionrUrMjoin)r(r~_ separator model_pathrWs r,rz6VertexAIBatchTransformation._parse_model_from_gcs_filesr $+<#8#B#B=#Q 9j!'', u:>U1X1qSXXeBQi0122r.cZ|duxr&|jdxr|j|duS)z Returns True if `input_file_id` is a raw gs:// Vertex batch input file (i.e. not a LiteLLM-managed unified file id) with a `publishers/` model path that `_get_model_from_gcs_file` can parse. Nzgs://) startswithr)r(rs r,$is_unmanaged_gcs_batch_input_file_idz@VertexAIBatchTransformation.is_unmanaged_gcs_batch_input_file_ids>  % J((1 J..}=TI r.cJ|j|jdddS)za Extracts the bare model name (e.g. "gemini-1.5-flash-001") from a gcs file uri. rTr{rE)r#r|)r(r~s r,!get_bare_model_name_from_gcs_filez=VertexAIBatchTransformation.get_bare_model_name_from_gcs_files' ++L9@@aHLLr.)__name__ __module__ __qualname____doc__ classmethodr r'r-VertexBatchPredictionResponser rBdictstrrrQr>r?rAr r@r&r#rrNrrr.r,rrs  #  $  0  4       CH~ c3h  . -C` -eh - -Hejm&DIfDknDD2+4+ ++4 # #  CC< 3c 3cDj 3 3  t  PT    MSMSMMr.rN)typingrr urllib.parser litellm._uuidr#litellm.llms.vertex_ai.common_utilsrrlitellm.types.llms.openair r litellm.types.llms.vertex_ailitellm.types.utilsr rrr.r,rs- I*,rMrMr.