uPjPdZddlmZddlmZmZddlmZmZm Z m Z GddZ y) a Vertex AI BGE (BAAI General Embedding) Configuration BGE models deployed on Vertex AI require different input/output format: - Request: Use "prompt" instead of "content" as the input field - Response: Embeddings are returned directly as arrays, not wrapped in objects Model name handling: - Model names like "bge/endpoint_id" are automatically transformed in common_utils._get_vertex_url() - This module focuses on request/response transformation only )Final)EmbeddingResponseUsage)EmbeddingParametersTaskTypeTextEmbeddingBGEInputVertexEmbeddingRequestc eZdZdZededefdZedeezde dede fdZ e dd ed e dzd edzde fd Zed e dededefdZy)VertexBGEConfiga" Configuration and transformation logic for BGE models on Vertex AI. BGE (BAAI General Embedding) models use a different request format where the input field is named "prompt" instead of "content". Supported model patterns (after provider split in main.py): - "bge-small-en-v1.5" (model name) - "bge/204379420394258432" (endpoint ID pattern) Note: Model name transformation (bge/ -> numeric ID) is handled automatically in common_utils._get_vertex_url(). This class focuses on request/response format only. modelreturncP|j}|jdxsd|vS)ap Check if the model is a BGE (BAAI General Embedding) model. After provider split in main.py, supports: - "bge-small-en-v1.5" (model name) - "bge/204379420394258432" (endpoint ID pattern) Args: model: The model name after provider split Returns: bool: True if the model is a BGE model zbge/bge)lower startswith)r model_lowers q/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/vertex_embeddings/bge.py is_bge_modelzVertexBGEConfig.is_bge_model(s*#[[] %%f-E+1EEinputoptional_paramsct}g}|jd}|jd}t|tr|g}|D]+}tj |||}|j |-||d<tdi||d<|S)a Transforms an OpenAI request to a Vertex BGE embedding request. BGE models use "prompt" instead of "content" as the input field. Args: input: The input text(s) to embed optional_params: Optional parameters for the request model: The model name Returns: VertexEmbeddingRequest: The transformed request task_typetitle)promptrr instances parameters)r get isinstancestrr _create_embedding_inputappendr) rrr vertex_request vertex_text_embedding_input_listrrtextembedding_inputs rtransform_requestz!VertexBGEConfig.transform_request;s9O8POQ(,;,?,? ,L &**73 eS !GE ED-EET]fnsEtO , 3 3O D E'G{#':'M_'M|$rNrrrc:t|}|||d<|||d<|S)a Creates a TextEmbeddingBGEInput object for BGE models. BGE models use "prompt" instead of "content" as the input field. Args: prompt: The prompt to be embedded task_type: The type of task to be performed title: The title of the document to be embedded Returns: TextEmbeddingBGEInput: A TextEmbeddingBGEInput object )rrr)r )rrrtext_embedding_inputs rr#z'VertexBGEConfig._create_embedding_input[s7&'<6&J  09  -  ,1  )##rresponsemodel_responsec d|vr td|d}t|tstdt |g}d}t |D]D\}}t|tstd|dt ||j d||dFd |_||_||_ t|d| }t|d ||S) a Transforms a Vertex BGE embedding response to OpenAI format. BGE models return embeddings directly as arrays in predictions: { "predictions": [ [0.002, 0.021, ...], [0.003, 0.022, ...] ] } Args: response: The raw response from Vertex AI model: The model name model_response: The EmbeddingResponse object to populate Returns: EmbeddingResponse: The transformed response in OpenAI format Raises: KeyError: If response doesn't contain 'predictions' ValueError: If predictions is not a list or contains invalid data predictionsz$Response missing 'predictions' fieldz)Expected 'predictions' to be a list, got rzExpected embedding at index z to be a list, got embedding)objectindexr0list) prompt_tokenscompletion_tokens total_tokensusage) KeyErrorr!r3 ValueErrortype enumerater$r1datar rsetattr) r,r r- _predictionsembedding_response input_tokensidxembedding_valuesr7s rtransform_responsez"VertexBGEConfig.transform_responseus2  (AB B&}5 ,-HlI[H\]^ ^$& %.|%<  !C!.5 #?uDWX\]mXnWo!pqq  % %) !1  !'0$<1[gh/r)NN)__name__ __module__ __qualname____doc__ staticmethodr"boolrr3dictr r)rr r#rrCrrrr r s FCFDFF$d3Si>&* $$d?$Tz$  $$25T5#5GX5]n55rr N) rGtypingrlitellm.types.utilsrrtypesrrr r r rrrrNs( 8RRr