uPjTUddlZddlmZddlmZddlmZmZmZm Z ddl Z ddl Z ddl m Z ddlmZddlmZddlmZmZdd lmZdd lmZdd lmZmZmZdd lmZdd lm Z m!Z!GddeZ"deddfdZ#de$ddfdZ%de$dzde$e&e&fdzfdZ'de$dzde$dzde$e&e&fdzfdZ(Gdde&eZ)e)Dcgc]}|jTdc}Z+ee,d<dUde&de$dzde)fdZ-de&ded de.fd!Z/de&ded de.fd"Z0de&de.fd#Z1dd$lmZed%Z2de&de&fd&Z3d'e&dzde&fd(Z4d'e&dzde&fd)Z5de&d*e&dzd'e&dzd+ed,de6e&e&ff d-Z7d.e2de&d/e.dzd*e&dzd'e&dzd+ed,de6e&e&ffd0Z8d.e2de&d/e.dzde6e&e&ffd1Z9d2e:ede.fd3Z;dVd4Zd6e$de$fd9Z?d:e$e&efde$e&effd;Z@dVd<ZAdVd=e$e&efd>eBde$e&effd?ZCdUd:e$e&efd@eDe&de$e&effdAZEdVdBZFdCZGdDe&fdEZHdFe&deBfdGZIdVdHZJdIe&de&dzfdJZKdIe&de&dzfdKZLdIe&de&dzfdLZMdMe&d*e&d'e&de&fdNZNdOe&dMe&d'e&dzd*e&dzde jf dPZPGdQdReZQGdSdTeZRycc}w)XN)deepcopy)Enum)AnyFinalLiteralget_type_hints)verbose_logger)DEFAULT_MAX_RECURSE_DEPTH) unpack_defs)BaseLLMModelInfoBaseTokenCounter)BaseLLMException)AllMessageValues)"VERTEX_AI_PROVIDER_METADATA_FIELDSPartTypeSchema)TokenCountResponse)supports_response_schemasupports_system_messagescPeZdZ ddededeejzdzffd ZxZ S) VertexAIErrorN status_codemessageheadersc*t||||y)N)rrr)super__init__)selfrrr __class__s h/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/common_utils.pyrzVertexAIError.__init__s k7SN) __name__ __module__ __qualname__intstrdicthttpxHeadersr __classcell__)rs@r rrsA 04 TTT %, TTr!robjreturnct|trTtD] }||vsg||<|jd}t|trtD]}|j |dytD]}t ||st ||gt|dd}t|trtD]}|j |dyy)N_hidden_params) isinstancer(rgetpophasattrsetattrgetattr)r,field hidden_paramss r ,redact_vertex_ai_metadata_from_logged_objectr8"s#t7 E|E   01 mT *; /!!%. /3$ 3  C #$C!148M-&7 +E   eT * +'r!model_call_detailsc|jd}t|tsydD]c}|j|}t|ts%|jd}t|tsGtD]}|j |dey)z success_handler() merges response._hidden_params into litellm_params.metadata['hidden_params'] before redaction runs, so the Vertex metadata must be scrubbed from that copy too. litellm_paramsNmetadatalitellm_metadatar7)r1r0r(rr2)r9r; metadata_keyr=r7r6s r -redact_vertex_ai_metadata_from_litellm_paramsr@6s /223CDN nd +8+ !%%l3(D)  _5 -. 7 +E   eT * ++r!r;c |sydD]t}||vr||}|t|ts d|vr%|d}t|ts;|jDcic]\}}t|ts||}}}|sr|cSycc}}w)a5 Build Vertex/GCP billing labels from LiteLLM user metadata on ``litellm_params``: ``metadata`` (``completion(..., metadata=...)``) or ``litellm_metadata``, using ``requester_metadata`` string key-value pairs (same convention as Gemini). ``metadata`` is tried first when both are present. Nr<requester_metadata)r0r(itemsr')r;keyr=rmkvlabelss r )vertex_request_labels_from_litellm_paramsrIKs /  n $ !#&  :h#=  x /  * +"d# #%88:D41aAs1C!Q$DD M  Es A>-A>optional_paramscd}|Yd|vrU|jd}t|tr4|jDcic]\}}t|ts||}}}|s t |}|r|SdScc}}w)z Resolve labels from optional ``labels`` (Gemini-style) and/or ``litellm_params["metadata"]`` / ``litellm_params["litellm_metadata"]`` (``requester_metadata``). Pops ``labels`` from optional_params when present. NrH)r2r0r(rCr'rI)rJr;rHrawrFrGs r pop_vertex_request_labelsrMgsz%)F"x?'B$((2 c4 '*yy{Itq!jC6HadIFI :>J6%%Js A1A1c0eZdZdZdZdZdZdZdZdZ dZ d Z y ) VertexAIModelRoutez Enum for Vertex AI model routingpartner_modelsgeminigemmabge model_garden non_geminiopenai agent_engineN) r#r$r%__doc__PARTNER_MODELSGEMINIGEMMABGE MODEL_GARDEN NON_GEMINIOPENAI_COMPATIBLE AGENT_ENGINEr!r rOrOzs.*%N F E C!LJ !Lr!rO/VERTEX_AI_MODEL_ROUTESmodelc:ddlm}|r(|jdd|dvrtjSd|vrtj S|j r#|r!|jdrtjS|j|rtjSd|vsd |jvrtjSd |vrtjSd |vs|jd rtjSd|vrtjStjS) a Determine which handler to use for a Vertex AI model based on the model name. Args: model: The model name (e.g., "llama3-405b", "gemini-pro", "gemma/gemma-3-12b-it", "xai/grok-4.1-fast-non-reasoning") litellm_params: Optional litellm parameters dict that may contain base_model for routing Returns: VertexAIModelRoute: The route enum indicating which handler should be used Examples: >>> get_vertex_ai_model_route("llama3-405b") VertexAIModelRoute.PARTNER_MODELS >>> get_vertex_ai_model_route("gemini-pro") VertexAIModelRoute.GEMINI >>> get_vertex_ai_model_route("gemma/gemma-3-12b-it") VertexAIModelRoute.GEMMA >>> get_vertex_ai_model_route("xai/grok-4.1-fast-non-reasoning") VertexAIModelRoute.MODEL_GARDEN >>> get_vertex_ai_model_route("1234567890", {"api_base": "http://10.96.32.8"}) VertexAIModelRoute.GEMINI # Numeric endpoints with api_base use HTTP path rVertexAIPartnerModels base_modelrQz agent_engine/api_baserdzbge/rSzgemma/rVzxai/)4litellm.llms.vertex_ai.vertex_ai_partner_models.mainrgr1rOrZr`isdigitis_vertex_partner_modelrYlowerr\r[ startswithr]r^)rdr;rgs r get_vertex_ai_model_routerps6 .,,\:F ~l3 3%,, ,%!... }}>n.@.@.L!(((4454A!000%5;;=0!%%%5!''' 5E,,V4!...5!(((  ( ((r!custom_llm_provider) vertex_aivertex_ai_betarQc |}|dk(rd}t||}tjj|rd}|S#t$r#}t j d|d}Yd}~|Sd}~wwxYw)NrsrrrdrqTzUnable to identify if system message supported. Defaulting to 'False'. Received error message - %s Add it here - https://github.com/BerriAI/litellm/blob/main/model_prices_and_context_window.jsonF)rlitellmVertexGeminiConfig_is_model_gemini_spec_model Exceptionr warning)rdrq_custom_llm_providersupports_system_messagees r get_supports_system_messager~s(2 "2 2#. ":\p"q  % % A A% H&* # #" ( R  #( ""(s7; A'A""A'c2|}|dk(rd}t||}|S)Nrsrrru)r)rdrqr{_supports_response_schemas r get_supports_response_schemars-/..*'?eau'v $$r!c|j}tjd}t|j |S)a Check if the model supports responseJsonSchema (JSON Schema format). responseJsonSchema is supported by Gemini 2.0+ models and uses standard JSON Schema format with lowercase types (string, object, etc.) instead of the OpenAPI-style responseSchema with uppercase types (STRING, OBJECT, etc.). Benefits of responseJsonSchema: - Supports additionalProperties for stricter schema validation - Uses standard JSON Schema format (no type conversion needed) - Better compatibility with Pydantic's model_json_schema() Args: model: The model name (e.g., "gemini-2.0-flash", "gemini-2.5-pro") Returns: True if the model supports responseJsonSchema, False otherwise z"gemini-(?:[2-9]|[1-9]\d+)(?:\.|\-))rnrecompileboolsearch)rd model_lowergemini_2_plus_patterns r supports_response_json_schemars8&K$&::.S#T %,,[9 ::r!)r)chat embeddingbatch_embeddingimage_generation count_tokenschtD](}|j|s|j|ddcS|S)an Strip routing prefixes from model name for PSC/endpoint URL construction. Patterns like "bge/", "gemma/", "openai/" are used for internal routing but should not appear in the actual endpoint URL. Routing prefixes are derived from VertexAIModelRoute enum values. Args: model: The model name with potential prefix (e.g., "bge/123456", "gemma/gemma-3-12b-it") Returns: str: The model name without routing prefix (e.g., "123456", "gemma-3-12b-it") Examples: >>> get_vertex_base_model_name("bge/378943383978115072") "378943383978115072" >>> get_vertex_base_model_name("gemma/gemma-3-12b-it") "gemma-3-12b-it" >>> get_vertex_base_model_name("xai/grok-4.1-fast-non-reasoning") "grok-4.1-fast-non-reasoning" >>> get_vertex_base_model_name("1234567890") "1234567890" )rcroreplace)rdroutes r get_vertex_base_model_namers;:(/   E "==A. ./ Lr!vertex_locationcp|dk(r|S| tdtjd|s td|S)aR Validate a Vertex AI location before interpolating it into a request host or URL path. ``vertex_location`` is client-controllable on the proxy (it flows in from the request body), so it must never be trusted verbatim in a URL or an attacker could point the host at their own server and exfiltrate the admin's Google access token. Allow the special ``global`` control plane and otherwise require a lowercase alphanumeric-plus-hyphen token (e.g. ``us``, ``us-central1``, ``eu``), which rejects host injection like ``attacker.example/`` or ``evil.com#``. globalzvertex_location is requiredz^[a-z][a-z0-9-]*$zInvalid vertex_location format) ValueErrorrmatch)rs r validate_vertex_locationr9sE("677 88(/ :9:: r!cDt|}|dk(ryd|vrd|dSd|dS)a' Get the base URL for Vertex AI API calls. - ``global`` uses the global control plane host. - Multi-region geographies (e.g. ``us``, ``eu``) use ``aiplatform.{geo}.rep.googleapis.com``. - Regional locations (e.g. ``us-central1``) use ``{region}-aiplatform.googleapis.com``. rz!https://aiplatform.googleapis.com-zhttps://aiplatform.z.rep.googleapis.comzhttps://z-aiplatform.googleapis.com)r)rvalidated_locations r get_vertex_base_urlrOsG!9 IX%2 $$$%7$88KLL ())C DDr!vertex_projectvertex_api_version)v1v1beta1c ,|}t|} tj|d}|jdd}|rdnd}t |}|j r|d|d |d |d |d | } | |fS|d |d |d|d | } | |fS#t$rd}YYwxYw)aM Get URL for embedding models. Handles special patterns: - bge/endpoint_id -> strips to endpoint_id for endpoints/ routing - numeric model -> routes to endpoints/ - regular model -> routes to publishers/google/models/ - models with uses_embed_content flag -> use embedContent endpoint instead of predict rjrrruuses_embed_contentF embedContentpredictrb /projects/ /locations/ /endpoints/: /v1/projects//publishers/google/models/)rrvget_model_infor1ryrrl) rdrrroriginal_model model_inforendpointbase_urlurls r _get_embedding_urlras"N &U 3E##22 + (^^,@%H);n H)/:H }} !./z.9IUdTeepqvpwwxzByCD = -'7{?BSSmnsmttuv~uA = #"#s)B BBmodestreamc (d}d}tjj|}|dk(rTd}t|}|durd}|j r|d|d|d|d |d | }n|d|d|d|d |d | }|dur|d z }n|d k(rt ||||S|dk(rBd}t|}|j r|d|d|d|d |d | }n6|d|d|d |d | }n%|dk(r d}t|}|d|d|d|d |d | }|r|st d|||fS)NrjrgenerateContentTstreamGenerateContentrbrrrrr?alt=sser)rdrrrrrrr countTokensz,Unable to get vertex url/endpoint for mode: )rvrwget_model_for_vertex_ai_urlrrlrr) rrdrrrrrrrs r _get_vertex_urlrs/CH  & & B B B OE v~$&7 T>.H ==?Ja 23:n=M[YhXiituzt{{|~F}GHCJa 23:n=M[YhXijDEJDKKLMULVWC T> : C  !)+1   # #&7 ==?Ja 23:n=M[YhXiituzt{{|~F}GHCJmN+;;FWWqrwqxxy{CzDEC   &7 !./z.9IUdTeeAF@GGHIQHRS hGvNOO =r!cHddlm}d|}|j|rdnd}|dk(r'd}|durd }d |d |d |d }||fSd |d |d |}||fS|dk(rd}d|d |}||fS|dk(rd}d|d |}||fS|dk(rd}d|d |}||fS|dk(r tdtd|)zBuild the Gemini API URL for the given mode. The API key is NOT included in the URL. Callers must pass it via the ``x-goog-api-key`` header instead to avoid leaking credentials in error tracebacks. r)rwzmodels/v1alphav1betarrTrz*https://generativelanguage.googleapis.com/rbrrrrz1https://generativelanguage.googleapis.com/v1beta/rbatchEmbedContentsrrrzLiteLLM's `gemini/` route does not support image generation yet. Let us know if you need this feature by opening an issue at https://github.com/BerriAI/litellm/issueszUnsupported mode: )@litellm.llms.vertex_ai.gemini.vertex_and_google_ai_studio_geminirw_is_gemini_3_or_newerr)rrdrrw_gemini_model_name api_versionrrs r _get_gemini_urlrsd#*% 1&8&N&Nu&U[cK v~$ T>.H>{m1M_L``abjakkstC& =#?{m1M_L``abjaklC" =!  !ABTAUUVW_V`a = " "'ABTAUUVW_V`a =   ABTAUUVW_V`a = # # u  -dV455r!partscJd}|D]}d|vs|jdd}|S)a# check that user_content has 'text' parameter. - Known Vertex Error: Unable to submit request because it must have a text parameter. - 'text' param needs to be present (empty strings are valid) - Relevant Issue: https://github.com/BerriAI/litellm/issues/5515 FtextT)r1)rhas_text_paramparts r _check_text_in_contentrs:N" T>dhhv.:!N" r!cp|tkDrtdtdd|vr0t|dtr|dDcgc] }|dk(rdn| c}|d<|j dd}|(|j D]\}}t ||dz|j d d}|t ||dzyycc}w) zkFix empty strings in enum values by replacing them with None. Gemini doesn't accept empty strings in enums. Max depth of " exceeded while processing schema.enumrN propertiesrdepthrC)r rr0listr1rC_fix_enum_empty_strings)schemarvaluer_rCs r rrs ((=)B(CCefgg Jvf~t {"anyOf": [{"type": "string"}, {"type": "null"}]} Case 2: If additional metadata is present, try to keep it E.g. {"anyOf": [{"type": "string"}, {"type": "null"}], "default": "test", "title": "test"} -> {"anyOf": [{"type": "string", "title": "test"}, {"type": "null", "title": "test"}]} titleN descriptionrc3<K|]}t|tywr")r0r().0rs r z'_filter_anyof_fields..sFqbfzRVX\G]Fqs)r1r0r(rall)rrrany_ofrs r _filter_anyof_fieldsrs??7D1E$=K+t$)A#G, [j&>3FqjpFqCq 6$)DM*5D'  6   r!c|tkDrtdtdt|tr|j d}t|t r+|j dk(rd|vs,|j dik(s|j ddk(r d|vrddi|d<|jD]]\}}t|trt||dz&t|ts7|D]"}t|tst||dz$_yy)NrQ exceeded while processing schema. Please check the schema for excessive nesting.rarrayrCobjectr) r rr0r(r1r'rnrCrr)rrtype_valrDrrs r rrs  ((567H I  &$!**V,8S)NN$/F*fjj.AR.Gzz&!W,v%%x0F7O ,,. 7JC%&eUQY/E4(!7D!$-%dEAI67  7 r!rrcR|tkDrtdtdd|vrjt|dtrWd|vr)|dj Dcgc]\}}| c}}|d<|dj D]\}}t ||dzd|vrt |d|dz|Scc}}w)ay vertex ai and generativeai apis order output of fields alphabetically, unless you specify the order. python dicts retain order, so we just use that. Note that this field only applies to structured outputs, and not tools. Function tools are not afflicted by the same alphabetical ordering issue, (the order of keys returned seems to be arbitrary, up to the model) https://cloud.google.com/vertex-ai/docs/reference/rest/v1/projects.locations.cachedContents#Schema.FIELDS.property_ordering Args: schema: The schema dictionary to process depth: Current recursion depth to prevent infinite loops rrrpropertyOrderingrrC)r rr0r(rCr)rrrFrGs r rrs ((567H I  v*VL-A4"H V +8>|8L8R8R8T)U1!)UF% &<(..0 7DAq (EAI 6 7&$VG_eai@ M *Vs B# valid_fieldsc ^| t}t|}||vr|S|j|t|ts|Si}t |}|j D]\}}||vr |dk(rCt|tr3|j Dcic]\}}|t|||c}}||<S|dk(r |dvr|||<bc|dk(r!t|trt|||||<|dk(r/t|tr|D cgc]} t| ||c} ||<|||<|Scc}}wcc} w)zK Recursively filter a schema dictionary to keep only valid fields. rformat> date-timerrCr) ridaddr0r(rrCrr) rr processed schema_idresultrDrrFrGrs r rrsIE +II MM) k4 (F&{3K!'') U l "  , :eT#:[`[f[f[hiSWSTVW121lINNiF3K H_--#s  G^ 5$ 7.ulINF3K G^ 5$ 7[`aSW/lINaF3KF3K! $ Mjbs D$D*c*|tkDrtdtd |jdd}|d}|D]S}t|tr(|jddk(r|j |d};d|vs@t |dk(sOd |d<Ut |dk(r td |r |D]}d|d < |jd d}|(|jD]\}}t||d z|jdd}|t||d zyy)NrrrFrnullTrrzaInvalid input: AnyOf schema with only null type is not supported. Please provide a non-null type.nullablerrrrC) r rr1r0r(removelenrCr) rrr contains_nullatypernamerrCs r rrsO ((567H I  m::gt,E   )E%&599V+<+F U# $ u$Uq (f  ) u:?s    )$(j! ) <6J%++- CKD% *5 B C::gt,E &uEAI>r!cd|vrd|vr d|vr d|vrd|d<|jdd}|od|vr|d|jdd|s*|jdd|jddd|d<n(d|d<|jD]\}}t||jdd}| t|d D]K}|j|d}|t |t s)|D]}t |t st| My) NrroneOfallOfrrrequiredrC)rrr)r1r2rCrr0rr()rrrrrCrDvaluess r rr/s(Vv 5':OT[ciTi!v <6J  F:$6$> JJz4 ( JJ|T * JJz4 (%F6N%F6N)//1 ' e& '::gt,E *+C&  *VT": +eT*#E* ++r! field_namec|j|d|jdd}|$|jD]\}}t|||jdd}| t||yy)NrrC)r2r1rC strip_field)rrrrrrCs r rrPss JJz4  <6J%++- +KD% z * +::gt,E E:&r!vertex_datetimecdddlm}|j|d}t|jS)z Converts a Vertex AI datetime string to an OpenAI datetime integer vertex_datetime: str = "2024-12-04T21:53:12.120184Z" returns: int = 1722729192 r)datetimez%Y-%m-%dT%H:%M:%S.%fZ)rstrptimer& timestamp)rrdts r +_convert_vertex_datetime_to_openai_datetimer"]s-"!!/3JKB r||~ r!c|tkDrtdtdt|tsyd|vr$|d}t|trt |dkDrhd}g}|D]v}t|t s|dk(r|jddi-|dvr3d|i}|D]}||vst||||<|j|d|jd|ixtd |D}|r|D]}|j|d||d <|jdnrCmaxItemsminItemsrr maxProperties minPropertiesadditionalPropertiesr rrc3FK|]}t|ts|dvyw)r)N)r0r')rts r rz(_convert_schema_types..s",n![efgil[mQ2E-E,ns! !rr)rrCrrrC) r rr0r(rrr'appendranyr2rr) rrrtype_specific_fieldsrr+ item_schemar6has_object_or_arrayrDr prop_schema anyof_schemas r rrls' ((567H I   fd # . h %#h-!*; + 35F /!!S);MM66"23++#)1+K!5I F?19&-1HK.IMM+.MM61+.% /**-,nx,n)n "1,EJJud+,%F7O JJv  $ 'CMQ,>%a[F6N # &%F6N0 C &=3KEl"z%'>#(<<>BK)+uqyAB%eUQY7Jud$;$)CL), BC Cr!rcXtjd|}|r|jdSdS)z Get the vertex project id from the url `https://${LOCATION}-aiplatform.googleapis.com/v1/projects/${PROJECT_ID}/locations/${LOCATION}/publishers/google/models/${MODEL_ID}:streamGenerateContent` z/projects/([^/]+)rNrrgrouprrs r get_vertex_project_id_from_urlr7s* 99137E"5;;q>,,r!cXtjd|}|r|jdSdS)z Get the vertex location from the url `https://${LOCATION}-aiplatform.googleapis.com/v1/projects/${PROJECT_ID}/locations/${LOCATION}/publishers/google/models/${MODEL_ID}:streamGenerateContent` z/locations/([^/]+)rNr4r6s r get_vertex_location_from_urlr9s* 992C8E"5;;q>,,r!cXtjd|}|r|jdSdS)z Get the vertex model id from the url `https://${LOCATION}-aiplatform.googleapis.com/v1/projects/${PROJECT_ID}/locations/${LOCATION}/publishers/google/models/${MODEL_ID}:streamGenerateContent` z/models/([^:]+)rNr4r6s r get_vertex_model_id_from_urlr;s* 99/5E"5;;q>,,r!requested_routecBtjdd|d|d|}|S)zS Replace project and location values in the route with the provided values z /projects/[^/]+/locations/[^/]+/rrrb)rsub)r<rrmodified_routes r %replace_project_and_location_in_router@s4 FF+ ^$K/@BN r!rcrtj|}d|vr#|r|r t|||}|j|S d}d|vrd}|j drd}|j ddd}n&|j d rd}|j d dd}|d |d |}d|z|z}|j|}|S) a< Allow user to specify their own project id / location. If missing, use defaults Handle cachedContent scenario - https://github.com/BerriAI/litellm/issues/5460 Constructed Url: POST https://LOCATION-aiplatform.googleapis.com/{version}/projects/PROJECT_ID/locations/LOCATION/cachedContents locations)pathr cachedContentrz/v1/rbrz /v1beta1/rr)r)URLr@ copy_withror) rr<rr new_base_urlvertex_versionbase_requested_routeupdated_requested_route updated_urls r construct_target_urlrLs" ))H-Lo% oCOUcetuO%%?%;; 04N/)"!!&))11&#qA  # #K 0")11+sAF%3$4J~>NkZiYj"k%(+?%?/%Q%//5L/MK r!ceZdZdedzfdZ ddededeededed edzd edzdefd Z dd edzd edzdeefd Z e dd edzdedzfd Z e dd edzdedzfdZ e dededzfdZy)VertexAIModelInfor-NctS)z Factory method to create a token counter for this provider. Returns: Optional TokenCounterInterface implementation for this provider, or None if token counting is not supported. VertexAITokenCounter)rs r get_token_counterz#VertexAIModelInfo.get_token_counters $%%r!rrdmessagesrJr;api_keyrictdN&Vertex AI models are not supported yetNotImplementedError)rrrdrSrJr;rTris r validate_environmentz&VertexAIModelInfo.validate_environment#s""JKKr!ctd)zF Returns a list of models supported by this provider. rWrX)rrTris r get_modelszVertexAIModelInfo.get_models/""JKKr!ctdrVrX)rTs r get_api_keyzVertexAIModelInfo.get_api_key5s!"JKKr!ctdrVrX)ris r get_api_basezVertexAIModelInfo.get_api_base9r]r!ctd)a2 Returns the base model name from the given model name. Some providers like bedrock - can receive model=`invoke/anthropic.claude-3-opus-20240229-v1:0` or `converse/anthropic.claude-3-opus-20240229-v1:0` This function will return `anthropic.claude-3-opus-20240229-v1:0` rWrXrjs r get_base_modelz VertexAIModelInfo.get_base_model?s""JKKr!)NNr")r#r$r%r rRr(r'rrrZr\ staticmethodr_rarcrar!r rNrNs>d#:&"## L L L'( L  L  Lt L* L  LL#*LsTzLUYZ]U^L LS4ZL3:LL#L*L tLL LcLcDjLLr!rNceZdZdZ ddedzdefdZ ddedeeee fdzdeeee fdzd eee fdzd ed eeee fdzd e dzde dzfd Z y)rQz;Token counter implementation for Google AI Studio provider.Nrqr-c@ddlm}||jjk(S)Nr) LlmProviders)litellm.types.utilsrg VERTEX_AIr)rrqrgs r should_use_token_counting_apiz2VertexAITokenCounter.should_use_token_counting_apiMs 5"l&<&<&B&BBBr! model_to_userScontents deployment request_modeltoolssystemc JKddl}ddlm} |xsi}|j|j di} | j |r| } | j dxs| j d} | j dxs| j d} | j dxs| } | j d xs| j d }| j ||xsg| | | | d{}|0t|j d d|||j d d|Syddlm }ddl m }||n ||xsg}||d}| j||jdi| d{}|'d|vr#t|d|||j d d|Sy770w)Nrrfr;rvertex_ai_projectrvertex_ai_locationvertex_count_tokens_locationvertex_credentialsvertex_ai_credentials)rdrSr;rrru input_tokenstokenizer_usedr) total_tokensrn model_usedtokenizer_typeoriginal_responserP)%_gemini_convert_messages_with_history)rS)rdrl totalTokensra)copyrkrgrr1rmrr+litellm.llms.vertex_ai.count_tokens.handlerrQ,litellm.llms.vertex_ai.gemini.transformationr}update acount_tokens)rrkrSrlrmrnrorprrgcount_tokens_params_requestpartner_models_handlerrrrur rQr}resolved_contentscount_tokens_paramss r rz!VertexAITokenCounter.count_tokensUs   %2 -1]]:>>JZ\^;_-`# ! 8 8 F,A,C "9<<=MNRmRqRq#SN:==>OPToTsTs$UO :==>\]papO(C(G(G$))J,001HI 2>>"!R:- /#5 ?F!)!'NA!>"/+#)::.>#C&, N? Y  ':%^ &-*  ( . ./B C?/1??-F!mv&=)!' !6"/+#)::.>#C&, cHs%C)F#+F,BF#0F!1/F#!F#r")NrNN) r#r$r%rXr'rrjrr(rrrrar!r rQrQJsE+/C 4ZC C-1-1!YYtCH~&-YtCH~&- Y cNT) Y  YDcN#d*Yd Y d "Yr!rQr")r)F)Srrrrrtypingrrrrr)rvlitellm._loggingr litellm.constantsr 8litellm.litellm_core_utils.prompt_templates.common_utilsr litellm.llms.base_llm.base_utilsr r )litellm.llms.base_llm.chat.transformationrlitellm.types.llms.openairlitellm.types.llms.vertex_airrrrhr litellm.utilsrrrr8r(r@r'rIrMrOrrc__annotations__rprr~rrall_gemini_url_modesrrrtuplerrrrrrrrrrrr&rrrrrrr"rr7r9r;r@rErLrNrQ)rs0r rs 66 +7POF6 3LT$T+c+d+(+d+t+*4K #s(^d8&D[&4K& #s(^d&& "d "AS SuEKK=!2 SSE)SE)$+E)QcE)P# #%,-T%U# #, %  %%,-T%U %  %;;;8ij!c!c!HcDjS,E4ZEE$$ $$J$4Z$ 0 $  38_ $N7 7 7 4K7$J 7 4Z 7  0 7 38_7t) ) ) 4K) 38_ )X $x. T 8&.7b0T0$0f4D4d38nc3h278c3hDQTVYQYN6$d38n$CH$aefiknfnao$N'?T+B 'C '   MC`--d --c-cDj--c-cDj- 3 PS fi nq ...4Z.$J .  YY .b/L(/Ldd+dG!Ts:I&