Ë uPêjÝ&ãó<—UddlmZmZddlZddlmZddlmZmZmZddl m Z m Z  gd¢Z ee d<ded ed ed ezd ed fd„Z dded ede dedzdedzdedzdedzd eeeffd„Zde de d eeeffd„Z dded ede dedzdedzd eeeff d„Zy)é)ÚFinalÚLiteralN)Úverbose_logger)Ú_is_above_128kÚgeneric_cost_per_tokenÚ#get_vertex_regional_endpoint_uplift)Ú ModelInfoÚUsage)zgemini-1.0-proz gemini-proúgemini-2Úmodels_without_dynamic_pricingÚmodelÚcustom_llm_providerÚ call_type)Ú embeddingÚ aembeddingÚreturn)Úcost_per_characterÚcost_per_tokencóp—|dk(rd|vs,d|vs(d|vs$d|vs d|vsd|vs|dk(r |dk(s|d k(s |dk(rd |vry y ) z¦ Route the cost calc to the right place, based on model/call_type/etc. Returns - str, the specific google cost calc function it should route to. Ú vertex_aiÚclaudeÚllamaÚmistralÚjambaÚ codestralÚgemmarrr rr©)r rrs úk/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/cost_calculator.pyÚ cost_routerrsi€ð ˜{Ò*à ˜Ñ Ø˜%ÑؘEÑ!ؘ%ÑؘeÑ#ؘ%Ñà  +Ò -Ø ˜+Ò %¨°lÒ)BØ  +Ò -Ø ˜5Ñ àØ óÚusageÚprompt_charactersÚcompletion_charactersÚ service_tierÚvertex_locationcó—tj||¬«}|€t||||¬«\}} nU t|dz¬«r'|tvrd|vr|d€ Jd|›d|›«‚||dz}nd |vr|d € Jd|›d |›«‚||d z}|€t||||¬«\} } na|j} t|dz¬«r'|tvrd |vr|d € Jd|›d |›«‚| |d z} nd|vr|d€ Jd|›d|›«‚||dz} t||«} || z| | zfS#t $r2} t jd | «t||||¬«\}} Yd} ~ ŒÂd} ~ wwxYw#t $r2} t jd | «t||||¬«\} } Yd} ~ ŒŠd} ~ wwxYw)aK Calculates the cost per character for a given VertexAI model, input messages, and response object. Input: - model: str, the model name without provider prefix - custom_llm_provider: str, "vertex_ai-*" - prompt_characters: float, the number of input characters - completion_characters: float, the number of output characters - service_tier: optional tier derived from Gemini trafficType ("priority" for ON_DEMAND_PRIORITY, "flex" for FLEX/batch). - vertex_location: the Vertex AI location serving the request; non-global locations apply the model's regional-endpoint uplift multiplier Returns: Tuple[float, float] - prompt_cost_in_usd, completion_cost_in_usd Raises: Exception if model requires >128k pricing, but model cost not mapped ©r rN)r rr!r$é©ÚtokensÚ*input_cost_per_character_above_128k_tokenszmodel info for model=za does not have 'input_cost_per_character_above_128k_tokens'-pricing for > 128k tokens model_info=Úinput_cost_per_characterz= does not have 'input_cost_per_character'-pricing model_info=zslitellm.litellm_core_utils.llm_cost_calc.google.py::cost_per_character(): Exception occured - %s Defaulting to NoneÚ+output_cost_per_character_above_128k_tokenszP does not have 'output_cost_per_character_above_128k_tokens' pricing model_info=Úoutput_cost_per_characterz> does not have 'output_cost_per_character'-pricing model_info=) ÚlitellmÚget_model_inforrr Ú ExceptionrÚdebugÚcompletion_tokensr)r rr!r"r#r$r%Ú model_infoÚ prompt_costÚ_ÚeÚcompletion_costr3Ú vertex_uplifts rrr=s›€ô:×'Ñ'¨eÐI\Ô]€JðÐ Ü'ØØ 3ØØ%ô  ‰ˆ ‘Qð äÐ&7¸!Ñ&;Õ<ØÔ!?Ñ?ðAÀJÑNØ"Ð#OÑPÐ\ðð,¨E¨7ð3UðV`ðUaðbó ð]ð 0°*Ð=iÑ2jÑj‘ ð/°*Ñ<ÀÐLfÑAgÐAsðð,¨E¨7Ð2pÐq{Ðp|Ð}óØsð0°*Ð=WÑ2XÑX ðÐ$Ü+ØØ 3ØØ%ô  ш‰?ð$)×#:Ñ#:Ðð äÐ&;¸aÑ&?Õ@ØÔ!?Ñ?ðBÀZÑOØ"Ð#PÑQÐ]ðð,¨E¨7ð3DðEOðDPðQó ð^ð #4°jÐAnÑ6oÑ"o‘ð0°:Ñ=À*ÐMhÑBiÐBuðð,¨E¨7Ð2qÐr|Ðq}Ð~óØuð#8¸*ÐE`Ñ:aÑ"aô?¸zÈ?Ó[€MØ ˜Ñ &¨¸-Ñ(GÐ GÐGøômò Ü × Ñ ðGØô ô,ØØ$7ØØ)ô ‰NˆKûð ûôRò Ü × Ñ ðGØô ô"0ØØ$7ØØ)ô "Ñ ˆAûð ús1®ADÂ$AE Ä E Ä(EÅE Å FÅ(FÆFr4có&—|jd«}|jd«}|j}|j}t|¬«r|||z}n ||dxsdz}|jd«}t|¬«r | ||z}||fS||dxsdz}||fS)NÚ&input_cost_per_token_above_128k_tokensÚ'output_cost_per_token_above_128k_tokensr)Úinput_cost_per_tokengÚoutput_cost_per_token)ÚgetÚ prompt_tokensr3r)r4r!r;r<r@r3r5r8s rÚ_handle_128k_pricingrA²sÅ€ð 5?·N±NÐCkÓ4lÐ*Ø.8¯n©nÐ=fÓ.gÐ+à ×.Ñ.€MØ$×6Ñ6Ðä˜]Õ+Ð0VÐ0bØ#Ð&LÑL‰ à# zÐ2HÑ'IÒ'PÈSÑQˆ ð/9¯n©nÐ=fÓ.gÐ+ÜÐ.Õ/Ð4[Ð4gØ+Ð.UÑUˆð ˜Ð 'Ð'ð,¨zÐ:QÑ/RÒ/YÐVYÑZˆà ˜Ð 'Ð'r cóè—tj||¬«}|jd«}|jd«}|€|&t||¬«\}} t ||«} || z| | zfSt |||||¬«S)aB Calculates the cost per token for a given model, prompt tokens, and completion tokens. Input: - model: str, the model name without provider prefix - custom_llm_provider: str, either "vertex_ai-*" or "gemini" - prompt_tokens: float, the number of input tokens - completion_tokens: float, the number of output tokens - service_tier: optional tier derived from Gemini trafficType ("priority" for ON_DEMAND_PRIORITY, "flex" for FLEX/batch). - vertex_location: the Vertex AI location serving the request; non-global locations apply the model's regional-endpoint uplift multiplier Returns: Tuple[float, float] - prompt_cost_in_usd, completion_cost_in_usd Raises: Exception if model requires >128k pricing, but model cost not mapped r'r;r<)r4r!)r rr!r$r%)r/r0r?rArr) r rr!r$r%r4r;r<Úprompt_cost_128kÚcompletion_cost_128kr9s rrrÌs€ô8 ×.Ñ.°UÐPcÔd€Jð5?·N±NÐCkÓ4lÐ*Ø5?·^±^ÐDmÓ5nÐ+Ø-Ð9Ð=dÐ=pÜ1EØ!Øô2 Ñ.ÐÐ.ô CÀ:ÈÓ_ˆ Ø -Ñ/Ð1EÈ Ñ1UÐUÐUä !ØØ/ØØ!Ø'ô  ðr )NNNN)NN)Útypingrrr/rÚ.litellm.litellm_core_utils.llm_cost_calc.utilsrrrÚlitellm.types.utilsr r r Ú__annotations__ÚstrrÚfloatÚtuplerrArrr rúrLs~ð÷"Ð!ãÝ"÷ñ÷ 1ððò )UРÓTð Ø ð àð ðÐ0Ñ1°CÑ7ð ð Ð 3Ñ4ó  ðD'+Ø*.Ø#Ø"&ñrHØ ðrHàðrHð ðrHð˜t‘|ð rHð ! 4™<ð rH𠘑*ð rHð˜4‘ZðrHð ˆ5%ˆ<ÑórHðj(Øð(à ð(ð ˆ5%ˆ<Ñó(ð< $Ø"&ñ /Ø ð/àð/ð ð/ð˜‘*ð /ð ˜4‘Zð /ð  ˆ5%ˆ<Ñô /r