uPjUdZddlZddlmZmZddlmZddlmZddl m Z ddl m Z m Z eZeed<Gd d e Zy) zC Anthropic Token Counter implementation using the CountTokens API. N)AnyFinal)verbose_logger)AnthropicCountTokensHandler)BaseTokenCounter) LlmProvidersTokenCountResponseanthropic_count_tokens_handlerceZdZdZ ddedzdefdZ ddedeeee fdzdeeee fdzd eee fdzd ed eeee fdzd e dzde dzfd Z y)AnthropicTokenCounterzNToken counter implementation for Anthropic provider using the CountTokens API.Ncustom_llm_providerreturnc<|tjjk(SN)r ANTHROPICvalue)selfr s v/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/anthropic/count_tokens/token_counter.pyshould_use_token_counting_apiz3AnthropicTokenCounter.should_use_token_counting_apis#l&<&<&B&BBB model_to_usemessagescontents deployment request_modeltoolssystemc Kddlm}|sy|xsi}|jdi} | jd} | stjd} | st j dy tj||| ||d{} | t| jd d||d | S y7(#|$r[} t j d | j| jtd||d d | j| jcYd} ~ Sd} ~ wt$r;} t j d| td||d d t| dcYd} ~ Sd} ~ wwxYww)a Count tokens using Anthropic's CountTokens API. Args: model_to_use: The model identifier messages: The messages to count tokens for contents: Alternative content format (not used for Anthropic) deployment: Deployment configuration containing litellm_params request_model: The original request model name Returns: TokenCountResponse with token count, or None if counting fails r)AnthropicErrorNlitellm_paramsapi_keyANTHROPIC_API_KEYz-No Anthropic API key found for token counting)modelrr!rr input_tokens anthropic_api) total_tokensr model_usedtokenizer_typeoriginal_responsez6Anthropic CountTokens API error: status=%s, message=%sT)r&rr'r(error error_message status_codez+Error calling Anthropic CountTokens API: %si)#litellm.llms.anthropic.common_utilsrgetosgetenvrwarningr handle_count_tokens_requestr r,message Exceptionstr) rrrrrrrrrr r!resultes r count_tokensz"AnthropicTokenCounter.count_tokensss. G%2 */? D!$$Y/ii 34G  " "#R S& "@"\"\"! #]#F!)!'NA!>"/+#2&, ">O    " "#[]^]j]jlmlulu v%+'.iiMM    " "#PRS T%+'.!!f  sgA"E%B-B+%B-(E*E+B--E2ADEE E0E EE EEr)NNN) __name__ __module__ __qualname____doc__r5boolrlistdictrr r8rrr r sX+/C 4ZC C-1-1!PPtCH~&-PtCH~&- P cNT) P  PDcN#d*Pd P d "Prr )r=r/typingrrlitellm._loggingr+litellm.llms.anthropic.count_tokens.handlerr litellm.llms.base_llm.base_utilsrlitellm.types.utilsrr r __annotations__r rArrrHs> +S=@)D(EEY,Yr