uPj+UdZddlZddlmZddlmZmZddlmZddl m Z ddl m Z dZ eed <d ed eeeffd Zd ed eefd Zded eefdZded eeeffdZded efdZded eeeffdZGdde Zy)z AWS Bedrock CountTokens API transformation logic. This module handles the transformation of requests from Anthropic Messages API format to AWS Bedrock's CountTokens API format and vice versa. N)Mapping)FinalLiteral) JsonValue) BaseAWSLLM)get_bedrock_base_modeli)DEFAULT_ANTHROPIC_INVOKE_MODEL_MAX_TOKENSvaluereturnc*t|tr|SiSN isinstancedictr s u/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/bedrock/count_tokens/transformation.py _json_dictrud+533c*t|tr|SgSr )rlistrs r _json_listrrrcontentcTt|trd|igSt|tr|SgS)Ntext)rstrr)rs r_to_converse_contentrs.'3!""'4  Irmessagecrt|}|jdt|jdddS)Nroler)r r)rgetr)rfieldss r_to_converse_messager$'s5w'F 6"' 9b(AB rraw_namectjddt|tr|nd}|r|dj r|nd|}|ddS)Nz [^a-zA-Z0-9_]_r!rt_@)resubrrisalpha)r%nameprefixeds r_sanitized_bedrock_tool_namer//sJ&&)3JxQTeZdZdZdeeefdedfdZdeeefde eeffdZ deeefde eeffdZ dede efd Z d ede eefd zfd Zdeeefde eeffd Z ddededed zded zdef dZdeeefde eeffdZdeeefdd fdZy )BedrockCountTokensConfiga Configuration and transformation logic for AWS Bedrock CountTokens API. AWS Bedrock CountTokens API Specification: - Endpoint: POST /model/{modelId}/count-tokens - Input formats: 'invokeModel' or 'converse' - Response: {"inputTokens": } request_datar )converse invokeModelc|jd}t|trO|D]I}t|ts|jd}t|ts6t d|DsIyyy)z Detect whether to use 'converse' or 'invokeModel' input format. Args: request_data: The original request data Returns: 'converse' or 'invokeModel' messagesrc3HK|]}t|txrd|vyw)r7Nr).0blocks r z>BedrockCountTokensConfig._detect_input_type.._s'4vejZt5L5`QW[`Q`5`4vs "r?r>)r"rrrany)selfr=rArrs r_detect_input_typez+BedrockCountTokensConfig._detect_input_typeKso'**:6 h % $ )!'40!++i0gt,4vnu4v1v(  ) rcr|j|}|dk(r|j|S|j|S)a Transform request to Bedrock CountTokens format. Supports both Converse and InvokeModel input types. Input (Anthropic format): { "model": "claude-3-5-sonnet", "messages": [{"role": "user", "content": "Hello!"}] } Output (Bedrock CountTokens format for Converse): { "input": { "converse": { "messages": [...], "system": [...] (if present) } } } Output (Bedrock CountTokens format for InvokeModel): { "input": { "invokeModel": { "body": "" } } } r>)rH_transform_to_converse_format!_transform_to_invoke_model_format)rGr= input_types r+transform_anthropic_to_bedrock_count_tokenszDBedrockCountTokensConfig.transform_anthropic_to_bedrock_count_tokensgs?B!33LA  #55lC C99,G Grc(t|jd}|jd}|jd}|Dcgc] }t|}}d|i}|j|}|r||d<|j |} | r| |d<dd|iiScc}w)z?Transform to Converse input format, including system and tools.rAsystemtools toolConfiginputr>)rr"r$_transform_system_transform_tools) rGr=rArOrPr user_messagesconverse_input system_blocks tool_configs rrJz6BedrockCountTokensConfig._transform_to_converse_formats$\%5%5j%AB$((2#''0_g0gSZ1Eg1N0g 0g7A=6Q $55f= '4N8 $"2259 +6N< (*n5661hsBrOc|gSt|trd|igSt|tr3|Dcgc]'}t|tsd|j ddi)c}SgScc}w)z;Transform Anthropic system prompt to Bedrock system blocks.rr!)rrrrr")rGrOrDs rrSz*BedrockCountTokensConfig._transform_systemse >I fc "V$% % fd #AGc:V[]aKbVUYYvr23c c ds AArPNc\|syt|Dcgc] }t|}}d|iScc}w)z7Transform Anthropic tools to Bedrock toolConfig format.NrP)rr:)rGrPr0 bedrock_toolss rrTz)BedrockCountTokensConfig._transform_toolss9YcdiYj0kQU1Ft1L0k 0k''1ls)cPddl}ddl}|jDcic]\}}|dk7s ||}}}d|vr(|jdd|jdt|j |j |jj}dd d |iiiScc}}w) z&Transform to InvokeModel input format.rNmodelrAanthropic_versionzbedrock-2023-05-31 max_tokensrRr?body) base64r4items setdefaultr b64encodedumpsencodedecode)rGr=rar4kv body_data encoded_bodys rrKz:BedrockCountTokensConfig._transform_to_invoke_model_formats.:-?-?-ARTQQ'\AqDR R  "  !46J K  /X Y%..tzz)/D/K/K/MNUUW -&,)?@AASs B"B"r]aws_region_nameapi_baseaws_bedrock_runtime_endpointct|}|jd}|j|}|j|||\}}|d|d} | S)a Construct the AWS Bedrock CountTokens API endpoint using existing LiteLLM functions. Args: model: The resolved model ID from router lookup aws_region_name: AWS region (e.g., "eu-west-1") api_base: Optional custom API base URL (takes highest priority) aws_bedrock_runtime_endpoint: Optional custom Bedrock runtime endpoint Returns: Complete endpoint URL for CountTokens API zbedrock/)model_id)rmrnrlz/model/z /count-tokens)r removeprefixencode_model_idget_runtime_endpoint) rGr]rlrmrnrpencoded_model_idbase_urlr'endpoints r!get_bedrock_count_tokens_endpointz:BedrockCountTokensConfig.get_bedrock_count_tokens_endpointsq(*%0((4"&"6"6"6"I//)E+0 ! &Jg.>-?}Mrbedrock_responsec.|jdd}d|iS)z Transform Bedrock CountTokens response to Anthropic format. Input (Bedrock response): { "inputTokens": 123 } Output (Anthropic format): { "input_tokens": 123 } inputTokensr input_tokens)r")rGrxr{s r'transform_bedrock_response_to_anthropicz@BedrockCountTokensConfig.transform_bedrock_response_to_anthropics! /22=!D  --rc|jds td|j|}|dk(r|jdg}|s tdt|ts tdt |D]J\}}t|t std|dd |vrtd|d d |vs=td|d yt|d kr tdy)z Validate the incoming count tokens request. Supports both Converse and InvokeModel input formats. Args: request_data: The request payload Raises: ValueError: If the request is invalid r]zmodel parameter is requiredr>rAz1messages parameter is required for Converse inputzmessages must be a listzMessage z must be a dictionaryr z must have a 'role' fieldrz must have a 'content' fieldz,Request must contain content to count tokensN)r" ValueErrorrHrr enumeraterlen)rGr=rLrAirs rvalidate_count_tokens_requestz6BedrockCountTokensConfig.validate_count_tokens_requests(:; ; 33LA  #*..z2>H !TUUh- !:;;'1 Q 7!'40$xs2G%HII($xs2K%LMMG+$xs2N%OPP Q< A% !OPP&r)NN)__name__ __module__ __qualname____doc__rrrrrHrrMrJrrSrTrKrwr|rrrr<r<AspwsI~/F7SlKm8&Hc9n-&H c9n &HP7'#y.:Q7VZ[^`i[iVj7.  d9o (i(Di4H44O(Bgc9n>UBZ^_bdm_mZnB. $37 !!!* ! '*Dj ! !F. 'Y 7. c9n .(&Q'#y.:Q&QVZ&Qrr<)rr*collections.abcrtypingrrpydanticr!litellm.llms.bedrock.base_aws_llmr!litellm.llms.bedrock.common_utilsrr __annotations__rrrrrrr$r/r:r<rrrrs #!8D 48)574i4Di$844i4DO4)Y)S)^0D9  d3 >.B iQziQr