uPj`UdZddlZddlmZmZddlmZmZmZm Z m Z ddl Z ddl m Z ddlmZmZddlmZmZmZmZmZmZmZmZdd lmZdd lmZd d lmZer dd l m!Z"e"Z#neZ#dZ$ee%d<dZ&ee%d<Gdde dZ'Gdde dZ(Gdde dZ)Gdde Z*Gdde Z+de*dee,e-ffd Z.de+de)fd!Z/d"e,de0fd#Z1Gd$d%eeZ2Gd&d'eZ3y)(uY Snowflake Cortex REST API — Chat Transformation Routes to native Cortex REST API endpoints based on model: - Claude models → POST /api/v2/cortex/v1/messages (Anthropic format) - All other models → POST /api/v2/cortex/v1/chat/completions (OpenAI format) Ref: https://docs.snowflake.com/en/user-guide/snowflake-cortex/cortex-rest-api N)MappingSequence) TYPE_CHECKINGAnyFinalProtocol TypedDict)ReadOnly)AllMessageValuesChatCompletionToolCallChunk)ChatCompletionMessageToolCallChatCompletionUsageBlockChoicesFunctionGenericStreamingChunkMessage ModelResponseUsage)BaseModelResponseIterator)OpenAIGPTConfig)SnowflakeBaseConfig)Loggingz 2023-06-01ANTHROPIC_VERSION)zclaude-claude__CLAUDE_MODEL_PREFIXEScheZdZUeeed<eeed<eeed<eeed<eeeefed<y)_AnthropicContentBlocktypetextidnameinputN)__name__ __module__ __qualname__r str__annotations__robjecto/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/snowflake/chat/transformation.pyrr1s> 3- 3-  3- GCK( ))r,rF)totalc.eZdZUeeed<eeed<y)_AnthropicUsageBlock input_tokens output_tokensN)r%r&r'r intr)r+r,r-r0r09s3-C= r,r0cdeZdZUeeed<eeed<eeed<eeeed<eeed<y)_AnthropicMessagesResponser"model stop_reasoncontentusageN) r%r&r'r r(r)rrr0r+r,r-r5r5>s=  C=# h56 77 ( ))r,r5c&eZdZdZdeeeffdZy)_ChatCompletionsResponsezOResponse view that decodes the Cortex chat-completions body as a field mapping.returncyNr+selfs r-jsonz_ChatCompletionsResponse.jsonIr,N)r%r&r'__doc__rr(r*rAr+r,r-r;r;FsY/gc6k*/r,r;ceZdZdZdefdZy)_MessagesResponsezGResponse view that decodes the Cortex messages body in Anthropic shape.r<cyr>r+r?s r-rAz_MessagesResponse.jsonOrBr,N)r%r&r'rCr5rAr+r,r-rErELsQ505r,rEresponser<c"|jSr>rArGs r-_decoded_chat_completionsrKR ==?r,c"|jSr>rIrJs r-_decoded_messagesrNVrLr,r6cr|jjdtfdtDS)zPReturn True if model name (after stripping snowflake/ prefix) is a Claude model. snowflake/c3@K|]}j|ywr>) startswith).0pr#s r- z#_is_claude_model..]sBatq!Bs)lower removeprefixanyr)r6r#s @r-_is_claude_modelrYZs+++-,,\:D B+AB BBr,ceZdZdZefdZdedeefdZ d&dedzdedzded e d e d e dzdefd Z d'd e dedee d e d e dedzdedzde ffd Z dee dee fdZdee deedzee ffdZdedee d e d e d e de f dZdedee d e d e de de f dZdede eeffdZdedee d e d e de de f dZ d'dedej.dedede dee d e d e dededzde dzdefdZdedej.dedede dee defd Zdedej.dedede dee defd!Z d(d"ed#e de dzdd$fd%ZxZS))SnowflakeConfigu Snowflake Cortex REST API — unified provider. Auto-routes based on model name: - Claude models → /api/v2/cortex/v1/messages (Anthropic Messages format) - All others → /api/v2/cortex/v1/chat/completions (OpenAI format) Auth: PAT: api_key="pat/" → X-Snowflake-Authorization-Token-Type: PROGRAMMATIC_ACCESS_TOKEN JWT: api_key="" → X-Snowflake-Authorization-Token-Type: KEYPAIR_JWT c t|Sr>)super get_config)cls __class__s r-r^zSnowflakeConfig.get_configmsw!##r,r6r<cFgd}t|r|jd|S)N) temperature max_tokensmax_completion_tokenstop_pstreamtools tool_choicethinking)rYappend)r@r6paramss r-get_supported_openai_paramsz+SnowflakeConfig.get_supported_openai_paramsqs$  E " MM* % r,Napi_baseapi_keyoptional_paramslitellm_paramsrfcP|j||}t|r|dS|dS)Nz/cortex/v1/messagesz/cortex/v1/chat/completions) _get_api_baserY)r@rmrnr6rorprfs r-get_complete_urlz SnowflakeConfig.get_complete_urls:%%h@ E "Z23 3677r,headersmessagesc \t||||||||}t|r t|d<|S)N)rtr6rurorprnrmzanthropic-version)r]validate_environmentrYr) r@rtr6rurorprnrmr`s r-rwz$SnowflakeConfig.validate_environmentsH'.+)/  E "+2!)&(6N>2 &&~6&&t,# -$r,c g}g}|D]}t|tr%|jdd}|jdd}nt|dd}t|dd}|dk(r]t|tr|r|j ||t|t s|j djd|D|dk(rvt|tr|jdn t|dd }|r/g}|r|j d |d |D]} t| tr| jd in t| d i} t| tr| jd dn t| d d} t| tr| jddn t| dd} t| tr| jddn t| dd} t| trtj| n| }|j d| | |d|j d|d|j d|d1|dk(rt|tr|jddn t|dd}t|tr|ntj|}d||d}|r_|dddk(rTt|ddt r>|ddr6|dddjddk(r|ddj ||j d|gd |j ||d |rdj|nd }||fS#tjtf$ri}YkwxYw)uF Split messages into system prompt and conversation turns for Anthropic format. - system messages → collected and joined (preserves guardrail prompts) - assistant messages with tool_calls → tool_use content blocks - tool role messages → user role with tool_result content blocks rolerzr8system c3jK|]+}|jddk(s|jdd-yw)r r!rzN)r)rSbs r-rUz?SnowflakeConfig._extract_system_and_messages..s01pXYX]X]^dXeioXo!%%2C1ps33 assistant tool_callsNr!)r r!ryr"r# argumentsz{}tool_use)r r"r#r$)rr8r tool_call_id tool_result)r tool_use_idr8userrr z ) isinstancedictrgetattrr(rjlistjoinrAloadsJSONDecodeError TypeErrordumps)r@ru system_parts conversationmsgrr8rcontent_blockstcrtc_id func_name func_args input_datar tool_contenttool_result_blockrs r-_extract_system_and_messagesz,SnowflakeConfig._extract_system_and_messagessU*, *, > HC#t$wwvr*"wwy"5sFB/!#y"5xgs+ ''0. '' 1pW1p(pq$6@d6KSWW\2QXY\^jlpQq >@N&--vw.OP(9CB9Mrvvj"5SZ[]_ikmSn4>r44HtR 0gVXZ^`bNcbkJ'--(2&+(1)3 &!''(XY ''(QR3=c43HCGGNB/gVY[ikmNn+5Wc*Bw SZH[ )#/+%! !$R(0F:"<#3I#>E$R(3$R(3A6::6BmS $Y/667HI ''EVDW(XY##Tg$FG}> H@BNFKK $=SW|##K!% 4 4i@,)+J,s 'MM M c|jddxsd}|jdi}t|r|j|||||S|j|||||S)NrfF extra_body)poprY_transform_request_anthropic_transform_request_openai)r@r6rurorprtrfrs r-transform_requestz!SnowflakeConfig.transform_requestsk.11(EBKe+// bA E "44UHoW]_ij j--eXPVXbccr,rc|jdd}|jdd}|xs|}|jd||d||} ||| d<| S)z-OpenAI format for /chat/completions endpoint.rcNrdrPr6rurf)rrW) r@r6rurorfrrcrd resolved_maxbodys r-rz)SnowflakeConfig._transform_request_openais~,// dC '6':':;RTX'Y3Az '' 5        #,8D( ) r,rhct|tr ddiddiddid}|j|ddiSt|tr=|jddk(r'|jdi}d|jdd d S|SddiS) a$ Convert tool_choice from OpenAI format to Anthropic format. OpenAI string values: "auto", "required", "none" OpenAI dict: {"type": "function", "function": {"name": "..."}} Anthropic: {"type": "auto"}, {"type": "any"}, {"type": "tool", "name": "..."} r autorXnone)rrequiredrryrr#rz)r r#)rr(rr)r@rhmappingrs r-#_transform_tool_choice_to_anthropicz3SnowflakeConfig._transform_tool_choice_to_anthropic7s k3 '(#UO(G ;;{VV,<= =  T *v&*4)ooj"= &0DEE r,c*|j|\}}d|vr|j|d|d<d|vr|j|d|d<|jdd}|r d|vr||d<|j d} | ||d||} ||| d<d| vrd | d<| S) z1Anthropic Messages format for /messages endpoint.rgrhrdNrcrPrri)rrrrrW) r@r6rurorfrrrrd model_namers r-rz,SnowflakeConfig._transform_request_anthropicMs $@@J o %'+'I'I/ZaJb'cOG $ O +-1-U-UVefsVt-uOM *'6':':;RTX'Y \%H,AOL )!..|<  $*  *  *   #DN t #!%D  r, raw_responsemodel_response logging_obj request_dataencoding json_modec pt|r|j||||||S|j||||||Sr>)rY_transform_response_anthropic_transform_response_openai) r@r6rrrrrurorprrnrs r-transform_responsez"SnowflakeConfig.transform_responsetsM E "55|^[,PX ..ulNT_amowxxr,ct|}|j|d|d|itdi|}d|jxsdz|_|||jd<|S)z0Parse standard OpenAI chat completions response.rzcomplete_input_dictr$rnoriginal_responseadditional_argsrPr6r+)rK post_callrr6_hidden_params) r@r6rrrrru response_jsonreturned_responses r-rz*SnowflakeConfig._transform_response_openaisy 9F +2LA  $1#A=#A".2C2I2I2OR"P  8=  , ,W 5  r,ct|}|j|d|d|id}g} |jdgD]} | jddk(r|| jddz }-| jddk(sB| jt | jddd t | jd dt j| jd i  ddddd} | j|jddd} t|xsdd} | r| | _ t| d| }|jdi}t|jdd|jdd|jdd|jddz}|g|_ ||_ d|jd|z|_|jdd|_|||j d<|S)z5Parse Anthropic Messages response into OpenAI format.rzrrr8r r!rr"ryr#r$r#r)r"r rystoplengthrend_turnrcr stop_sequencer7rNr)r8rr) finish_reasonindexmessager9r1r2 prompt_tokenscompletion_tokens total_tokensrPr6)rNrrrjr rrArrrrrchoicesr9r6r"r)r@r6rrrrrur text_contentrblock_stop_reason_maprrchoice usage_datar9s r-rz-SnowflakeConfig._transform_response_anthropics 1> +2LA    "&&y"5 Eyy F* &" 55 6"j0!!1 99T2.'!)!&62!6&*jj7B1G&H"   "$# #  033M4E4EmU_4`bhi  )=KP !+G '  *--gr: $..;(nn_a@#:Z^^O]^=__  #)$+m.?.?.OO)--dB7  5:N ) )' 2r,streaming_response sync_streamSnowflakeStreamingHandlerct|||S)N)rrr)r)r@rrrs r-get_model_response_iteratorz+SnowflakeConfig.get_model_response_iterators )1#  r,r>)NNF) r%r&r'rC classmethodr^r(rrlrboolrsr rwrtuplerrrrrrhttpxResponserLiteLLMLoggingObjr*rrrr __classcell__r`s@r-r[r[`s $$  c *# 8* 8t 8 8  8  8t  8  8*##'(     t* .4:$t*8L$T:J5KL$PUVY\`V`bfgkblVlPmL$\ d d'( d d  d  d  d'(      4 s tCQTH~ ,%%'(% %  %  % %d#!%yynny& y ' y  y'(yyyyty$;y y(!!nn!& ! ' !  !'(! !6FFnnF& F ' F  F'(F FX"'  "    $;  %  r,r[cjeZdZdZ d dedededzffd Zdedefd Z dedefd Z dedefd Z xZ S) rz Parse streaming events from both Snowflake endpoints. - /chat/completions: OpenAI SSE format (has "choices" key) - /messages: Anthropic SSE format (has "type" key like content_block_delta) rrrNc`t|||d|_d|_d|_d|_y)N)rrrrz)r]__init__ _tool_index_tool_id _tool_name _input_tokens)r@rrrr`s r-rz"SnowflakeStreamingHandler.__init__s6 ,>KX r,chunkr<cNd|vr|j|S|j|S)Nr)_parse_openai_chunk_parse_anthropic_chunk)r@rs r- chunk_parserz&SnowflakeStreamingHandler.chunk_parser s,  ++E2 2**511r,c |jdg}|stddddddS|d}|jdi}|jdxsd}|jdxsd}d}|jd }|ri|d} | jd i} t| jd dd | jd d| jd dd| jdd}t||dk7|d|jdd|S)NrrzFrr! is_finishedrr9rrdeltarr8rryr"r#rrrr"r ryr)rrr ) r@rrrrrr!rrrrs r-rz-SnowflakeStreamingHandler._parse_openai_chunks!9b1(!     zz'2.%zz/:@b ii *0b!IIl3 "1 B&&R0D266$# HHVR0!%+r!:ffWa(H%%+'**Wa(   r,c|jdd}|dk(rL|jdi}|jdi}|jdd|_tdddddd S|d k(r|jd i}|jdd}|d k(r1t|jd dddd|jddd S|dk(rtdddd|jddt|jd|j |jddd|j  S|dk(r|jdi}|jddk(r`|jdd|_|jdd|_|jdd|_tdddd|jddt|jd|j dd|j  S|dk(r|jd i}|jdd}|jdi}ddddd} d} |s |jrC|jdd} |jxs|jdd} t| | | | z } tdd!| j|d| dd S|d"k(rtdd!dddd Stdddddd S)#Nr rz message_startrr9r1rFrcontent_block_deltar text_deltar!rinput_json_deltary partial_jsonrrcontent_block_start content_blockrr"r# message_deltar7rrrrr2rT message_stop)rrrr rrrr) r@r event_typerrr delta_typerr7 _stop_mapr9output_tinput_ts r-rz0SnowflakeStreamingHandler._parse_anthropic_chunk:s !IIfb1  ("YYy"5G Wb1J!+!BD (!   0 0IIgr*E % &" 5J\),62. %"$))GQ/! 11, %"$))GQ/8=='$(OO).>2)F"#.. "0 0#(99_b#AM  (J6 - 1 1$ ; "/"3"3FB"?#(99Wa#8 , %"$))GQ/8=='*.//!K"..   ? *IIgr*E!&="!=K7B/J"&(!'  I ET//",..!"D!%!3!3!Xz~~nVW7X0")&.!(8!3 ) 'mmK@  > )( $  %   r,r) r%r&r'rCr*rrrrrrrrrs@r-rrsr"' "  $; 2$2+@2 ' ' 2G' Rp Dp 5Jp r,r)4rCrAcollections.abcrrtypingrrrrr rtyping_extensionsr litellm.types.llms.openair r litellm.types.utilsr rrrrrrrbase_llm.base_model_iteratorropenai_like.chat.transformationrutilsr*litellm.litellm_core_utils.litellm_loggingr_LiteLLMLoggingObjrrr)rrr0r5r;rEr(r*rKrNrrYr[rr+r,r-rs -AA &S   F>'X*'5'! *Ye*!9E! *%*0x0 66 (@WSRX[EY 16PCCCDC U )?U p r 9r r,