uPj(<UdZddlZddlZddlZddlmZmZddlmZm Z ddl m Z m Z ddl mZddlmZddlmZd d lmZd d lmZd d lmZe eedzZee ded<e eZee eed<dedeeeffdZ dededzfdZ!GddeZ"GddeZ#GddeZ$GddeZ%GddeZ&Gdd eZ'Gd!d"eZ(y)#z This file contains the handler for AWS Bedrock Nova Sonic realtime API. This uses aws_sdk_bedrock_runtime for bidirectional streaming with Nova Sonic. N)FinalProtocol) JsonValue TypeAdapter)_redact_stringverbose_proxy_logger)get_aws_dns_suffix)Logging)RealtimeResponseTransformInput) BaseAWSLLM) BedrockError)BedrockRealtimeConfigzlist[str] | None_CLIENT_MODALITIES_ADAPTER_CLIENT_MESSAGE_ADAPTERvaluereturnc*t|tr|SiSN) isinstancedictrs j/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/bedrock/realtime/handler.py _json_dictrsud+533c*t|tr|SdSr)rstrrs r _json_strrsuc*544rcHeZdZdZdefdZdeddfdZd dededzddfd Zy) RealtimeClientWebSocketzAThe client-facing websocket surface the realtime bridge talks to.rc Kywrselfs r receive_textz$RealtimeClientWebSocket.receive_text&dataNc Kywrr#)r%r)s r send_textz!RealtimeClientWebSocket.send_text(r'r(codereasonc Kywrr#)r%r,r-s rclosezRealtimeClientWebSocket.close*r'r()iN) __name__ __module__ __qualname____doc__rr&r+intr/r#rrr!r!#s0K,C,5C5D5SSC$JS$Srr!c$eZdZdeddfdZddZy)BedrockInputStreameventrNc Kywrr#)r%r7s rsendzBedrockInputStream.send.r'r(c Kywrr#r$s rr/zBedrockInputStream.close0r'r()rN)r0r1r2objectr9r/r#rrr6r6-s4444&rr6c(eZdZededzfdZy)BedrockPayloadPartrNcyrr#r$s rbytes_zBedrockPayloadPart.bytes_4s&)r)r0r1r2propertybytesr?r#rrr=r=3s ) ))rr=c(eZdZededzfdZy)BedrockOutputChunkrNcyrr#r$s rrzBedrockOutputChunk.value925r)r0r1r2r@r=rr#rrrCrC8s 5)D055rrCceZdZdedzfdZy)BedrockOutputStreamrNc Kywrr#r$s rreceivezBedrockOutputStream.receive>r'r()r0r1r2rCrIr#rrrGrG=s=1D8=rrGc8eZdZedefdZdeeeffdZ y)BedrockBidirectionalStreamrcyrr#r$s r input_streamz'BedrockBidirectionalStream.input_streamBrErc Kywrr#r$s r await_outputz'BedrockBidirectionalStream.await_outputEr'r(N) r0r1r2r@r6rMtupler;rGrOr#rrrKrKAs) 5055KE&2E*E$FKrrKc$*eZdZdZfdZ ddededededzdedzd edzd edzd edzd edzd edzdedzdedzdedzdedzdedzdedzdedzf"dZ ddede de dede dedzf dZ de dede dedede f dZxZS)BedrockRealtimez=Handler for Bedrock Nova Sonic realtime speech-to-speech API.c"t|yr)super__init__)r% __class__s rrUzBedrockRealtime.__init__Ks rNmodel websocket logging_objapi_baseapi_keytimeoutaws_region_nameaws_access_key_idaws_secret_access_keyaws_session_token aws_role_nameaws_session_nameaws_profile_nameaws_web_identity_tokenaws_sts_endpointaws_bedrock_runtime_endpointaws_external_idc K ddlm}m}ddlm}ddlm}|d|i}|j||}||}n||}nd|d t|}tjd |||j|| | || | | ||| }| td d |j}||||j|j |j"|}||}t%} |j'||d{}tjd|j)t+j,|j/||d{tjddddddddd}t1j2|j5||||||} t1j2|j7||||||}!t1j8| |!dd{y#t$r tdwxYw777!#t:$rT}"tj<d|" |j?dtAd|"d{7#t:$rYwxYwd}"~"wwxYww)a` Establish bidirectional streaming connection with Bedrock Nova Sonic. Args: model: Model ID (e.g., 'amazon.nova-sonic-v1:0') websocket: Client WebSocket connection logging_obj: LiteLLM logging object aws_region_name: AWS region Various AWS authentication parameters r)BedrockRuntimeClient0InvokeModelWithBidirectionalStreamOperationInput)Config)StaticCredentialsResolverzRMissing aws_sdk_bedrock_runtime. Install with: pip install aws-sdk-bedrock-runtimeNr]zhttps://bedrock-runtime..z0Bedrock Realtime: Connecting to %s with model %s) r^r_r`r]rbrcrardrergiz}No AWS credentials found for Bedrock realtime. Set aws_* params in litellm_params or configure credentials in the environment) status_codemessage) endpoint_uriregionr^r_r`!aws_credentials_identity_resolver)config)model_idz2Bedrock Realtime: Bidirectional stream establishedz;Bedrock Realtime: sent session.created to client on connectcurrent_output_item_idcurrent_response_idcurrent_conversation_idcurrent_delta_chunkscurrent_item_chunkscurrent_delta_typesession_configuration_requestT)return_exceptionsz+Error in BedrockRealtime.async_realtime: %sizInternal error: )r,r-)!aws_sdk_bedrock_runtime.clientrirjaws_sdk_bedrock_runtime.configrksmithy_aws_core.identityrl ImportError_get_aws_region_namer rdebugget_credentialsrget_frozen_credentials access_key secret_keytokenr&invoke_model_with_bidirectional_streamr+jsondumpssession_created_eventasyncio create_task_forward_client_to_bedrock_forward_bedrock_to_clientgather Exception exceptionr/r)#r%rWrXrYrZr[r\r]r^r_r`rarbrcrdrerfrgkwargsrirjrkrloptional_paramsrp credentialsfrozen_credentialsrsbedrock_clienttransformation_configbedrock_stream session_stateclient_to_bedrock_taskbedrock_to_client_taskes# rasync_realtimezBedrockRealtime.async_realtimeNs> t  > J  "!?&O#77OO  #L ) 57L5o5FaHZ[jHkGlmL""#UWcejk!11/"7/+--'#9-+2    B %0$F$F$H%"0;;"4"?"?066.G.I  !5F C'<'>: *8*_*_@%P+%N ! & &'[ \%%djj1F1\1\]bdo1p&qr r r & &'d e+/'++/(,'+&*15DM-4,?,?//")!  - "-4,?,?//")!  - "..&&"&  K trs s tr% sL    * *+XZ[ \ oo4IYZ[Y\G]8^o___      sI"G$CI"!H<G<=AH G>BHHH#I"$G99I"<H>HH I I""I II  I IIIIII" client_wsrrrc Kddlmmdtddffd } |j d{}t j d|dd |j|||jd  } | D]} || d{|d} d} tjt5ttj|} t| jd } | d k(r.send_to_bedrocksaG3?;Q;QRY;Z[E!--2259 9 9 & &'NP_`dadPe f :s>A"A A"Tz*Bedrock Realtime: Received from client: %srr|)rorWr|typezsession.updatesession modalitiesz&Client to Bedrock forwarding ended: %sexc_info)aws_sdk_bedrock_runtime.modelsrrrr&rrtransform_realtime_requestget contextlibsuppressrrr validate_jsonrrvalidate_pythonr+rrsession_updated_eventsession_close_messagesrMr/)r%rrrrWrrYrrotransformed_messagesrclient_message_typerequested_modalitiesparsed_client_messager close_messagerrs ` @@rrz*BedrockRealtime._forward_client_to_bedrocksQ  g3 g4 g( : ) 6 6 88$**+WY`aebeYfg(='W'W#2?2C2CDc2d(X($(<;O)/:::;*6:'=A(#,,Y70:;R;`;`ah;i0j-.78M8Q8QRX8Y.Z+.2BB3M3]3] *+@+D+DY+O P T TUa b40 +.>>'11 JJ 5 K KES^`t u78;   : & &'OQR]a b!6!M!M!O 9 ((39)-888999 9$$Y/ :$1177999 : : : : :  :sIFE0AFE3%F*A:E5$AF)F*F3F5E>:F I AI G+G G+" I+G4 0!IH>/H20H>5 I>I I IIIc @K |jd{}|djd{}|tjdn|jr|jj nd} | r| j d} tjd| dd|jd|jd |jd |jd |jd |jd |jdd} |j| ||| } |j| jd| jd | jd | jd | jd | jd | jdd| jdg} | D]I}tj|}|j|d{tjd|ddK |jd{y777B#t$r"}tjd|dYd}~Hd}~wwxYw7;#t$rYywxYw# |jd{7w#t$rYwwxYwxYww)z9Forward messages from Bedrock stream to client WebSocket.TNrz&Bedrock Realtime: Bedrock stream endedrz+Bedrock Realtime: Received from Bedrock: %srrvrwrxryrzr{r|ru)rorWrY!realtime_response_transform_inputresponsez$Bedrock Realtime: Sent to client: %sz&Bedrock to client forwarding ended: %sr)rOrIrrrr?decodertransform_realtime_responseupdaterrr+rr/)r%rrrrWrYroutputresult payload_bytesbedrock_responsertransformed_responseopenai_messagesopenai_message message_jsonrs rrz*BedrockRealtime._forward_bedrock_to_client's< -::<<%ay0022>(../WX7=|| 3 3  '4';';G'D$(../\^nosps^tu3@2C2CD\2]/&>z2&NO*9o'+zz.'A '11,???,223Y[ghlil[mno_b oo'''o=2\@ c & &'OQR]a b b c (   oo'''  sJH1H)H1H,F8H1,H/-!H1I0I!#I$I!(J)H1,H1/H11 I:II0II0I!! I-*J,I--J0J2J JJ  J JJJJJ)NNNNNNNNNNNNNNr)r0r1r2r3rUrr!LiteLLMLoggingfloatrrKrr rr __classcell__)rVs@rrRrRHsG $" $&*(,,0(,$('+'+-1'+37&*%WW+W$ W * W t WWtW:W #TzW:WTzW*W*W!$d W *!W"'*Dj#W$t%W@.2>:*>:3>: 5 >:  >: 6 >:$d*>:@F2F+F 5 F  F $ F6FrrR))r3rrrtypingrrpydanticrrlitellm._loggingrr(litellm.litellm_core_utils.aws_partitionr *litellm.litellm_core_utils.litellm_loggingr rlitellm.types.realtimer base_aws_llmr common_utilsrtransformationrlistrr__annotations__rrrrr!r6r=rCrGrKrRr#rrrs  "+AGPA%'1EPQUVYQZ]aQaEbE+.@"ABb9DY9O{956O4i4Di$845Y53:5ThT'' ** 66 >(>LLejer