tPjKX`UddlZddlZddlmZmZddlZddlmZmZm Z m Z m Z ddlm Z ddlmZddlmZmZddlmZddlmZdd lmZmZdd lmZdd lmZmZmZm Z eZ!ee"d <d Z#ee"d<dZ$ee"d<dZ%ee"d<dZ&ee"d<de'dzde'fdZ(de)e'deddfdZ*de+de)e'fdZ, d=de+de'de-ddfdZ.ded ed!e)dzd"ede/e'e+dze'ff d#Z0 d>d%e'd&e'd'e'dzd(e'dzd)e1dzde'de'fd*Z2d+e'de+e'efdzfd,Z3e!jid-eegd$g.e!jid/eegd$g.e!jid0eegd$g.eefd1e d2e d edefd3Z5e!jid4d$g5e!jid6d$g5e!jid7d$g5d1e d2e de fd8Z6e!jid9eegd$g.e!jid:eegd$g.e!jid;eegd$g.eefd1e d2e d ede fd<Z7y)?N)AnyFinal) APIRouterDepends HTTPExceptionRequestResponse)status)verbose_proxy_logger)ProxyExceptionUserAPIKeyAuth)can_key_call_resolved_model)user_api_key_auth)decrypt_value_helperencrypt_value_helper)_read_request_body)RealtimeClientSecretRequestRealtimeClientSecretResponse#RealtimeTranscriptionSessionRequest$RealtimeTranscriptionSessionResponserouter realtime_v1_REALTIME_TOKEN_VERSIONzgpt-4o-realtime-preview_DEFAULT_REALTIME_MODELgpt-realtime-whisper_DEFAULT_TRANSCRIPTION_MODEL)realtime transcription_ALLOWED_SESSION_TYPES session_typereturnc|tvr|Sy)Nr)r)r s o/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/realtime_endpoints/endpoints.py_coerce_realtime_session_typer$#s--  candidatesmodelcXt|tr|r||vr|j|yyyy)N) isinstancestrappend)r&r's r#_append_model_candidater,)s.%%E,C% -D%r%sessionc~g}|jd}t|tr]|jd}t|tr<|jd}t|trt||jd|jd}t|trt||jd|S)Naudioinputrr'input_audio_transcription)getr)dictr,)r-r&r/ audio_inputnested_transcriptionflat_transcriptions r#,_transcription_model_candidates_from_sessionr7.s#%J;;w'E%"YYw/ k4 (*5///*J .5'(,,W5 !( ,G H$d+ ,>,B,B7,KL r%create_if_missingcd}|jd}t|tr i|d|i|d<d}|jd}t|tr[|jd}t|tr:|jd}t|tri|di|di|d|iii|d<d}|s|syt|tr|ni}|jd}t|tr|ni}i|di|dd|iii|d<y)NFr1r'Tr/r0r)r2r)r3)r-r'r8updated_existing_configr6r/r4r5s r##_set_transcription_model_on_sessionr;CsU $ ' ,G H$d+0  0 U0 +,#' KK E%ii( k4 (*5///*J .5 $ $%'*2*#U* $ +/'&7t,E"E))G$K!+K!>+BK   gu- GGr%requser_api_key_dictllm_model_list llm_routercKt|jr|jjnd}|jr|jjdnd}|||d<|jr|jjnd}|xs|jxst }|dk7rt ||||d{|||fSt|xsi}|s"t||t||j|s|jt|d}|D]} t | |||d{| t||d|jdd|||fS77/w) NT exclude_nonetyperr' valid_tokenr>r?rr-r'r8r') r$r-rC model_dumpr'rrr7r,r+rr;pop) r<r=r>r?r session_data session_modelr'transcription_model_candidatestranscription_models r#_prepare_client_secret_sessionrMsss 8CKK 8H8H]abLTWT_T_s{{'='=4'='PeiL+ V03 3;;,,MF#))F/FE&)))!    lL00,XYeYkik,l" ) > N > J )&--.JK *1 -E= )%))!     + " $' , ,,= " s%B2E4E5A/E$E%.EEr ephemeral_keymodel_iduser_idteam_id expires_atc\t|||xsd|xsd||d}tj|dS)z Encode metadata with the upstream ephemeral key so /realtime/calls can route without requiring model as a query param. )vrNrOrPrQrRr ),:) separators)rjsondumps)rNrOrPrQrRr payloads r#_encode_realtime_token_payloadr\s;%&=b=b $&G ::g* 55r%decrypted_valuec$ tj|}t|tsy|j dt k7ryt|j dtsyt|j dtsy|S#t$rYywxYw)zV Decode realtime token payload; returns None for legacy/raw ephemeral tokens. NrUrNrO)rYloads Exceptionr)r3r2rr*)r]decodeds r#_decode_realtime_token_payloadrbs~ O4 gt ${{322 gkk/2C 8 gkk*-s 3 N sB BBz/v1/realtime/client_secrets) dependenciestagsz/realtime/client_secretsz"/openai/v1/realtime/client_secretsrequestfastapi_responsec Kddlm}m}m}m}m}m}m} m} m } i} t|d{} td%i| }t||||d{\}}}d|i} ||| d<n|jrd|d| d<|jr|jjd | d <|| |||| | d{} |j!|| d d{} t#j$d|| | d || d{}|d{}|j:dk7rMt#j*d|j:|j<t?|j@|j:dS|jC}|jEdd}|jEd }tG||t5|d!dt5|d"dt/|tHr|nd|#}tK|}||d<|jEd}t/|tLr/|jEd$}t/|tLr d|vr||d<||d<tOd%i|S7777u7N7G#t&$r}|j)||| d{7t#j*dt-|t/|t0r|t/|t2rRt1t5|dt-|t5|ddt5|ddt5|dt6j8t1t5|dt-|t5|ddt5|ddt5|ddd}~wwxYww)&Nr add_litellm_data_to_requestgeneral_settingsr>r? proxy_configproxy_logging_obj route_request user_modelversionre)r<r=r>r?r'r-r)rCr'TrA expires_afterdatarerjr=rorkacreate_realtime_client_secretr=rs call_typez.WebRTC: /v1/realtime/client_secrets (model=%s)rs route_typer?rnr=original_exception request_datazWlitellm.proxy.realtime_endpoints.webrtc.create_realtime_client_secret(): Exception - %smessagerCNoneparam status_coder|rCr~codez+WebRTC client_secrets upstream error %s: %sapplication/jsoncontentr media_typevaluerTrRrPrQrNrOrPrQrRr client_secret)(litellm.proxy.proxy_serverrirjr>r?rkrlrmrnrorrrMr'rqrG pre_call_hookr debugr`post_call_failure_hookerrorr*r)r rgetattr http_statusHTTP_400_BAD_REQUESTrtextr rrYr2r\intrr3r)rerfr=rirjr>r?rkrlrmrnrorsbodyr<r'rIr llm_call upstream_respe upstream_json raw_valuerR token_payloadencrypted_token session_objcss r#create_realtime_client_secretrs(   DH .w??08482P/)! 3 - )|\  #*DO YY'1EBDO   $'$5$5$@$@d$@$SD !0-/%   '44/65   ""#SUZ[ -7!! !   6>~ 8  C'"" 9  % %    !))%11)  "/!3!3!5M*--gr:I%)),7J9)9d;)9d;!+J!<:$! M#7}"EO,M'&3&7&7 &BK+t$OOO4 b$ GrM)BwK#. i ' 8- 88[@- &   0>  66/ 7   "" e F  a (G a ' 9c!f5Q/a&1Q {/O/OP   Ay#a&1FF+!Wf-M3/   ' sMI H:!I H=A$I 2I3I I)I 8I9 I I I D3M:I =I I I I I MM ,I/-CM  MMz/v1/realtime/calls)rdz/realtime/callsz/openai/v1/realtime/callsc Kddlm}m}m}m}m}m}m}m} |jjd} | r| jds1ttjdditj dS| j#dj%} t'| d } | s1ttjdd itj dS|j)d{} t+| }||jd }|Xt-|t.rHt1j0|kDr1ttjdd itj dS|jdd}|jdxs#|j2jdxst4}|jdxsd}|jdxsd}t7|jd}n(| }|j2jdt4}d}d}d}t9||}i} d|i}|dk(rt;||dn||d<||| |d}|||||| |d{}|j=||dd{}t?j@d|||d|| d{}|d{}t|jR|jT|jjd)d*S777y7Q7I#tB$r}|jE|||!d{7t?jFd"tI|t-|tJrRtMtO|d#tI|tO|dd$tO|d%d$tO|d&tjP'tMtO|d#tI|tO|dd$tO|d%d$tO|d&d('d}~wwxYww)+Nr)rirjr?rkrlrmrnro AuthorizationzBearer rz'Missing or invalid Authorization headerrrrealtime_calls_auth)rkeyzInvalid or expired tokenrRzToken has expiredrNrTrOr'rPrQr r)rPrQrCrTrF)r'openai_ephemeral_keysdp_bodyr-rrarealtime_callsruz%WebRTC: /v1/realtime/calls (model=%s)rwryzNlitellm.proxy.realtime_endpoints.webrtc.proxy_realtime_calls(): Exception - %sr|r}r~rrrz content-typezapplication/sdp)+rrirjr?rkrlrmrnroheadersr2 startswithr rYrZrHTTP_401_UNAUTHORIZED removeprefixstriprrrbr)rtime query_paramsrr$r r;rr rr`rrr*rr rrrr)rerfrirjr?rkrlrmrnro auth_headerrdecrypted_token_valuerdecoded_payloadrRrr'rPrQr minimal_authrssession_configrrrs r#proxy_realtime_callsrbs    &-__%8%8%IK k44Y?JJ)RST#99)  )55i@FFHO#7 !$ !JJ)CDE#99)  $+<<>1H;~ 4 %%!-- ((,,^=NO O2l   0>  66* 7   "" \ F  a ' 9c!f5Q/a&1Q {/O/OP   Ay#a&1FF+!Wf-M3/   # sC&O.(K0)EO.*5K;K3 K;;K5<)K;%K7& K;/K90K;4=O.3K;5K;7K;9K;; O+O&LC O&&O++O.z#/v1/realtime/transcription_sessionsz /realtime/transcription_sessionsz*/openai/v1/realtime/transcription_sessionsc`Kddlm}m}m}m}m}m}m} m} m } i} t|d{} td$i| }|jxsd}t||||d{| jDcic]\}}|dk7s ||}}}||d} || |||| | d{} |j|| d d{} t!j"d || | d || d{}|d{}|j8dk7rMt!j(d|j8|j:t=|j>|j8dS|jA}|jCd}t-|tDrsd|vro|jCdd}|jCd}tG||t3|d dt3|d!dt-|tHr|ndd"#}tK||d<||d<tMd$i|S77cc}}w7l7S7,7%#t$$r}|j'||| d{7t!j(dt+|t-|t.r|t-|t0r]t/t3|dt3|dt+|t3|ddt3|ddt3|dt4j6t/t3|dt+|t3|ddt3|ddt3|ddd}~wwxYww)%a) Create an ephemeral Realtime transcription session (POST /v1/realtime/transcription_sessions) for the WebRTC/WebSocket flow. Mirrors the client_secrets route but targets the transcription_sessions endpoint and encrypts the ephemeral key returned under `client_secret.value`. rrhrpNrrDr')r'transcription_sessionrr&acreate_realtime_transcription_sessionruz8Realtime: /v1/realtime/transcription_sessions (model=%s)rwryzXlitellm.proxy.realtime_endpoints.create_realtime_transcription_session(): Exception - %sdetailr|rCr}r~rrrrz5Realtime transcription_sessions upstream error %s: %srrrrrTrRrPrQrrr)'rrirjr>r?rkrlrmrnrorrresolved_modelritemsrr rr`rrr*r)r rrrrrrr rrYr2r3r\rrr)rerfr=rirjr>r?rkrlrmrnrorsrr<r'krUrrrrrrrrRrs r#%create_realtime_transcription_sessionrsX6   D@ .w??8@4@..0J4J)))!    :>'VAg1'V'V9NO0-/%   '44/>5   ""#]_de -?!! !   6>~ 8  C'"" C  % %    !))%11)  "/!3!3!5M),,_=M-&7m+C - 1 1'2 > )--l; =#-y$?-y$?%/ C%@zd(  "6m!D g)6 o& / @- @@A@ (W   0>  66/ 7   "" f F  a (G a ' 8WQ 3q6-JKQ/a&1Q {/O/OP   Ay#a&1FF+!Wf-M3/   ' sL.HH5H!H"H9 H H  H%H&HH)H+H, H5H6H:D L.HH HHHH L+'L&>I?C'L&&L++L.)F)r)8rYrtypingrrhttpxfastapirrrrr r rlitellm._loggingr litellm.proxy._typesr r litellm.proxy.auth.auth_checksr$litellm.proxy.auth.user_api_key_authr0litellm.proxy.common_utils.encrypt_decrypt_utilsrr-litellm.proxy.common_utils.http_parsing_utilsrlitellm.types.realtimerrrrr__annotations__rrrrr*r$listr,r3r7boolr;tuplerMrr\rbpostrrrrr%r#rs  HH)1?FBM !..!::&<e< ==d s !S !#!$! $490$- - -- -`,- $,-%,-4K,- ,-  3t S ! ,-j# 6664Z64Z 6 d 6  6 60 #s(^d,!+,-   +,-   (+,-  )00A(B@9 @9@9&@9" @9   @9F      P PPP   Pf)+,-   &+,-   0+,-  )00A(BzA zAzA&zA* zA   zAr%