uPjL*JdZddlZddlmZddlmZddlmZGddeZy)a_ Vertex AI Realtime (BidiGenerateContent) config. Extends GeminiRealtimeConfig but adapts the WSS URL and auth header for the Vertex AI endpoint instead of Google AI Studio. URL pattern: wss://{location}-aiplatform.googleapis.com/ws/ google.cloud.aiplatform.v1.LlmBidiService/BidiGenerateContent Auth: OAuth2 Bearer token (not an API key). N)Final)verbose_logger)GeminiRealtimeConfigc eZdZdZdedededdffd ZdefdZ dd edzd ed edzdefd Z dd e d ed edzde fdZ ddedefdZ d edefdZ d edefdZ d ede de fdZ dded ededzdeeffd ZxZS)VertexAIRealtimeConfigz Realtime config for Vertex AI (BidiGenerateContent). ``access_token`` and ``project`` must be pre-resolved by the caller (they require async I/O) and injected at construction time. access_tokenprojectlocationreturnNcLt|||_||_||_yN)super__init__ _access_token_project _location)selfrr r __class__s s/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/vertex_ai/realtime/transformation.pyrzVertexAIRealtimeConfig.__init__s$ ) !cy)NF)rs r_include_function_response_idz4VertexAIRealtimeConfig._include_function_response_id#srapi_basemodelapi_keyc|r8|jd}|jddjdd}|dS|j}|dk(rd}n|d }d|dS) z Build the Vertex AI Live WSS endpoint URL. If *api_base* is provided it overrides the default aiplatform host, allowing enterprise / VPC-SC deployments to point at a custom gateway. /zhttps://zwss://zhttp://zws://zA/ws/google.cloud.aiplatform.v1.LlmBidiService/BidiGenerateContentglobalzaiplatform.googleapis.comz-aiplatform.googleapis.com)rstripreplacer)rrrrbaser hosts rget_complete_urlz'VertexAIRealtimeConfig.get_complete_url*ss ??3'D<< H5==iQDV\] ].. x .DZ9:Dv^__rheaderscvt|}d|j|d<|jr|j|d<|S)u Return headers with a Bearer token for Vertex AI. ``api_key`` is intentionally ignored — Vertex AI uses OAuth2 tokens, not API keys. The token was resolved at config-construction time. zBearer Authorizationzx-goog-user-project)dictrr)rr%rrs rvalidate_environmentz+VertexAIRealtimeConfig.validate_environmentHs@w-%,T-?-?,@#A ==-1]]G) *rinput_audio_formatc2dddd}|j|dS)Nzaudio/pcm;rate=24000z audio/pcmuz audio/pcma)pcm16 g711_ulaw g711_alawzapplication/octet-stream)get)rr* mime_typess rget_audio_mime_typez*VertexAIRealtimeConfig.get_audio_mime_type^s),%%  ~~02LMMrcddlm}ddlm}dg}d|jd|j d|}|d|id d d d iiid }t jd|iS)ad Return the JSON setup message for Vertex AI Live. Vertex AI requires the fully-qualified model path: ``projects/{project}/locations/{location}/publishers/google/models/{model}`` Also enables automatic activity detection (server VAD) and output audio transcription so the proxy forwards transcript events. r)BidiGenerateContentSetup)GeminiResponseModalitiesAUDIO projects/ /locations//publishers/google/models/responseModalitiesautomaticActivityDetectionF )disabledsilenceDurationMs)rgenerationConfigrealtimeInputConfiginputAudioTranscriptionoutputAudioTranscriptionsetup)litellm.types.llms.geminir3litellm.types.llms.vertex_air4rrjsondumps)rrr3r4response_modalitiesfull_model_path setup_configs rsession_configuration_requestz4VertexAIRealtimeConfig.session_configuration_requestks} GIFMY#,T]]O;t~~FVVpqvpw!x$!57J K- %),/$(*(*9 zz7L122rc@d|jd|jd|S)z9Return the fully-qualified Vertex AI model resource path.r6r7r8)rr)rrs r_vertex_model_pathz)VertexAIRealtimeConfig._vertex_model_paths'4==/T^^4DD^_d^effrsession_paramsc|j|}|ji|}|j||d<|jdi}|jddg|j d}t |t xr|j ddu}|jd i}|jd i}|sd|d <|jd d |jdi|jdi|j||S)zHBuild Vertex AI setup configuration with proper model path and defaults.)optional_paramsnon_default_paramsrr>r9r5turn_detectioncreate_responseFr?r:r<r=r;r@rA)&_normalize_session_payload_for_mappingmap_openai_paramsrL setdefaultr/ isinstancer(_finalize_gemini_live_setup) rrrMrIgeneration_configclient_turn_detectionclient_disabled_auto_responserealtime_input_configautomatic_detections r_build_vertex_ai_setup_configz4VertexAIRealtimeConfig._build_vertex_ai_setup_configs&DD^T"44R\j4k !% 7 7 > W$0#:#:;Mr#R$$%9G9E(6'9'9:J'K ,d 3 m8M8Q8QRc8dhm8m &(4'>'>?TVX'Y%:%E%EFbdf%g,.3  +&&':C@ 92> :B?//|DDrmessagerJctj|}|jd}|dk(r|T|j||jdxsi}tjd|i}t j d|gStj|jdxsi}t|tr*|jddurt jdgSt j d gSt |5|||S) a Translate OpenAI realtime client messages to Vertex AI format. On the first ``session.update`` (when no setup has been sent yet) the full ``BidiGenerateContentSetup`` is built with Vertex AI's model path and forwarded. Any later ``session.update`` is dropped: Vertex AI documents ``setup`` as the first-and-only client message, and a second ``setup`` closes the connection with a 1007 policy error. typezsession.updatesessionrBz?Vertex AI Realtime: Sending initial setup with tools to backendrRFuVertex AI Realtime: Dropping subsequent session.update (turn_detection.create_response=False) — Vertex Live rejects a second setup message. Audio-transcription guardrails cannot suppress the model's auto-response on Vertex AI in non-deferred mode.z@Vertex AI Realtime: Ignoring session.update (setup already sent))rEloadsr/r]rFrdebugr_extract_turn_detectionrVr(warningrtransform_realtime_request) rr^rrJ json_messagemsg_typerIgemini_setup_msgrYrs rrfz1VertexAIRealtimeConfig.transform_realtime_requests#jj1 &**62 ' ',4&*&H&HP\P`P`ajPkPqoq&r *.**g|5L*M $$%fg())%9$P$PQ]QaQabkQlQrpr$s !/6;P;T;TUf;gkp;p&&6I$$%ghIw1'5B_``rr )r,)__name__ __module__ __qualname____doc__strrboolrr$r(r)r1rJrLr]listrf __classcell__)rs@rrrsJ"S"3"#"$" t# `*``t ` `D# t   ,NcNN33333Hggg)E3)E)EQU)E^59 ,a,a,a(+Tz ,a c ,a,arr) rmrEtypingrlitellmr+litellm.llms.gemini.realtime.transformationrrrrrrus)  "LUa1Uar