uPjfUddlZddlmZddlmZmZmZddlZddlmZ ddl m Z ddl m Z erddlmZneZe Zeed<d eed efd Zd efd Zd efd ZGddZGddeZGddeZy)N)datetime) TYPE_CHECKINGAnyFinal)Logging)PassThroughEndpointLogging) EndpointType)$BaseGoogleGenAIGenerateContentConfig'GLOBAL_PASS_THROUGH_SUCCESS_HANDLER_OBJ event_linesreturncHdj|dzjdS)N z zutf-8)joinencode)r s l/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/google_genai/streaming_iterator.py_encode_google_genai_sse_eventrs! IIk "V + 3 3G <<cg} t|}|dk(r|r t|S |j|1#t$r|r t|cYSwxYwN)next StopIterationrappend line_iterr lines r_next_google_genai_sse_chunkrsg$&K   ?D 2:5kBB 4   5kBB  s 5A AcKg} |jd{}|dk(r|r t|S-|j|>7)#t$r|r t|cYSwxYwwr) __anext__StopAsyncIterationrrrs r_anext_google_genai_sse_chunkr"*ss$&K  ",,..D 2:5kBB 4  .! 5kBB  s7A#AAA%A#AA A#A  A#c FeZdZdZ d dededededeeefdzf dZd Z y) /BaseGoogleGenAIGenerateContentStreamingIteratorz Base class for Google GenAI Generate Content streaming iterators that provides common logic for streaming response handling and logging. Nlitellm_logging_obj request_bodymodelcustom_llm_provider hidden_paramsc*||_||_tj|_g|_||_||_|tjjjk(rtjntj|_|xsi|_yN)r%r&rnow start_timecollected_chunksr'r(litellm LlmProvidersGEMINIvaluer VERTEX_AI endpoint_type_hidden_params)selfr%r&r'r(r)s r__init__z8BaseGoogleGenAIGenerateContentStreamingIterator.__init__@sz$7 (",,.-/ #6 #6':N:N:U:U:[:[#[L  amawaw /<.Arrc "Kddlm}tj}t j |j |jtd|jxsi|j|j|j||j yw)z8Handle the logging after all chunks have been collected.r)PassThroughStreamingHandlerz/v1/generateContent) r%passthrough_success_handler_obj url_router&r4r- raw_bytesend_timer'N)6litellm.proxy.pass_through_endpoints.streaming_handlerr9rr,asyncio create_task#_route_streaming_logging_to_handlerr%r r&r4r-r.r')r6r9r=s r_handle_async_streaming_loggingzOBaseGoogleGenAIGenerateContentStreamingIterator._handle_async_streaming_loggingSsz #,,. ' K K$($<$<0W/!..4""00??//!jj L  sB Br+) __name__ __module__ __qualname____doc__LiteLLMLoggingObjdictstrrr7rBrrr$r$:sY04 B.BB B ! B CH~, B& rr$cteZdZdZ ddededededededzd eeefdzffd Z d Z d Z d Z dZ xZS)+GoogleGenAIGenerateContentStreamingIteratorzP Streaming iterator specifically for Google GenAI generate content API. Nr' logging_obj generate_content_provider_configlitellm_metadatar(r&r)c t |||xsi|||||_||_||_||_|j |_yN)r%r&r'r(r))superr7responser'rNrO iter_linesstream_iterator r6rSr'rMrNrOr(r&r) __class__s rr7z4GoogleGenAIGenerateContentStreamingIterator.__init__ps^  +%+ 3'  !  0P- 0 (224rc|Sr+rJr6s r__iter__z4GoogleGenAIGenerateContentStreamingIterator.__iter__ rc t|j}|jj||S#t$rtwxYwr+)rrUr.rrr6chunks r__next__z4GoogleGenAIGenerateContentStreamingIterator.__next__sE 78L8LME  ! ! ( ( /L   s 14Ac|Sr+rJrYs r __aiter__z5GoogleGenAIGenerateContentStreamingIterator.__aiter__r[rc Ktdw)NzHUse AsyncGoogleGenAIGenerateContentStreamingIterator for async iteration)NotImplementedErrorrYs rr z5GoogleGenAIGenerateContentStreamingIterator.__anext__s""lmms NN)rCrDrErFrIrGr rHrr7rZr_rar __classcell__rWs@rrLrLks%)/355' 5 +O 5  5!5Tk5CH~,54 nrrLcheZdZdZ d dededededededzd eeefdzffd Z d Z d Z xZ S)0AsyncGoogleGenAIGenerateContentStreamingIteratorzV Async streaming iterator specifically for Google GenAI generate content API. Nr'rMrNrOr(r&r)c t |||xsi|||||_||_||_||_|j |_yrQ)rRr7rSr'rNrO aiter_linesrUrVs rr7z9AsyncGoogleGenAIGenerateContentStreamingIterator.__init__s^  +%+ 3'  !  0P- 0 (335rc|Sr+rJrYs rraz:AsyncGoogleGenAIGenerateContentStreamingIterator.__aiter__r[rcK t|jd{}|jj||S7!#t$r |j d{7twxYwwr+)r"rUr.rr!rBr]s rr z:AsyncGoogleGenAIGenerateContentStreamingIterator.__anext__se %!>t?S?S!TTE  ! ! ( ( /LU" %668 8 8$ $ %s5A,A> AA,AA)A A))A,rd) rCrDrErFrIrGr rHrr7rar rerfs@rrhrhsw%)/366' 6 +O 6  6!6Tk6CH~,64%rrh)r?rtypingrrrr/*litellm.litellm_core_utils.litellm_loggingrrG4litellm.proxy.pass_through_endpoints.success_handlerr:litellm.types.passthrough_endpoints.pass_through_endpointsr 1litellm.llms.base_llm.google_genai.transformationr r __annotations__listrIbytesrrr"r$rLrhrJrrrus,,ST,/(1K1M'M=S =e= !u ! !e ! . . b0n2a0nf)%7f)%r