tPjdZddlmZddlZddlmZmZddlmZddl m Z m Z ddZ ddZ dd Zd d  dd Zdd ZddZddZy)a`Anthropic SSE <-> ModelResponse conversion for guardrail streaming hooks. `/v1/messages` streams reach a guardrail's `async_post_call_streaming_iterator_hook` as raw SSE frames rather than chunk objects, which `stream_chunk_builder` cannot assemble. These helpers let a hook scan such a stream, and re-emit it when the guardrail rewrote the response. ) annotationsN)MappingSequence)Final)Choices ModelResponsec&td|DS)Nc3HK|]}t|ttfywN) isinstancestrbytes.0chunks k/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/guardrails/anthropic_sse.py z$is_raw_sse_stream..sG5z%#u.Gs ")any) all_chunkss ris_raw_sse_streamrs GJG GGctdjd|D} |jdS#t$rYywxYw)Nrc3K|]=}t|ttfr%t|tr|n|jd?yw)utf-8N)r r rencoders rrz%_joined_sse_stream..s=  ec5\ *E5)u||G/DDsAAr)joindecodeUnicodeDecodeError)rraws r_joined_sse_streamr sCC zz'"" s + 77c`ddlmtfdj|DdS)Nr"AnthropicPassthroughLoggingHandlerc3K|]N}j|x9jddk(r%tjdxtrPyw)Ntype message_startmessage)_extract_sse_datagetr dict)reventr# event_datar's rrz+_anthropic_message_start..'sY @RRSXYY fv&/9jnnY&??7F  sAA)`litellm.proxy.pass_through_endpoints.llm_provider_handlers.anthropic_passthrough_logging_handlerr#next_split_sse_chunk_into_events) sse_streamr#r,r's @@@r_anthropic_message_startr1!s5  ;XXYcd    rF)restore_identitycddlm}t|}|yt|}|y|r|j dnd} |j |fdt |tr|nd}t |tsy|s|S|j d}t |tr||_ t |tr |r||_ |S#t$rYywxYw)aAssemble raw Anthropic SSE frames into a ModelResponse. ``restore_identity`` stamps the upstream message id and model onto the result, which the assembler does not carry through. It is off by default so callers that re-emit the assembled response keep the wire shape they had before this helper was shared. The writes land on a freshly built object that is unreachable from caller state until returned. rr"Nmodel)rlitellm_logging_objr4id) r-r#r r1r)"_build_complete_streaming_responser r Exceptionrr7r4)rr2r#r0r&r4 assembled message_ids rassemble_anthropic_sse_streamr<2s+:6J3J?M1A=$$W-tE=``"} $%eS1%ra  i / %))$/J*c"! %%   s'B88 CCcFdjd|jDS)zLAssistant text of a response, used to detect whether a guardrail rewrote it.r5c3K|]N}t|tr.]s@  fg & v~~--s 3 sAA)rchoicesresponses rmodel_response_textrD[s& 77&& rcVtj|}d|djfS)zAnthropic error event, for a failure discovered after the response headers were flushed. Once a keepalive ping has been sent a raise cannot reach the client, so the failure has to travel as a frame. zUevent: error data: {"type": "error", "error": {"type": "guardrail_error", "message": z}} )jsondumpsr)r'bodys ranthropic_sse_error_framesrIes4 **W%D V8 %%+VX rcddlm}ddlm}|j |}t ||j S)Nr)LiteLLMAnthropicMessagesAdapter)#FakeAnthropicMessagesStreamIteratorrB)Hlitellm.llms.anthropic.experimental_pass_through.adapters.transformationrKNlitellm.llms.anthropic.experimental_pass_through.messages.fake_stream_iteratorrL&translate_openai_response_to_anthropictuplechunks)r:rKrLanthropic_responses r"anthropic_sse_chunks_from_responserSrsF!@ A h h!i! 4>PQXX YYr)rSequence[object]returnbool)rrTrUz str | None)r0r rUzMapping[str, object] | None)rrTr2rVrUzModelResponse | None)rCrrUr )r'r rUtuple[bytes, ...])r:rrUrW)__doc__ __future__rrFcollections.abcrrtypingrlitellm.types.utilsrrrr r1r<rDrIrSrrr^s_# -6H $?D& &7;&&R  Zr