uPjU}UdZddlZddlZddlZddlmZmZmZddlm Z ddl m Z m Z m Z mZmZddlZddlmZmZddlmZddlmZdd lmZdd lmZdd lmZmZdd lm Z dd l!m"Z"e r,ddl#m$Z%ddl#m&Z'ddl(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0ddl1m+Z2ddl1m3Z4dZ5dZ6e dze7d< ddl#m$Z$m&Z&m8Z8m9Z9ddl:m;Z6ddl(m*Z*m+Z+m,Z,mm?Z?m@Z@mAZAddlBmCZCmDZDddlEmFZFe?ZGe e7d<deeHeIfdeJdeJd dfd!ZKdeeHeIfd"eHdzd dfd#ZLd$ZMe e7d%<deeHeIfd&eeHeIfd dfd'ZNd(d)deeHeIfd eHfd*ZOd(d)d ed+fd,ZP dQd-d.d/eId0eHdzd&eQeHeIfd1eQeHeHfdzd e f d2ZRd(d)d ed3fd4ZSdRd5ZTd6d7d8eHeJzd d9fd:ZUdSd<ZVd(d)d-d.d=ed+d>eHdzd0eHdzd?eHdzd d;fd@ZWd(d)d-dAd edBfdCZXd(d)d-dAd=ed+d>eHdzd0eHdzd?eHdzd edBfdDZYe" dTd(ed)d-ed.d0eHdzd&eQeHeIfdzd"eHdzd1eQeHeHfdzdeId e fdEZZe"d(d)d-d.de d e eeIeIe fzfdFZ[d-dAd?eHd"eHdzd&eQeHeIfdzdGeQeHeIfdzdHeQeHeIfdzd efdIZ\ dUd(ed)d-edAd0eHdzd&eQeHeIfdzd"eHdzdGeQeHeIfdzdHeQeHeIfdzd1eQeHeHfdzdeId ee fdJZ]eddfdKeHdLe^dMeQeHeHfdzdNe_d d)f dOZ`edfdKeHdLe^dMeQeHeHfdzd d+fdPZay#e=$r dZ$dZ&dZ8dZ9YwxYw)Vzs LiteLLM A2A SDK functions. Provides standalone functions with @client decorator for LiteLLM logging integration. N) AsyncIterator CoroutineMapping) ModuleType) TYPE_CHECKINGAnyFinalOptionalcast)verbose_loggerverbose_proxy_logger)A2AStreamingIterator)A2ARequestUtils)DEFAULT_A2A_AGENT_TIMEOUT)Logging)get_async_httpx_clienthttpxSpecialProvider)LiteLLMSendMessageResponse)client)Client)ClientCallContext) AgentCardMessageSendMessageRequestSendMessageResponseSendStreamingMessageRequestSendStreamingMessageResponse#SendStreamingMessageSuccessResponseTask)r)StreamResponseF_a2a_conversions)rr ClientConfig create_client conversions)rrrSendMessageSuccessResponserrrT)LiteLLMA2ACardResolverget_agent_card_urlnormalize_agent_card_interfaces)handle_a2a_localhost_retrymap_a2a_exception)A2ALocalhostURLErrorA2ACardResolverkwargs prompt_tokenscompletion_tokensreturnc|jd}t|tr+tj||||z}||j d<yy)z Set usage on litellm_logging_obj for standard logging payload. Args: kwargs: The kwargs dict containing litellm_logging_obj prompt_tokens: Number of input tokens completion_tokens: Number of output tokens litellm_logging_obj)r/r0 total_tokensusageN)get isinstancerlitellmUsagemodel_call_details)r.r/r0r3r5s ^/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/a2a_protocol/main.py_set_usage_on_logging_objr<XsU"(,A!B%w/}}'/&)::  ;@..w7 0agent_idcl|y|jd}t|tr||jd<yy)z Set agent_id on litellm_logging_obj for SpendLogs tracking. Args: kwargs: The kwargs dict containing litellm_logging_obj agent_id: The A2A agent ID Nr3r>)r6r7rr:)r.r>r3s r;_set_agent_id_on_logging_objr@os>!',A!B%w/=E..z:0r=)cost_per_queryinput_cost_per_tokenoutput_cost_per_token_A2A_COST_PARAM_KEYSlitellm_paramsc |jd}t|tsytDcic]}|j||||}}|syi|jjdxsi||jd<ycc}w)a] Merge the agent's pricing params into model_call_details["litellm_params"] so A2ACostCalculator can read them. The non-streaming path reuses the proxy-built logging object, whose litellm_params already carries metadata / proxy_server_request / user-key context, so merge the pricing keys in rather than replacing the dict. r3NrE)r6r7rrDr:)r.rE logging_objkey cost_paramss r;"_set_litellm_params_on_logging_objrJs $9:K k7 +-A%(NDVDVWZD[Dg^C  K 8  ) ) - -.> ? E28 8K""#34 s BB a2a_client A2AClientTypecd}t|}|t|ddxsd}d|}d}|jd}t|tr,||_||_||jd<||jd<|S)z Extract agent info and set model/custom_llm_provider for cost tracking. Sets model info on the litellm_logging_obj if available. Returns the agent name for logging. unknownname a2a_agent/ a2a_agentr3modelcustom_llm_provider)_get_a2a_client_agent_cardgetattrr6r7rrRrSr:)rKr. agent_name agent_cardrRrSr3s r;_get_a2a_model_inforXsJ2:>JZ;Hy  |,E!,"(,A!B%w/$)!2E/:?..w7H[../DE r=rcttdt|dd}||Sttdt|dd}||Sttdt|ddS)Nr_litellm_agent_cardrW_card)r r rU)rKrWs r;rTrTskh{+WZAVX\-]^Jh{+WZt-TUJ %wz7D'I JJr=requestrrSapi_baseagent_extra_headerscKtjd||ddlm}t |j dr|j j dnt|j }|jt|j||||d{}tj|t|j S7.w) z Route a send_message through the LiteLLM completion bridge (e.g. LangGraph, Bedrock AgentCore). Requires request; api_base is optional for providers that derive endpoint from model. z5A2A using completion bridge: provider=%s, api_base=%srA2ACompletionBridgeHandler model_dumpjsonmode request_idparamsrEr]r^Nrg) r info6litellm.a2a_protocol.litellm_completion_bridge.handlerrahasattrrhrbdicthandle_non_streamingstridr from_dict)r\rSr]rEr^rarh response_dicts r;#_send_message_via_completion_bridgerssOQdfno8?w~~|7\W^^ & &F & 3bfgngugubvF!;!P!Pwzz?%/ "Q"M & / / #gjj/ ZZsBCC/CA2ACallContextTypect|ddS)N_litellm_call_context)rU)rKs r;_get_a2a_call_contextrws :6 ==r=c0ddlm}|j|S)Nrr$)a2a.compat.v0_3r%to_core_send_message_request)r\r%s r;_to_core_send_message_requestr{s+  3 3G <JJ!..zCXYcCd.ee eVWW5jWZZXM!((F fwo . B    'zz  s);B>A A A B> A  A3B>rWcard_urlrVc Kd}tdD]} t||d{}n| td|S7#t$r1}t|||dd{7}|r t |nd}Yd}~ad}~wt $re} t ||||nJ#t$r5} t| ||dd{7}|r t |nd}Yd} ~ Yd}~d} ~ wt $rwxYwYd}~d}~wwxYww)z>Send an A2A message with retry logic for localhost URL errors.NFerrorrWrK is_streamingrRzCA2A send_message failed: no response received after retry attempts.)rangerr,r*r( Exceptionr+r) rKr\rWrr]rV a2a_response_e localhost_errs r;_execute_a2a_send_with_retryrs L 1X !.z7!CCL 4`aa 5D# N9%%"  J :D)*5H  !!XxzJ' #='))!& $ >H-j9T  K sC%<:<C%< C"A1AA1,C%1 C">B C CC)B, *C>CC%CCC%C""C%rrcKt tdtj|}|j|t |23d{}t ||j }t|07+6yw)z@Stream message events via a2a-sdk 1.x and yield JSON-RPC chunks.Nrrrir)r!rrzrrwrrpr)rKr\rr| compat_chunks r;_stream_messagesr@s| j  1A0]0]^e0fJ!..zCXYcCd.e>>e1%GJJO * ==>es*AA9A7 A5 A7 (A95A77A9c Kd}d}tdD]} t||23d{} d}| |s tdy76d}y#t$r4} |rt| ||dd{7}|r t |nd}Yd} ~ od} ~ wt $rZ} |r t | |||#t$r5} t| ||dd{7}|r t |nd}Yd} ~ Yd} ~ d} ~ wwxYwd} ~ wwxYww)z@Stream an A2A message with retry logic for localhost URL errors.FrNTrrzMA2A send_message_streaming failed: no response received after retry attempts.)rrr,r*r(rr+r) rKr\rWrr]rVresponse_startedstream_succeededrchunkrrs r;_execute_a2a_stream_with_retryrOs1 1X  / GD  e#'  B jkk ? D $  # 9%%!  J :D)*5H   !!XxzJ ( #='))!% $ >H-j9T   sC* A AAA A C*AA C* C'B'A*(B<C* C' C"B! C"! C*C<B? =CC"C*CC""C''C*cK|xsi}|jd}|r t|ddnd}|jd} | r%| tdt|| |||d{S| td|a| td|xst t j }d |i} |r|| d <|r| j|t|| d{}|Jt||} tjd |j| t|} | r t| nd} t||| | || d{}tjd|jt!j"|t |j}|j$j'dd}t)j*||\}}}t-|||t/||t1|||S777w)as Async: Send a message to an A2A agent. Uses the @client decorator for LiteLLM logging and tracking. If litellm_params contains custom_llm_provider, routes through the completion bridge. Args: a2a_client: An initialized a2a.client.A2AClient instance (optional if using completion bridge) request: SendMessageRequest from a2a.types (optional if using completion bridge with api_base) api_base: API base URL (required for completion bridge, optional for standard A2A) litellm_params: Optional dict with custom_llm_provider, model, etc. for completion bridge agent_id: Optional agent ID for tracking in SpendLogs **kwargs: Additional arguments passed to the client decorator Returns: LiteLLMSendMessageResponse (wraps a2a SendMessageResponse with _hidden_params) Example (standard A2A): ```python from litellm.a2a_protocol import asend_message, create_a2a_client from a2a.types import SendMessageRequest, MessageSendParams from uuid import uuid4 a2a_client = await create_a2a_client(base_url="http://localhost:10001") request = SendMessageRequest( id=str(uuid4()), params=MessageSendParams( message={"role": "user", "parts": [{"kind": "text", "text": "Hello!"}], "messageId": uuid4().hex} ) ) response = await asend_message(a2a_client=a2a_client, request=request) ``` Example (completion bridge with LangGraph): ```python from litellm.a2a_protocol import asend_message from a2a.types import SendMessageRequest, MessageSendParams from uuid import uuid4 request = SendMessageRequest( id=str(uuid4()), params=MessageSendParams( message={"role": "user", "parts": [{"kind": "text", "text": "Hello!"}], "messageId": uuid4().hex} ) ) response = await asend_message( request=request, api_base="http://localhost:2024", litellm_params={"custom_llm_provider": "langgraph", "model": "agent"}, ) ``` r3litellm_trace_idNrS)request is required for completion bridge)r\rSr]rEr^request is required?Either a2a_client or api_base is required for standard A2A flowX-LiteLLM-Trace-IdX-LiteLLM-Agent-Id)base_url extra_headersz(A2A send_message request_id=%s, agent=%srKr\rWrr]rVz)A2A send_message completed, request_id=%srircT)re exclude_none)r\rr)r.r/r0)r.rEr.r>)r6rU ValueErrorrsrouuiduuid4updatecreate_a2a_clientrXr rjrprTr(rrfrom_a2a_responserrbr%calculate_usage_from_request_responser<rJr@)rKr\r]rEr>r^r.rGtrace_idrSrrVrWrrresponserrr/r0rs r; asend_messagers&|$)rN$9:KALw{$6=RVH!/!3!34I!J ?HI I8 3) 3    .//  ^_ _0s4::<00Dh/O 2:M. /   !4 5,hm\\   !! !+J?JBGJJPZ[3:>J8B(4H < !LCWZZP1BB<\_`g`j`j\klH/;.?.?.J.JPVei.J.jM ==#   #+'f^T!B OU .]s9AG+G#A/G+G&A#G+2G)3B1G+&G+)G+c tj}|td||d|Stjtd||d|S#t$rd}Y>wxYw)a Sync: Send a message to an A2A agent. Uses the @client decorator for LiteLLM logging and tracking. Args: a2a_client: An initialized a2a.client.A2AClient instance request: SendMessageRequest from a2a.types **kwargs: Additional arguments passed to the client decorator Returns: LiteLLMSendMessageResponse (wraps a2a SendMessageResponse with _hidden_params) N)rKr\)asyncioget_running_looprrrun)rKr\r.loops r;rrsg&'') N GNvNN{{=ZJZSYZ[[ sA AAmetadataproxy_server_requestc tjj}d|}t|dddgdd|t|jt|j}||_d|_||jd <d|jd <|j|jd <|r||jd <|r|jni} |r|| d <|r|| d<| |_ | |_ | |jd<|xsi|jd <|S)z0Build logging object for streaming A2A requests.rPuserzstreaming-request)rolecontentFasend_message_streaming)rRmessagesstream call_type start_timelitellm_call_id function_idrQrRrSrr>rrrE) datetimenowrrorprRrSr:rcopyrEoptional_params) r\rVr>rErrrrRrG_litellm_paramss r;_build_streaming_logging_objr1s !))--/J |,E !.ABC+GJJ OKK&1K#.3K""7+|jrt|jntt!j"}d|i}|r||d<|r|j%|t'||dd{}|Jt)||}|t+||||||}tjd|j|t-|}|r t/|nd}t1||||||}t3||t5||||23d{} | 7m6y776yw)a Async: Send a streaming message to an A2A agent. If litellm_params contains custom_llm_provider, routes through the completion bridge. Args: a2a_client: An initialized a2a.client.A2AClient instance (optional if using completion bridge) request: SendStreamingMessageRequest from a2a.types api_base: API base URL (required for completion bridge) litellm_params: Optional dict with custom_llm_provider, model, etc. for completion bridge agent_id: Optional agent ID for tracking in SpendLogs metadata: Optional metadata dict (contains user_api_key, user_id, team_id, etc.) proxy_server_request: Optional proxy server request data Yields: SendStreamingMessageResponse chunks from the agent Example (completion bridge with LangGraph): ```python from litellm.a2a_protocol import asend_message_streaming from a2a.types import SendStreamingMessageRequest, MessageSendParams from uuid import uuid4 request = SendStreamingMessageRequest( id=str(uuid4()), params=MessageSendParams( message={"role": "user", "parts": [{"kind": "text", "text": "Hello!"}], "messageId": uuid4().hex} ) ) async for chunk in asend_message_streaming( request=request, api_base="http://localhost:2024", litellm_params={"custom_llm_provider": "langgraph", "model": "agent"}, ): print(chunk) ``` rSNrz2A2A streaming using completion bridge: provider=%srr`rbrcrdrfrr3rrrrT)rr streaming)r\rVr>rErrz2A2A send_message_streaming request_id=%s, agent=%srr)rr\rGrV)r6rr rjrkrarlrhrbrmhandle_streamingrorpr7rrUrrrrrXrrTr(rr@r)rKr\r]rEr>rrr^r.rSrarhr_raw_logging_objrGlogging_trace_idrrrVrWrrs r;rr\s}`$)rN!/!3!34I!J ?HI I PRef 7>gnnl6[GNN % %6 % 2aefmftftau 6FF7::) 3 G   %K.//$jj)>?6@AQSZ6["2aeK  ^_ _T_'+7I4"Pei*d'**s7::RUVZV`V`VbRc0Dh/O 2:M. /   !4 5,'   !! !+J?J2!)!5  LgjjZde2:>J8B(4H2 F!B+ e  I   $ Hs\B3H15H)9H&:H)=C H1H+BH1H/H-H/H1&H))H1-H//H1rtimeoutrrc2Kts tdtjd|t t j d|i}|j}|r-tjdt|jt||}t|j|rd|ind d{}t|t!||  d{}||_|r t%| nd|_||_tjd ||S7c7Aw)a Create an A2A client for the given agent URL. This resolves the agent card and returns a ready-to-use A2A client. The client can be reused for multiple requests. Args: base_url: The base URL of the A2A agent (e.g., "http://localhost:10001") timeout: Request timeout in seconds (default: ``DEFAULT_A2A_AGENT_TIMEOUT`` / env ``DEFAULT_A2A_AGENT_TIMEOUT``) extra_headers: Optional additional headers to include in requests Returns: An initialized a2a.client.A2AClient instance Example: ```python from litellm.a2a_protocol import create_a2a_client, asend_message # Create client once client = await create_a2a_client(base_url="http://localhost:10001") # Reuse for multiple requests response1 = await asend_message(a2a_client=client, request=request1) response2 = await asend_message(a2a_client=client, request=request2) ``` rzCreating A2A client for %sr llm_providerrhz(A2A client created with extra_headers=%s httpx_clientrheadersN) http_kwargs)rr) client_config)service_parameterszA2A client created for %s)A2A_SDK_AVAILABLErr rjrr A2AProviderrr debuglistkeysr-r)get_agent_cardr#r"_litellm_httpx_clientrrvrZ) rrrr_async_handlerrresolverrWrKs r;rrs"@  j  4h?2)557#N)//L""#MtTaTfTfThOij%<(SH7%%P]9m2Lcg%hhJ,"% J(4J$  ]; $ &0J"3X> / is%B-D/D0#DDADDcdKts tdtjd|t t j d|i}|j}t||}|jd{}tjdt|dr|j|Sd |S7:w) a Fetch the agent card from an A2A agent. Args: base_url: The base URL of the A2A agent (e.g., "http://localhost:10001") timeout: Request timeout in seconds (default: ``DEFAULT_A2A_AGENT_TIMEOUT`` / env ``DEFAULT_A2A_AGENT_TIMEOUT``) extra_headers: Optional additional headers to include in requests Returns: AgentCard from the A2A agent rzFetching agent card from %srrrNzFetched agent card: %srOrN) rrr rjrrA2Arr-rrlrO)rrr http_handlerrrrWs r;aget_agent_cardr2s  j  5x@1)--7#L'--L%!H'5577J0WZY_E`*//p gpp 8sA1B03B.4;B0)N)r\rr1CoreSendMessageRequest)rKrLr\rr1r)NNNNNN)NNNNNNNN)b__doc__rrrcollections.abcrrrtypesrtypingrrr r r r8litellm._loggingr r 'litellm.a2a_protocol.streaming_iteratorrlitellm.a2a_protocol.utilsrlitellm.constantsr*litellm.litellm_core_utils.litellm_loggingr&litellm.llms.custom_httpx.http_handlerrrlitellm.types.agentsr litellm.utilsr a2a.clientrrLrrta2a.compat.v0_3.typesrrrrrrrra2a.types.a2a_pb2rr r}rr!__annotations__r"r#ryr%r&r"litellm.a2a_protocol.card_resolverr'r(r),litellm.a2a_protocol.exception_mapping_utilsr*r+litellm.a2a_protocol.exceptionsr,r-roobjectintr<r@rDrJrXrTrmrsrwr{rrrrrrrrrfloatboolrrrr=r;rs7   ==<<AH67>< 2B   OF&**t#*QQ? A0/@ CK @@@ @.F CK FDjF F(bea CK CK( 8OWS&[=QVY:K?Kx ?TK26 [ ![[Dj[f% [ c3h$. [  [>>o>(CW:X>= O O-03YO*O:&& !&%&Dj & Dj & d &&R > >*G >12 >-l-l *-l%-lDj -l Dj -l d -l12-l`,0.2/315 P)P * +PDjPf%, P Dj P c3h$. PP PPf\\ !\\ )FFD(H H  HZ/+/%% %S>D(% %a FLM s!&K K"!K"