tPj">UdZddlmZddlZddlmZmZmZddlm Z ddl m Z ddl m Z ddlmZmZmZmZdd lmZdd lmZmZmZdd lmZdd lmZer dd lmZddlm Z dZ!de"d<e#e$dfZ%de"d<GddeZ&e ddGddZ'e ddGddZ(e ddGddZ)e ddGdd Z*e(e)ze*zZ+de"d!<Gd"d#eZ,Gd$d%eZ-Gd&d'eZ.Gd(d)eZ/Gd*d+eZ0d>d,Z1d?d-Z2d@d.Z3dAd/Z4dBd0Z5dCd1Z6dDd2Z7e iZ8d3e"d4<dEd5Z9e ddGd6d7Z:dFd8Z; dGd9Z<Gd:d;Z=e=Z>de"d<< dHd=Z?y)IzvSemantic ranking over the in-memory A2A agent registry, shared by GET /v1/agents?query= and the agent_search MCP tool.) annotationsN) AwaitableMappingSequence) dataclass)chain)MappingProxyType) TYPE_CHECKINGFinalProtocol TypeAlias) OpenAIError) BaseModel ConfigDictValidationError)BudgetExceededError) AgentResponse)UserAPIKeyAuth)Routerr DEFAULT_AGENT_SEARCH_TOP_K.r VectorceZdZddZy)EmbeddercyN)selftextss o/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/agent_endpoints/agent_search.py__call__zEmbedder.__call__sN)r Sequence[str]returnzAwaitable[Sequence[Vector]])__name__ __module__ __qualname__r!rr"r rrsPr"rT)frozenslotsc"eZdZUded<ded<y)AgentSearchHitragentfloatscoreNr%r&r'__annotations__rr"r r+r+s  Lr"r+ceZdZUded<y)AgentSearchHitsztuple[AgentSearchHit, ...]hitsNr/rr"r r2r2%s $$r"r2ceZdZUded<y)AgentSearchNotConfiguredstrreasonNr/rr"r r5r5* Kr"r5ceZdZUded<y)AgentSearchEmbeddingFailedr6r7Nr/rr"r r:r:/r8r"r:AgentSearchOutcomecLeZdZUeddZdZded<dZded<dZd ed <y ) _SearchableSkillTignorer(extrar6name descriptionrztuple[str, ...]tagsN) r%r&r'r model_configrBr0rCrDrr"r r=r=7s+T:LD#NKD/r"r=c>eZdZUeddZdZded<dZded <y ) _SearchableCardTr>r?rAr6rCrtuple[_SearchableSkill, ...]skillsN)r%r&r'rrErCr0rIrr"r rGrG?s#T:LK+-F (-r"rGc,eZdZUeddZded<y)_EmbeddingItemTr>r?ztuple[float, ...] embeddingNr%r&r'rrEr0rr"r rKrKFsT:L  r"rKc,eZdZUeddZded<y)_EmbeddingDataTr>r?ztuple[_EmbeddingItem, ...]dataNrMrr"r rOrOLsT:L $$r"rOcReZdZUedZded<ded<ded<ded<d ed <y ) AgentSearchResultT)r(r6agent_id agent_namerCrHrIr-r.NrMrr"r rRrRRs'T*LMO (( Lr"rRct tj|jS#t$r tcYSwxYwr)rGmodel_validateagent_card_paramsr)r,s r _searchable_cardrX\s6!--e.E.EFF !  !s !77cdjd|j|jdj|jfDS)N c3&K|] }|s| ywrr.0parts r z_skill_text..dscT^bDc)joinrBrCrD)skills r _skill_textrccs5 88cejj%2C2CSXXejjEY%Zc ccr"ct|}td|jD}djd|j|j g|DS)Nc32K|]}t|ywr)rc)r]rbs r r_z$agent_search_text..isKe{51K c3&K|] }|s| ywrrr\s r r_z$agent_search_text..jsad\`Tar`)rXtuplerIrarTrC)r,card skill_liness r agent_search_textrlgsK"5)DKt{{KKK 99au'7'79I9I&XK&Xa aar"ct|j}t|jj|jj|j |j |jS)N)rSrTrCrIr.)rXr,rRrSrTrCrIr.)hitrjs r agent_search_resultromsN"399-D ##99''$${{ii  r"ctdt||dD}tjtd|Dtjtd|Dz}|r||z SdS)Nc3,K|] \}}||zywrr)r]abs r r_z$cosine_similarity..ysEtq!QUEsTstrictc3&K|] }||z ywrr)r]rrs r r_z$cosine_similarity..zs 51Q 5c3&K|] }||z ywrr)r]rss r r_z$cosine_similarity..zsF\QRq1uF\rwg)sumzipmathsqrt)leftrightdotnormss r cosine_similarityrxs_Es4t'DEEC99S 5 5563F\V[F\C\9]]E3;(S(r"cPddlm}i|j|d|jiS)Nr)LiteLLMProxyRequestSetup user_api_key)$litellm.proxy.litellm_pre_call_utilsr'get_sanitized_user_information_from_keyapi_key)user_api_key_dictrs r embedding_spend_metadatar~s4M  " J JK\ ] )11 r"cdfd }|S)NcKt|}j|td{}tdtj |j jDS7Aw)N)modelinputmetadatac34K|]}|jywr)rL)r]items r r_z1router_embedder..embed..sjT^^js)list aembeddingrrirOrV model_dumprP)rbatchresponseembedding_modelrouterrs r embedzrouter_embedder..embedsjE{ & 1 1!9QRc9d!2!  j0M0MhNaNaNc0d0i0ijjj s,A3A1AA3)rr#r$zSequence[Vector]r)rrrrs``` r router_embedderrsk Lr"zFinal[Mapping[str, Vector]] _NO_VECTORScK t||d{}t |t |k7r%t dt |dt |dS|S7F#tttf$r}t d|cYd}~Sd}~wwxYww)Nz#embedding the search query failed: r7zembedding model returned z vectors for z inputs)rir ValueErrorrr:len)rrvectorsexcs r _embed_allrs^U5\12 7|s5z!).s7|nM#e*U\]   N 2 %8 9^)3VWZV[1\]]^sCB AAA>B AB 1B?B B B  B c"eZdZUded<ded<y) _Embeddedr query_vectorMapping[str, Vector]rNr/rr"r rrs !!r"rc0tfd|DS)Nc3RK|]}t|tk( ywr)r)r]textrrs r r_z"_same_dimension..s$I4s74=!S%66Is$')all)rrrs`` r _same_dimensionrs I5I IIr"c ^Kttjfd|D}t||g|d{}t |t r|St ttjt||ddd}t|d||rt|d|Sttj|}t||g|d{}t |t r|St|dt tt||dddS77Iw)Nc3,K|] }|vs| ywrr)r]rcacheds r r_z*_embed_query_and_agents..s(V$4vCU(Vs Trtr)rr) ridictfromkeysr isinstancer:r ritemsrzrr) rqueryrrmissingembeddedrunique reembeddeds ` r _embed_query_and_agentsrs4==(V%(VVWG&uu.?w.?@@H(67%d5WhWXWYlcgAh+i&jkGx{GU3hqk7CC$--./F(0@0@AAJ*89 ],.sJ%.u5Jrfzembedding model z% returned vectors of mixed dimensionsrc 3K|]5\}}t|tjj|7yw))r,r.N)r+rrr)r]r,rrs r r_z*AgentSearchIndex.search..sB E4U2CHDYDY[c[k[klp[q2rss s;>Trtc|jSr)r.)rns r z)AgentSearchIndex.search..s CIIr")keyreverse)r2rirrrrrr:rrrr rsortedrz) rragentstop_krrrrrankedrs @r searchzAgentSearchIndex.searchs"+ +J6JJ ))/;G 7ueV TT h : ;Ox44h6F6FN-)/)::_` ))tDMM)t?DLLYhjrLs)tu  #&vuT#B &  E&%.$9::!UsAD D B4D N)r$None)rr6rrr$r) rr6rSequence[AgentResponse]rintrrrr6r$z,AgentSearchHits | AgentSearchEmbeddingFailed)r%r&r'__doc__rrrrr"r rrsEqQ>;;"9;BE;NV;il; 5;r"rglobal_agent_search_indexc K| tdS| tdS|j|||t||||d{S7w)Nzjagent search needs litellm_settings.agent_search_embedding_model set to an embedding model from model_listrzDagent search needs a model_list so the embedding model can be called)r5rr)rrrrrindexrs r search_agentsrsb'  ~'/uvv vuofoGXY[j  sAA AA )r,rr$rG)rbr=r$r6)r,rr$r6)rnr+r$rR)r}rr~rr$r-)rrr$zdict[str, object])rrrr6rrr$r)rrrr#r$z/tuple[Vector, ...] | AgentSearchEmbeddingFailed)rrrrrr#r$bool) rrrr6rr#rrr$z&_Embedded | AgentSearchEmbeddingFailed)rr6rrrrrz Router | Nonerz str | Nonerrrrr$r;)@r __future__rr{collections.abcrrr dataclassesr itertoolsrtypesr typingr r r r openairpydanticrrrlitellm.exceptionsrlitellm.types.agentsrlitellm.proxy._typesrlitellm.routerrrr0rir-rrr+r2r5r:r;r=rGrKrOrRrXrcrlrorrrrrrrrrrrrr"r rs7|" 88!"<<;;2.3%$%E%%*% %QxQ $d#$  $d#%%$% $d#$ $d#$!02J JMg gIgy.i.!Y! %Y%  !db ) ,