uPjw(UdZddlmZddlZddlZddlmZmZddlm Z ddl m Z ddl m Z ddlmZdd lmZmZmZdd lmZd Zd ed <ddZddZ ddZddZGdde Zy)u Post-call hook for the adaptive router. On each successful or failed completion, build a Turn from the request/response and push it through `AdaptiveRouter.record_turn`. The router then updates the in-memory bandit cell + session state and queues writes for the proxy flusher. All work happens after the response has been returned to the caller. Any exception is swallowed — signal recording must never break a request. ) annotationsN)AnyFinal)verbose_router_logger) CustomLogger)AdaptiveRouter)classify_prompt) ADAPTIVE_ROUTER_CHOSEN_MODEL_KEYADAPTIVE_ROUTER_RESPONSE_HEADERSIGNAL_GATE_MIN_MESSAGES)Turn)user_api_key_hashuser_api_key_team_iduser_api_key_user_iduser_api_key_end_user_idr_IDENTITY_FIELDSc |jdxsi}|jd}|r t|S|jdxsittr1jdxsjd}|r t|S|jdxsg}t |t krydj fdtD}|dt }|d ztj|Dcgc]%}|jd |jd d 'c}d tz}tj|jdjScc}w)uPick a stable per-conversation key for owner-cache attribution. Order: 1. Honor a client-supplied session id (`litellm_session_id` on either `litellm_params` or `litellm_params.metadata`, or `session_id` on metadata) — backward compat for callers already wired up. 2. Otherwise derive a sha256 over (identity fields, first SIGNAL_GATE_MIN_MESSAGES messages) so the key is stable across turns and only materialises once there is enough context for the bandit to act on (matching the gate in the signal-processing path). Returns None if the conversation is shorter than SIGNAL_GATE_MIN_MESSAGES. litellm_paramslitellm_session_idmetadata session_idmessagesN:c3~K|]4}ttrtj|xsdnd6yw)N) isinstancedictstrget).0frs r/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/router_strategy/adaptive_router/hooks.py z'_resolve_session_key..Gs3s]^j46PHLLO1r2VXXss:=|rolecontent)r%r&T) sort_keysdefaultzutf-8)rrrrlenr joinrjsondumpshashlibsha256encode hexdigest) kwargsrsidridentityanchormpayloadrs @r"_resolve_session_keyr7(s:#JJ'78>BN   1 2C 3x$((4:H(D!ll<(NHLL9M,N s8Ojj,2H 8}//xxsbrssH667F   **KQ RaaeeFmi0@ A R    >>'..1 2 < < >> Ss1*E cB|syt|D]}|jddk(s|jd}t|tr|cSt|trA|D]<}t|t s|jddk(s)|jdccSyy)Nr%userr&typetext)reversedrrrlistr)rmsgr&parts r"_last_user_contentr@Us !  776?f $ggi(G'3''4(#0D!$-$((62Bf2L#xx//0  c |sgSg}t|D]i}t|tsnW|jddk7rnA|jd}t |jd}|j ||dk|j |S)u3Extract the current turn's tool result payloads from the request messages. Tool results are `role == "tool"` messages that sit at the tail of the conversation — i.e. after the most recent assistant message with `tool_calls`, waiting for the model to produce a user-facing reply. Walk backwards from the end and collect the contiguous run of tool messages; stop at the first non-tool message. Each result is normalized to `{content, is_error}` — the only fields `signals._detect_failure` / `_detect_exhaustion` actually read. r%toolr&is_error)r&rD)r<rrrboolappendreverse)rresultsr>r&rDs r"_recent_tool_resultsrIfs  +-G! C#t$  776?f $ '')$ +,7AB C OO NrAc |dgfS t|ddxs|jd}|sdgfS|d}t|ddxs#t|tr|jdnd}|dgfSt|dd}|!t|tr|jd}t|dd}|!t|tr|jd}g}|xsgD]D}t|tr|j |% |j |j F||fS#t$rdgfcYSwxYw#t$r"|j t|dddd YwxYw) zSReturn (assistant_text, tool_calls_list) extracted from a ModelResponse-ish object.Nchoicesrmessager& tool_callsnamer)rN arguments)getattrr ExceptionrrrF model_dump) response_objrKr>r&raw_tool_callsrMtcs r"!_assistant_content_and_tool_callsrVs{Rx y$?^]aC {Rxc9d+G:c40'')$S,5N*S$"7..0J"V b$    b ! V!!"--/2 V J 5 Rx0 V!!72vr+BQS"TU Vs# D9D1 D.-D.1(EEc`eZdZdZddZ d d dZdZdZ d dZy) AdaptiveRouterPostCallHookzHOne hook instance per AdaptiveRouter. Registered into litellm.callbacks.c||_y)N)adaptive_router)selfrZs r"__init__z#AdaptiveRouterPostCallHook.__init__s .rANcK|jdxsi}t|tr|jtnd}|syt|iSw)u Surface the chosen logical model as the `x-litellm-adaptive-router-model` response header for both streaming and non-streaming responses. `async_post_call_success_hook` fires after the stream is fully consumed, so writing to `_hidden_params["additional_headers"]` there is too late for streaming — the StreamingResponse headers are already frozen. This hook is called during header construction (before StreamingResponse is built), so the header is included for both paths. rN)rrrr r )r[datauser_api_key_dictresponserequest_headerslitellm_call_inforchosens r"%async_post_call_response_headers_hookz@AdaptiveRouterPostCallHook.async_post_call_response_headers_hooksI$((:.4"JTU]_cJd %EFjn/88sAA cHK|j||dd{y7w)Nresponse_status)_record)r[r1rS start_timeend_times r"async_log_success_eventz2AdaptiveRouterPostCallHook.async_log_success_eventsll6<lEEEs " "cK|jd}|"|jd}| t|ddnd}|j||t|d{y7w)Nrh exception status_codeirg)rrPriint)r[r1rSrjrkstatusexcs r"async_log_failure_eventz2AdaptiveRouterPostCallHook.async_log_failure_eventsX-. >K0C9<WS-5cFll6<VlMMMsAA AA cPK |jdxsg}t|}|sy|jdxsi}|jdxsi}t|tr|jtnd}|syt |} t |\} } t|} t| xsd} t| t| tr| nd| | |}|jj||| |d{y7#t$r }tjd|Yd}~yd}~wwxYww)Nrrrr) user_contentassistant_contentrM tool_resultsrh)r model_name request_typeturnz5AdaptiveRouterPostCallHook: failed to record turn: %s)rr7rrr r@rVrIr r rrZ record_turnrQrrn)r[r1rSrhr session_keyrr current_model user_textassistant_textrMrwryrzes r"riz"AdaptiveRouterPostCallHook._records- $ h$jj4:H!5f!=K%+JJ/?$@$FBN,00<BHNXYacgNhHLL)IJnrM 1(;I)J<)X &NJ"6x"@L"1)/r"BL&5?PS5T>Z^%) / D&&22&() 3    h ! + +,cef g g hsXD&"C:D&AC::D&;A7C:2C83C:7D&8C:: D#DD&D##D&)rZrreturnNone)NN) r^dict[str, Any]r_rr`rradict[str, str] | Nonerbzdict[str, Any] | Nonerr)r1rrSrrhrprr) __name__ __module__ __qualname____doc__r\rdrlrsrirAr"rXrXsR/2637 999 9 / 9 1 9 90FN*h*h*h *h  *hrArX)r1rr str | None)rlist[dict[str, Any]] | Nonerr)rrrzlist[dict[str, Any]])rSrrtuple)r __future__rr-r+typingrrlitellm._loggingr"litellm.integrations.custom_loggerr7litellm.router_strategy.adaptive_router.adaptive_routerr2litellm.router_strategy.adaptive_router.classifierr .litellm.router_strategy.adaptive_router.configr r r /litellm.router_strategy.adaptive_router.signalsr r__annotations__r7r@rIrVrXrrAr"rsz # 2;RN A %*?Z")@ FRhRhrA