tPjy/ dZddlZddlmZmZddlmZmZddlmZddl m Z ddl m Z ddl mZmZGd d Z dd ed ed eedzdefdZy)z> Response Polling Handler for Background Responses with Cache N)datetimetimezone)AnyFinal)verbose_proxy_logger)uuid4) RedisCache)ResponsesAPIResponseResponsesAPIStatusc+eZdZdZdZdZd'dedzdefdZe de fd Z e d e de fd Z e d e de fd Zd e dee efdefdZ d(d e dedzdedzdedzdedzdedzdedzdedzdedzde dzde dzdedzdedzdedzde dzdedzde dzd e dzd!e dzd"e dzddf*d#Zd e dee efdzfd$Zd e de fd%Zd e de fd&Zy))ResponsePollingHandlerz0Handles polling-based responses with Redis cachezlitellm:polling:response: litellm_poll_N redis_cachettlc ||_||_yN)rr)selfrrs s/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/response_polling/polling_handler.py__init__zResponsePollingHandler.__init__s&returnc2|jtS)z4Generate a unique UUID for polling with clear prefix)POLLING_ID_PREFIXr)clss rgenerate_polling_idz*ResponsePollingHandler.generate_polling_ids''( 22r response_idc8|j|jS)z&Check if a response_id is a polling ID) startswithr)rrs r is_polling_idz$ResponsePollingHandler.is_polling_ids%%c&;&;<w)a Update the polling state in Redis Uses OpenAI Response object format with native status types: https://platform.openai.com/docs/api-reference/responses/object Args: polling_id: Unique identifier for this polling request status: OpenAI ResponsesAPIStatus value usage: Usage information error: Error dict (automatically sets status to "failed") incomplete_details: Details for incomplete responses reasoning: Reasoning configuration from response.completed tool_choice: Tool choice configuration from response.completed tools: Tools list from response.completed output: Full output list to replace current output model: Model identifier instructions: System instructions temperature: Sampling temperature top_p: Nucleus sampling parameter max_output_tokens: Maximum output tokens previous_response_id: ID of previous response in conversation text: Text configuration truncation: Truncation setting parallel_tool_calls: Whether parallel tool calls are enabled user: User identifier store: Whether to store the response Nz(No cached state found for polling_id: %sr+r-r.failedr=r>r?r@rArBrCrDrErFrGrHrIrJrKrLr/z8Updated polling state for %s: status=%s, output_items=%s) rr#async_get_cacherwarningjsonloadsr7dumpsrlenr6r9)rr r+r.r=r>r?r@rAr-rBrCrDrErFrGrHrIrJrKrLr; cached_statestate output_counts r update_statez#ResponsePollingHandler.update_stateTsh --j9 %)$4$4$D$DY$OO  ( ()SU_ ` zz,/ $E(O  $E(O "E'N &E(O"E'N *E' (   E&M  "E'N..**U#/   "%))Hb"9: "" F TYZbTceq KP| s#=E;E6C:E;:E9;rsl '12Niid04 DD  D !I, D Dr