tPj<UdZddlmZddlZddlmZmZddlmZddl m Z m Z ddl m Z ddlmZdd lmZerdd lmZd Zd ed <dezZd ed<dZd ed<dZd ed<dZd ed<dZd ed<dZd ed<Gdde ZeeedfZd ed<GddZd!d Z y)"a Live proxy worker census, one row per worker process. Every uvicorn worker upserts its own row on a fixed heartbeat, so counting rows with a recent heartbeat answers "how many workers share this database?" without any coordination. The Admin UI's "no Redis" banner uses that count to hide itself for deployments that are provably a single worker, where per-worker rate limits, budgets, and router state are already global. All timestamps are written and compared with the database's own clock, so pods with skewed clocks still agree. ) annotationsN) TYPE_CHECKINGFinal) TypeAdapter)ReadOnly TypedDict)verbose_proxy_logger)uuid)RoutingPrismaWrapper) PrismaClient<r'PROXY_WORKER_HEARTBEAT_INTERVAL_SECONDS$PROXY_WORKER_LIVENESS_WINDOW_SECONDSiSTALE_ROW_RETENTION_SECONDSz INSERT INTO "LiteLLM_ProxyWorkerHeartbeat" (worker_id, hostname, last_heartbeat_at) VALUES ($1, $2, NOW()) ON CONFLICT (worker_id) DO UPDATE SET last_heartbeat_at = NOW() BEAT_SQLzh DELETE FROM "LiteLLM_ProxyWorkerHeartbeat" WHERE last_heartbeat_at < NOW() - make_interval(secs => $1) PRUNE_SQLz SELECT COUNT(*)::int AS live_workers FROM "LiteLLM_ProxyWorkerHeartbeat" WHERE last_heartbeat_at > NOW() - make_interval(secs => $1) COUNT_SQLzA DELETE FROM "LiteLLM_ProxyWorkerHeartbeat" WHERE worker_id = $1 DEREGISTER_SQLceZdZUded<y)_LiveWorkerCountRowz ReadOnly[int] live_workersN)__name__ __module__ __qualname____annotations__l/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/db/proxy_worker_heartbeat.pyrr5srr._COUNT_ROWS_ADAPTERc&eZdZdddZddZddZy)ProxyWorkerHeartbeatNc||_|xsttj|_t j |_yN) prisma_clientstrr uuid4 worker_idsocket gethostnamehostname)selfr%r(s r__init__zProxyWorkerHeartbeat.__init__=s1$1%.%C#djjl2C%113 rchK |jjjt|j|j d{|jjjt td{y7;7#t$r }tjd|Yd}~yd}~wwxYww)Nz'Proxy worker heartbeat write failed: %s) r%db execute_rawrr(r+rr Exceptionr debug)r,beat_errs rbeatzProxyWorkerHeartbeat.beatBs \$$''33Hdnndmm\ \ \$$''33I?Z[ [ [ ] [ \ & &'PRZ [ [ \sSB2ABB5B<B=BB2BB B/B*%B2*B//B2cK |jjjt|jd{y7#t $r }t jd|Yd}~yd}~wwxYww)Nz,Proxy worker heartbeat deregister failed: %s)r%r/r0rr(r1r r2)r,deregister_errs r deregisterzProxyWorkerHeartbeat.deregisterIsX g$$''33NDNNS S S g & &'UWe f f gs>A/7AAAA/A A, A'"A/'A,,A/r$)r%r r(z str | NonereturnNone)r8r9)rrrr-r4r7rrrr"r"<s4 \grr"c6K |j}t|tr |jn|}|j t t d{}tj|ddS7#t$r }tjd|Yd}~yd}~wwxYww)z The number of workers with a recent heartbeat, or None when the database cannot answer. Callers must treat None as "unknown", not as zero. Always counts on the primary: a lagging read replica must never undercount. Nrrz'Live proxy worker count unavailable: %s) r/ isinstancer writer query_rawrrr validate_pythonr1r r2)r%r/ primary_dbrows count_errs rcount_live_proxy_workersrBPs !$$)3B8L)MBIISU &00<`aa"2248;NKKb ""#LiXsABAA- A+ A-*B+A-- B6B BBB)r%r r8z int | None)!__doc__ __future__rr)typingrrpydanticrtyping_extensionsrrlitellm._loggingr litellm._uuidr 'litellm.proxy.db.routing_prisma_wrapperr litellm.proxy.utilsr rrrrrrrrrtupler r"rBrrrrMs # ' 11H013'3./2Y.Y$eY%)U)%  5  5   ) )/BC/G)HIUIgg( r