tPjhUdZddlZddlZddlmZmZddlmZddlmZm Z ddl m Z m Z ddl mZddlmZdd lmZmZed Zeedzed <ed Zeedzed <eej0 Zeed <e eZeed<GddeZGddeZGddeZGdde Zdede efdZ!defdZ"de#fdZ$dedefdZ%dedzde efdZ&y) z* Helper functions to query prometheus API N)datetime timedelta)Final) BaseModel TypeAdapter)ReadOnly TypedDict) get_secret)verbose_logger)get_async_httpx_clienthttpxSpecialProviderPROMETHEUS_URLPROMETHEUS_SELECTED_INSTANCE) llm_providerasync_http_handler_RAW_JSON_PAYLOADc@eZdZUdZeeefed<ee e efed<y)PrometheusRangeSamplez7One ``matrix`` series of the Prometheus HTTP query API.metricvaluesN) __name__ __module__ __qualname____doc__dictstrobject__annotations__listtuplefloat{/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/integrations/prometheus_helpers/prometheus_api.pyrrs(A f  ucz" ##r#rceZdZUeeed<y)PrometheusQueryDataresultN)rrrrrrr"r#r$r&r&"s & ''r#r&ceZdZUeed<y)PrometheusQueryResponsedataN)rrrr&rr"r#r$r)r)&s r#r)c.eZdZUeeed<eeed<y)PrometheusDailySpenddatespendN)rrrrrrr!r"r#r$r,r,*s 3- E?r#r, metric_namereturncKt td|d}ttj}tj td||dd{}t j|j}tjd|tj|jj}|S7hw)N=PROMETHEUS_URL not set please set 'PROMETHEUS_URL=<>' in .envz[24h]z /api/v1/query)querytimeparams+json response from prometheus /query api %s)r ValueErrorintr4rgetrvalidate_pythonjsonr debugr)model_validater*r')r/r3nowresponse_json_responseresultss r$get_metric_from_prometheusrC/sXYY!]%(ETYY[!C.22  -(5#1N3H.==hmmoNNFW,;;NKPPWWG N sACCA)Cc Kd}ddg}|D]}t|d{}|rtjd||D]}tjd||j}|j}|d}t |j d t k7rUtt|d }|j d d } |j d d } |d|d| d| dz }|dz }tjd||S7ޭw)zE Gets fallback metrics from prometheus for the last 24 hours -litellm_deployment_successful_fallbacks_total)litellm_deployment_failed_fallbacks_total)r/Nzresponse json %sz result= %srinstance primary_modelUnknownfallback_model`z3 successful fallback requests` with primary model=`z` -> fallback model=` zresponse message %s) rCr r=rrrr:r9r!) response_messagerelevant_metricsr response_jsonr' metric_labels metric_valuesmost_recent_valuevaluerJrLs r$#get_fallback_metric_from_prometheusrVAsS73#F8     !3] C' )$$\6: & & $1!$4!/;$((48TT E"3A"678 - 1 1/9 M !.!2!23CY!O aw.aboapqFGUFVVW%XX  D(  ) 24DE-F. - sC>C<CC>ctyy)NTF)rr"r#r$is_prometheus_connectedrXds! r#rUc0tj|dS)aRender ``value`` as a PromQL double-quoted string literal. PromQL string literals follow Go's escape rules (https://prometheus.io/docs/prometheus/latest/querying/basics/): a backslash begins an escape sequence and a bare ``"`` ends the literal. Without escaping, callers that accept arbitrary user-supplied values (like the ``api_key`` filter on ``/global/spend/logs``) can inject extra label matchers or selectors and read cross-tenant metrics. JSON's quoting rules are a strict subset of Go's, so ``json.dumps`` of a Python string produces a literal Prometheus accepts: ``\``, ``\"``, and the standard ``\n`` / ``\t`` / ``\uNNNN`` control-character escapes. The returned value already includes the surrounding quotes. F) ensure_ascii)r<dumps)rUs r$_quote_promql_string_literalr\js ::e% 00r#api_keyc Kt tdtj}|t dz }|j dz}|j dz}td}|d}nt |}d|d }|||d d }tj|| d{} tj| j} tjd | tj| j j"} | D cgc]Q} | j$D]@\} }tj&t)| j dzt)|dBS}} } }|S7cc}} } ww)z Expected Response Format: [ { "date": "2024-08-18T00:00:00+00:00", "spend": 1.001818099998933 }, ...] Nr2)daysz+00:00z/api/v1/query_rangez*sum(delta(litellm_spend_metric_total[1d]))z4sum(delta(litellm_spend_metric_total{hashed_api_key=z}[1d]))86400)r3startendstepr5r7)r-r.)rr8rutcnowr isoformatr\rr:rr;r<r r=r)r>r*r'r fromtimestampr!)r]end_date start_date start_strend_strurlr3quoted_api_keyr6r@rArBr' timestamprUformatted_resultss r$get_daily_spend_from_prometheusrp|sXYYoo'H 9"#55J"++-8I'')H4G"##67C< rys (+1+ %//?$@cDj!@2<=[2\eC$J/\2@T@d@deEe&v.5.$I$()(i9   $ 3 F 111$13:1$G[B\1r#