tPj.dZddlmZddlZddlmZmZmZddlmZm Z m Z ddl Z ddl m Z ddlmZddlmZdd lmZerdd lmZne Z dd Zdd ZGd deZy)u MavvrikFocusLogger — FOCUS-based Mavvrik export logger. Usage in config.yaml: litellm_settings: callbacks: ["mavvrik"] Required env vars: MAVVRIK_API_KEY MAVVRIK_API_ENDPOINT MAVVRIK_CONNECTION_ID Optional env vars: MAVVRIK_FOCUS_MAX_ROWS — row cap per export window (default: 500000) Only daily frequency is supported. The Mavvrik ingestion protocol stores one file per calendar date (metrics/YYYY-MM-DD). Hourly or interval exports would overwrite each other within the same day, producing incomplete data. ) annotationsN)datetime timedeltatimezone) TYPE_CHECKINGAnyFinal)verbose_proxy_logger)MAVVRIK_FOCUS_EXPORT_JOB_NAME)FocusTimeWindow) FocusLogger)AsyncIOSchedulerc|sy t|ttfrAtjt|t j jddddSt|trP|j}|sydD]8} tj||jt j cStjd|y#t$rY]wxYw#t$rY1wxYw)a\Parse metricsMarker from Mavvrik register response into a UTC datetime. Handles both formats Mavvrik may return: - Unix timestamp (int/float): e.g. 1749340800 - ISO date string: e.g. "2026-06-09" or "2026-06-09T00:00:00Z" Returns None for falsy values (0, None, empty string) which indicate no data has been ingested yet. N)tzrhourminutesecond microsecond)z%Y-%m-%dz%Y-%m-%dT%H:%M:%SZz%Y-%m-%dT%H:%M:%S)tzinfouEMavvrik FOCUS: could not parse metricsMarker %r — skipping catch-up) isinstanceintfloatr fromtimestamprutcreplacestrstripstrptime ValueError Exceptionr warning)markerfmts |/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/integrations/mavvrik_focus/mavvrik_focus_logger.py_parse_metrics_markerr&&s  fsEl +))%-HLLIQQqR  fc "\\^FN #,,VS9AAAVV   !hjpq  "    sHAC""C"?C"3C8C";C" CC"CC"" C.-C.c|yt|ttfr|dk(St|tr|j Sy)NTrF)rrrrr)r#s r%_is_empty_metrics_markerr(Is> ~&3,'{&#<<>!! cjeZdZdZdfd Z d dZdZd fd Zd dZe d dZ xZ S) MavvrikFocusLoggerzAFOCUS-based export logger that routes to the Mavvrik destination.c xtjddj}|dk7rtd|dt |dddddtjdtjd tjd d d |tjd }|rt ||_yd|_y)NMAVVRIK_FOCUS_FREQUENCYdailyzMAVVRIK_FOCUS_FREQUENCY='z' is not supported. Only 'daily' is allowed -- the Mavvrik ingestion protocol stores one file per calendar date (metrics/YYYY-MM-DD). Hourly or interval exports would overwrite each other within the same day.mavvrikcsvmavvrik_focus_exportsMAVVRIK_API_KEYMAVVRIK_API_ENDPOINTMAVVRIK_CONNECTION_ID)api_key api_endpoint connection_id)provider export_format frequencyprefixdestination_configMAVVRIK_FOCUS_MAX_ROWSi )osgetenvlowerr super__init__r _max_rows)selfkwargsr:raw __class__s r%rCzMavvrikFocusLogger.__init__Vs99%>HNNP  +I;7JJ   *99%67 " *@ A!#+B!C   YY7814SX'r)cK||n |j}|j}|jj||j|j d{}|Vt ||k\rHtjd||jj|j jd}|jrtjd|nF|jj|}|js|jj|}|j j#|xsd||j%|d{y77w)zEExport with Mavvrik row cap applied when no explicit limit is passed.N)limitstart_time_utc end_time_utcuMavvrik FOCUS export: row cap reached (%d rows). Some data for window %s→%s may be excluded. Increase MAVVRIK_FOCUS_MAX_ROWS to export all rows.r)z1Mavvrik FOCUS export: no usage data for window %s)content time_windowfilename)rD_ensure_engine _databaseget_usage_data start_timeend_timelenr r"dateis_emptydebug _transformer transform _serializer serialize _destinationdeliver_build_filename)rEwindowrJeffective_limitenginedatapayload normalizeds r%_export_windowz!MavvrikFocusLogger._export_windownsG+0*;++-",,;;!!,,<    &3t9+G ( (F !!&&($$&   ==? & &'Z\b c & 3 3 = =d CJ&&( ,,66zB!!))Ns++F3*   + * s%AE#EC?E#E!E#!E#c K|j}ddlm}|j}t ||st |d{y|jd{}tjtj}|jddddtdz }t|}t|}|t|j dz z } |s|||kr|| nt#|tdz| } |P|tdz| kr>t%j&d|j |j)| j)| |kr{t%j*d| j)t-| tdz|} t/| | d } |j1| d d{| tdz } | |kr{t/||d } |j1| d d{y777I7 w) uExport today's window, catching up any dates Mavvrik has not yet received. On each run: 1. Register with Mavvrik → get metricsMarker (last successfully ingested date) 2. If metricsMarker is behind yesterday (or 0/None for a fresh connector), catch up missed dates (capped at _MAX_CATCHUP_DAYS) 3. Export yesterday (today's daily window) This ensures a failed export on day N is automatically retried on day N+1 without any manual intervention. r)FocusMavvrikDestinationNr)dayszMavvrik FOCUS export: metricsMarker is more than %d days behind (%s). Catching up from %s only; earlier data will not be re-exported.z0Mavvrik FOCUS export: catching up missed date %sr.)rSrTr:)r`rJ)rP;litellm.integrations.focus.destinations.mavvrik_destinationrir]rrB_run_scheduled_exportget_metrics_markerrnowrrrrr&r(_MAX_CATCHUP_DAYSmaxr r"rVinfominr rf)rErbri destinationr#ro yesterday last_ingestedis_empty_markerearliest_catchup catch_up_date catch_up_endr`rHs r%rmz(MavvrikFocusLogger._run_scheduled_exports++- $00 +'>?'/1 1 1 *<<>>\\(,,/;;Aaq;QT]cdTee 4V< !9&!A"+iT=S=SVW=W.X"X }8]Y=V$1$9 s=S\bcSdCdfv?w (]YA=N-NQa-a$,,\**!&&(!&&(  )+$))F!&&( #=9!3D#DcJ (,)% ))t)DDD!22  )+(!   !!t!<<7"#|jt d{7wxYw7/w)u=Scheduler entry point — uses Mavvrik-specific pod-lock key.r)proxy_logging_objNdb_spend_update_writerpod_lock_manager) cronjob_idz0Mavvrik FOCUS export: unable to acquire pod lock) litellm.proxy.proxy_serverr|getattr redis_cache acquire_lockr r rXrm release_lock)rEr|r~writeracquireds r%#initialize_mavvrik_focus_export_jobz6MavvrikFocusLogger.initialize_mavvrik_focus_export_jobs@  (#$57OQUVF!#*63Et#L  0 < <$4$A$AMj$A$kkH$**+]^ ^00222&33?\3]]],,. . .l 3]&33?\3]]] .sfAC*B>C*.CCCC*C C*8C(9C*CC*C%C!C%%C*cKtjjtDcgc]}t |tur|}}|s6dtj vr$ddlm}|ddd}t|tr|g}|stjdy|d}|j}|j|jftdd |tjd |ycc}ww) z@Register the Mavvrik FOCUS export job on the provided scheduler.) callback_typer/r)$_init_custom_logger_compatible_classN)logging_integrationinternal_usage_cache llm_routerz4No MavvrikFocusLogger registered; skipping schedulerT)idreplace_existingz3mavvrik_focus: background export job scheduled (%s))litellmlogging_callback_managerget_custom_loggers_for_typer+type callbacks*litellm.litellm_core_utils.litellm_loggingrrr rX_build_scheduler_triggeradd_jobrr rr) schedulercbloggersrinstanceloggertrigger_kwargss r%!init_mavvrik_focus_background_jobz4MavvrikFocusLogger.init_mavvrik_focus_background_jobs66RRasRt- Bx-- - - 9(9(99 C$-%)H ($67#* & &'] ^   & ? ? A   6 6 ,!   !!"WYghA- s'C*C%B'C*)rFrreturnNone)r`r rJz int | Nonerr)rr)rrrr) __name__ __module__ __qualname____doc__rCrfrprmr staticmethodr __classcell__)rHs@r%r+r+SslKB0"  "  "  " NH=T/,$i#$i $i$ir)r+)r# object | Nonerzdatetime | None)r#rrbool)r __future__rr?rrrtypingrrr rlitellm._loggingr litellm.constantsr ,litellm.integrations.focus.destinations.baser 'litellm.integrations.focus.focus_loggerr apscheduler.schedulers.asynciorr&r(r+r>r)r%rsd&# 22,,1;H??    FIiIir)