tPjd8<UdZddlmZddlZddlmZddlmZmZddl m Z ddl m Z m Z mZddlmZdd lmZmZmZd d lmZmZd Zd ed<dZd ed<GddeZGddeZGddeZGddeZd dZd!dZ d"dZ!d#dZ"d$dZ#GddeZ$y)%uMavvrik GCS destination for FOCUS export. Flow: 1. GET /metrics/agent/ai/{connection_id}/upload-url → GCS signed URL 2. PUT with CSV content 3. PATCH /metrics/agent/ai/{connection_id} → advance metricsMarker ) annotationsN)Mapping)FinalProtocol)urlparse) NotRequiredReadOnly TypedDict)verbose_logger)AsyncHTTPHandlerget_async_httpx_clienthttpxSpecialProvider)FocusDestinationFocusTimeWindow)z .mavvrik.devz .mavvrik.aiz .mavvrik.appr_MAVVRIK_ALLOWED_SUFFIXESi_GCS_CHUNK_SIZEceZdZUded<y)MavvrikRegisterBodyz ReadOnly[NotRequired[int | str]] metricsMarkerN__name__ __module__ __qualname____annotations__/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/integrations/focus/destinations/mavvrik_destination.pyrr"s33rrceZdZUded<y)MavvrikUploadUrlBodyzReadOnly[NotRequired[str]]urlNrrrrr r &s ##rr ceZdZddZy)_RegisterResponsecyNrselfs rjsonz_RegisterResponse.json+rN)returnrrrrr(rrrr#r#*s.rr#ceZdZddZy)_UploadUrlResponsecyr%rr&s rr(z_UploadUrlResponse.json/r)rN)r*r r+rrrr-r-.s/rr-c"|jSr%r(responses r_register_bodyr32 ==?rc"|jSr%r0r1s r_upload_url_bodyr66r4rc$|j|Sr%)get)headersnames r _header_valuer;:s ;;t rc|jds tdt|jxsdj t fdt Ds tdy)Nzhttps://z)MAVVRIK_API_ENDPOINT must be an HTTPS URLc3@K|]}j|ywr%)endswith).0suffixhostnames r z)_validate_api_endpoint..BsQVx  (Qsz]MAVVRIK_API_ENDPOINT host must be a Mavvrik domain (e.g. https://api.mavvrik.dev/)) startswith ValueErrorrrBloweranyr) api_endpointrBs @r_validate_api_endpointrI>s`  " ": .DEE -66<"CCEH Q7PQ Q k   Rrct|}|jdk7rtd|d|jd|jxsdj }|dk(s$|j dstd|d|dyy) NhttpszMavvrik FOCUS destination: z must be HTTPS, got scheme ''r=zstorage.googleapis.comz.storage.googleapis.comz7 must be a GCS endpoint (storage.googleapis.com), got ')rschemerErBrFr?)r!labelparsedrBs r_validate_gcs_urlrPHsSMF }}6ug=YZ`ZgZgYhhijkk,"335H 0 0H4E4EF_4`)%0ghpgqqr s  5a 0rceZdZdZdd ddZeddZeddZeddZddZ dd Z dd Z dd Z dd Z dd Zy)FocusMavvrikDestinationz7Upload FOCUS CSV exports to Mavvrik via GCS signed URL.N)configc||xsi}|jd}|jd}|jd}|s td|s td|s tdt|||_|j d|_||_||_ttj|_ d |_ y) Napi_keyrH connection_idzzMAVVRIK_API_KEY must be provided for Mavvrik FOCUS destination (set MAVVRIK_API_KEY env var or pass in destination_config)zMAVVRIK_API_ENDPOINT must be provided for Mavvrik FOCUS destination (set MAVVRIK_API_ENDPOINT env var or pass in destination_config)zMAVVRIK_CONNECTION_ID must be provided for Mavvrik FOCUS destination (set MAVVRIK_CONNECTION_ID env var or pass in destination_config)/) llm_providerF) r8rErIrUrstriprHrVprefixr rLoggingCallback_http _registered)r'rZrSresolved_configrUrHrVs r__init__z FocusMavvrikDestination.__init__Vs 5;Lb(,,Y7-11.A .22?C N S T  |, (//4* '=K_KoKo'p  rc8|jd|jS)N/metrics/agent/ai/rHrVr&s r _agent_urlz"FocusMavvrikDestination._agent_urlzs"##$$6t7I7I6JKKrc:|jd|jdS)Nraz /upload-urlrbr&s r_upload_url_endpointz,FocusMavvrikDestination._upload_url_endpoint~s$##$$6t7I7I6J+VVrc d|jdS)Nzapplication/json) Content-Typez x-api-key)rUr&s r _auth_headersz%FocusMavvrikDestination._auth_headerss 2NNrcK|jry|jjjd|j|j d|j idd{}|jdk(rd|_td|jd k\r(td |jd |jdd d |_t|jdd}tjd||S7w)u~POST agent endpoint to register/initialize the connector (once per instance). Returns metricsMarker from the Mavvrik response — the last date index Mavvrik has successfully processed. Used by the logger to catch up any dates that were missed due to previous export failures. Returns None if the connector was already registered (cached). NPOSTr:>@methodr!r9r(timeoutFnMavvrik FOCUS destination: connector is disconnected (410). Re-enable the connection in the Mavvrik dashboard.,Mavvrik FOCUS destination: register failed (): TrrzBMavvrik FOCUS destination: connector registered (metricsMarker=%s))r]r\clientrequestrcrhrV status_code RuntimeErrortextr3r8r debugr'respmetrics_markers r_ensure_registeredz*FocusMavvrikDestination._ensure_registereds     JJ--55&&$,,- 6     s "$D E    s "!MdN^N^M__bcgclclmqnqcrbstu u .t 4 8 8! L P  + sAC6C4BC6cK|d|d}|jjjd|j|j|dd{}|j dk\r(t d|j d |jdd t|jd }|st d |jt|d tjd||S7w)u>GET upload-url endpoint → GCS signed URL for the given date.metrics)r:typedatetimeGETrk)rmr!r9paramsrnNrqz5Mavvrik FOCUS destination: failed to get signed URL (rsrtr!z9Mavvrik FOCUS destination: response missing 'url' field: z signed URLz5Mavvrik FOCUS destination: got signed URL for date %s)r\rurvrerhrwrxryr6r8r(rPr rz)r'date_strrr| signed_urls r_get_signed_urlz'FocusMavvrikDestination._get_signed_urls!)9(S JJ--55))&& 6     s "GHXHXGYY\]a]f]fgkhk]l\mn -T266u= !Z[_[d[d[fZghi i*l3TV^_! sAC$ C" BC$c Ktj|}t|}d}|jjj d|ddd|dd{}|j d vr(td |j d |jdd t|jd }|s tdt|dtjd|td| tz d} ||kr|||tz} |t| zdz } |t| z|k\} | r d|d| d|nd|d| d} | rddhndh} |jjj d|d| d| dd{}|j | vr.td|d| d|j d |jdd |t| z }tjd ||||kryy77p#t $rX |jjj d!|d"#d{7tjd$#t $rYwxYwwxYww)%uUpload gzip-compressed CSV to GCS via chunked resumable upload. The full CSV is gzip-compressed first, then uploaded in _GCS_CHUNK_SIZE chunks using the GCS resumable upload protocol. GCS assembles the chunks server-side into a single complete object — the bucket receives one file regardless of how many chunks were sent. Intermediate chunks: Content-Range: bytes X-Y/* → expect 308 Final chunk: Content-Range: bytes X-Y/T → expect 200/201 This handles exports larger than available memory for a single PUT while keeping the destination code self-contained (no changes to the FOCUS pipeline upstream). s<{"contentEncoding":"gzip","contentDisposition":"attachment"}rjzapplication/gzipstart)rgzx-goog-resumablerk)rmr!r9contentrnN)rtz4Mavvrik FOCUS destination: GCS session init failed (rsrqLocationzCMavvrik FOCUS destination: GCS session init missing Location headerz session URIzVMavvrik FOCUS destination: GCS session started, uploading %d gzip bytes in %d chunk(s)rrzbytes -rWz/*rtri4PUT)rgz Content-Rangeg^@zAMavvrik FOCUS destination: GCS chunk upload failed (chunk offset=z , expected=z, got=z6Mavvrik FOCUS destination: uploaded chunk offset=%d/%dDELETEg$@)rmr!rnz;I=H>>IIc|K|jjjd|j|jd|idd{}|j dk(rd|_td|j d k\r(td |j d |jdd tjd |y7sw)zHPATCH agent endpoint to advance metricsMarker after a successful upload.PATCHrrkrlNroFrprqz;Mavvrik FOCUS destination: failed to update metricsMarker (rsrtz7Mavvrik FOCUS destination: metricsMarker advanced to %s) r\rurvrcrhrwr]rxryr rz)r' date_epochr|s r_update_metrics_markerz.FocusMavvrikDestination._update_metrics_markers JJ--55&&!:. 6     s "$D E    s "MdN^N^M__bcgclclmqnqcrbst  VXbc# sAB<B:A4B<cK|jjjd|j|jd|j idd{}|j dk(rd|_td|j d k\r(td |j d |jdd d |_t|jdd}tjd||S7w)uRegister with Mavvrik and return the current metricsMarker. Always calls the Mavvrik register API — unlike deliver() which skips registration once _registered is True, catch-up requires a fresh marker value on every run. rjr:rkrlNroFrprqrrrsrtTrrz/Mavvrik FOCUS destination: got metricsMarker=%s)r\rurvrcrhrVrwr]rxryr3r8r rzr{s rget_metrics_markerz*FocusMavvrikDestination.get_metrics_marker*s!JJ--55&&$,,- 6     s "$D E    s "!MdN^N^M__bcgclclmqnqcrbstu u .t 4 8 8! LNP^_% sAC)C'BC)c6K|jjd}t|jj}|j d{|s0t j d||j|d{yt j dt||||j|d{}|j||d{|j|d{t j d|y777R7:7#w)zUpload FOCUS CSV to Mavvrik via GCS signed URL. Uses the start date of the time window as the object date key. z%Y-%m-%dNzFMavvrik FOCUS destination: empty content for date=%s, advancing markerz>Mavvrik FOCUS destination: uploading %d bytes for date=%s (%s)z6Mavvrik FOCUS destination: upload complete for date=%s) start_timestrftimeint timestampr~r rzrrrr)r'r time_windowfilenamerrrs rdeliverzFocusMavvrikDestination.deliverEs&0099*E 6 6 @ @ BC %%'''  X --j9 9 9  L L    #'"6"6x"@@ !!*g666))*555UW_`+ ( :A65sZADD0DD:DDDDD3D4DDDDD)rZstrrSzMapping[str, str] | Noner*None)r*r)r*zdict[str, str])r*zint | str | None)rrr*r)rrrbytesr*r)rrr*r)rrrrrrr*r)rrr__doc__r_propertyrcrerhr~rrrrrrrrrRrRSsA ,0 "!"!) "!  "!HLLWWOO D*Vpd*6#a#a% #a  #a  #arrR)r2r#r*r)r2r-r*r )r9zMapping[str, str]r:rr*z str | None)rHrr*r)r!rrNrr*r)%r __future__rrcollections.abcrtypingrr urllib.parsertyping_extensionsrr r litellm._loggingr &litellm.llms.custom_httpx.http_handlerr r rbaserrrrrrr r#r-r3r6r;rIrPrRrrrrs# #"!>>+ 4#R5R)(4)4$9$//00  Ua.Uar