tPjJbUddlZddlZddlmZddlmZmZmZddlm Z ddl m Z ddl m Z ddlmZer=ddlmZdd lmZdd lmZdd lmZmZdd lmZdd lmZddlmZ e ZeZeezZeZe!e"d<neZeZeZeZeZeZeZ ddlm#Z#mZdZ%ee"d<dZ&ee"d<GddeZ'y#e$$rdZ#dZY%wxYw)N) OrderedDict) TYPE_CHECKINGAnyFinal)verbose_logger)_utils)ArizeOTELAttributes)ArizePhoenixConfigTracerProvider) SpanProcessor)Span)SpanKindTracer) OpenTelemetry)OpenTelemetryConfig)ProtocolLITELLM_TRACER_NAME)rrlitellmz https://otlp.arize.com/v1/tracesARIZE_HOSTED_PHOENIX_ENDPOINT@_MAX_PROJECT_PROVIDERSc eZdZdZdZd$dZdefdZdedefdZ dede fd Z d e de ee ffd Zd e de fd Zd ZdededzfdZedefdZededzdedzfdZed e fdZed e defdZede dedededzfdZed e dededzfdZed e defdZd%de dzfdZdZdZd efd!Z ede!fd"Z"d#Z#y)&ArizePhoenixLoggera+ Arize Phoenix logger that sends traces to a Phoenix endpoint. Creates its own dedicated TracerProvider so it can coexist with the generic ``otel`` callback (or any other OTEL-based integration) without fighting over the global ``opentelemetry.trace`` TracerProvider singleton. cddlm}|0d|_d|_|j t |_||_yd|_t|_ tj|_ |j|_||_|ji}|j||_t!j"d||j$j&|j$j(y)ar Override to create per-project TracerProviders (LRU-cached) for Arize Phoenix. The base ``OpenTelemetry._init_tracing`` falls back to the global TracerProvider when one already exists. That causes whichever integration initialises second to silently reuse the first one's exporter, so spans only reach one destination. r)rNTFzoArizePhoenixLogger: Initialized per-project TracerProvider cache (default_project=%s, endpoint=%s, exporter=%s))opentelemetry.tracer_use_injected_tracer_provider_shared_span_processor get_tracerrtracer span_kindr_project_providers threadingLock_project_providers_lock_get_span_processor_resolve_project_name_get_tracer_forrdebugconfigendpointexporter)selftracer_providerrdefault_projects m/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/integrations/arize/arize_phoenix.py _init_tracingz ArizePhoenixLogger._init_tracing;s 1  &15D .*.D ')445HIDK%DN -2*DOM'0~~'7$&*&>&>&@#!!%!;!;B!?**?;  =  KK KK  returnNct|ddryt|dd}| |jt|dt j 5tt|dij}dddD]} |jy#t$r }tjd|Yd}~d}~wwxYw#1swYNxYw#t$r }tjd|Yd}~sd}~wwxYw) u Flush all cached per-project providers and the shared span processor. Call on graceful proxy shutdown. Do not call on LRU eviction — in-flight spans may still reference evicted providers. rFNrz@ArizePhoenixLogger: shared span processor force_flush failed: %sr%r"z9ArizePhoenixLogger: TracerProvider force_flush failed: %s) getattr force_flush Exceptionrr)r#r$listvalues)r-shared_processore providersproviders r0flush_tracer_providersz)ArizePhoenixLogger.flush_tracer_providers]s 48% @ ")$0H$"O  '  ,,.T4inn6F G V#GD2F$K$R$R$TUI V" eH e$$& e $$V   V V  e$$%`bcdd es;B%CC  B=B88B=C  C5C00C5 project_namecddlm}m}|||d}t|jdd}|||d<|j }|j |}|j|S)aF Build an OTEL Resource with project routing attrs that win over env detector. Phoenix uses ``openinference.project.name``; Arize AX uses ``model_id`` and ``service.name``. Project attrs are merged last so OTEL_RESOURCE_ATTRIBUTES from init does not pin every provider to one project. r)OTELResourceDetectorResource)zopeninference.project.namemodel_idz service.namedeployment_environmentNzdeployment.environment)opentelemetry.sdk.resourcesrArBr5r*detectcreatemerge)r-r?rArBproject_attributesrD env_resourceproject_resources r0!_get_litellm_resource_for_projectz4ArizePhoenixLogger._get_litellm_resource_for_projectzsw O+7$(5  )0 =UW[(\ ! -;Q 7 824;;= "*//2D"E!!"233r2cxddlm}||j|}|j|j|S)zHCreate a TracerProvider for *project_name* (caller holds no cache lock).rr )resource)opentelemetry.sdk.tracer rLadd_span_processorr)r-r?r r=s r0"_build_tracer_provider_for_projectz5ArizePhoenixLogger._build_tracer_provider_for_projects4:($2X2XYe2fg##D$?$?@r2ct|ddr |jS|j5||jvrF|jj ||j|j t cdddS ddd|j|}|j5||jvrF|jj ||j|j t cdddSt|jtk\r|jjd||j|<|j t cdddS#1swYxYw#1swYyxYw)zHReturn a tracer for *project_name*, creating/caching a provider on miss.rFN)last) r5r r%r" move_to_endrrrQlenrpopitem)r-r? new_providers r0r(z"ArizePhoenixLogger._get_tracer_forsT 48% @;;   ) ) ]t666''33LA..|<GGH[\ ] ]6 ]#EElS  ) ) @t666''33LA..|<GGH[\ @ @ 4**+/EE''//U/;4@D # #L 1**+>? @ @ ] ] @ @s A E!A E'6AE'E$'E0kwargscJ|j|}||j|fS)z9Resolve project name once and return the matching tracer.)r'r()r-rXr?s r0_resolve_tracer_for_kwargsz-ArizePhoenixLogger._resolve_tracer_for_kwargss("88@ T11,???r2c\t|ddr |jS|j|dS)zPRoute guardrail/raw-request spans to the same per-project tracer as the request.rF)r5r rZ)r-rXs r0get_tracer_to_use_for_requestz0ArizePhoenixLogger.get_tracer_to_use_for_requests/ 48% @;; ..v6q99r2cy)z Override: Arize Phoenix should NOT overwrite the proxy's ``open_telemetry_logger``. That attribute is reserved for the primary ``otel`` callback which handles proxy-level parent spans. N)r-s r0"_init_otel_logger_on_litellm_proxyz5ArizePhoenixLogger._init_otel_logger_on_litellm_proxysr2span response_objc2tj|||yN)rset_arize_phoenix_attributes)r-rarXrbs r0set_attributesz!ArizePhoenixLogger.set_attributess77flSr2c<tj|||tyrd)rrfr )rarXrbs r0rez/ArizePhoenixLogger.set_arize_phoenix_attributessdFL:MNr2namecF|yt|j}|r|SdSrd)strstrip)rh normalizeds r0_normalize_project_namez*ArizePhoenixLogger._normalize_project_names' <IOO- 'z1T1r2c#KdD]J}|j|}t|ts%|jd}t|tsG|Lyw)zLYield request metadata dicts; standard_logging_object before litellm_params.)standard_logging_objectlitellm_paramsmetadataN)get isinstancedict)rXkey found_keyrqs r0 _iter_metadata_dicts_from_kwargsz3ArizePhoenixLogger._iter_metadata_dicts_from_kwargssOA C 3Ii. }}Z0H(D)  s A A Ac||jd}t|txrt|jdS)aTrue when the call is routed through the LiteLLM proxy. Proxy mode is determined solely by the server-set ``proxy_server_request`` field in ``litellm_params``. Checking request metadata for ``user_api_key_auth_metadata`` is intentionally avoided: that field is user-supplied and would let an authenticated caller fake proxy-mode detection to route their telemetry into arbitrary Arize/Phoenix projects. rpproxy_server_request)rrrsrtbool)rXrps r0_is_proxy_requestz$ArizePhoenixLogger._is_proxy_requests6!' +; <.$/dD9K9KLb9c4ddr2rq metadata_key proxy_modec|jd}t|tr(tj |j|}|r|S|s$tj |j|Sy)z Read a Phoenix project field from proxy/SDK metadata. On the proxy, only ``user_api_key_auth_metadata`` (team/key config) may select the project. SDK callers may still set project fields directly on ``metadata``. user_api_key_auth_metadataN)rrrsrtrrm)rqr|r} auth_metadataprojects r0_project_from_metadata_dictz.ArizePhoenixLogger._project_from_metadata_dictsa (||,HI mT */GG HYHYZfHghG%==hll<>XY Yr2ctj|}tj|D] }tj|||}|s|cSy)N)r})rr{rwr)rXr|r}rqrs r0_metadata_project_from_kwargsz0ArizePhoenixLogger._metadata_project_from_kwargssQ.@@H *KKFS H(DDX|hrDsG r2ctj|d}|r|Stj|d}|r|Stjtjj dxstjj d}|r|Sy)aB Resolve the target Phoenix/Arize project for this request. Proxy priority: ``user_api_key_auth_metadata.phoenix_project_name_override``, ``user_api_key_auth_metadata.phoenix_project_name``, env, then ``default``. SDK priority: request metadata fields, then env, then ``default``. phoenix_project_name_overridephoenix_project_namePHOENIX_PROJECT_NAMEARIZE_PROJECT_NAMEdefault)rrrmosenvironrr)rXoverride phoenix_nameenv_names r0r'z(ArizePhoenixLogger._resolve_project_names|-JJ6Srs O0NNvWmn  ,DD JJNN1 2 ZbjjnnEY6Z  Or2r cddlm}||j|d}|jdixsi}|jdixsi}|jdixsi}|jdr|j | nd}t |}|rr|jd |jd } |j d | |j| nd||jj } |j| } | | fS|dfS)u Build a trace context for Phoenix's dedicated TracerProvider. The base ``_get_span_context`` returns parent spans from the global TracerProvider (the ``otel`` callback). Those spans live on a *different* TracerProvider, so they won't appear in Phoenix — using them as parents just creates broken links. Instead we: 1. Honour an incoming ``traceparent`` HTTP header (distributed tracing). 2. In proxy mode, create our *own* parent span on Phoenix's tracer so the hierarchy is visible end-to-end inside Phoenix. 3. In SDK (non-proxy) mode, just return (None, None) for a root span. r)traceNr\rpryheaders traceparent)r start_timeapi_call_start_timelitellm_proxy_request)rhrcontextkind) opentelemetryrrZrrget_traceparent_from_headerrz start_span_to_nsr!SERVERset_span_in_context) r-rXr rrpryrtraceparent_ctx is_proxy_modestart_time_val parent_spanctxs r0_get_phoenix_contextz'ArizePhoenixLogger._get_phoenix_contexts ( >44V>2NPT#UM#%::>>2SUY#ZM!.!?- ( !,,Y7--,FX2X-&*.@@1H*H!);;)2259#5 #A+44S9&8%9#C&8%9#D1H&8H"H  _ai !  19[1HooO#2"38G9 E  $ 0lm m jjnn-CDQ !/%   r2cVK|j}|jsdddSdddSw)N unhealthyz,PHOENIX_API_KEY environment variable not set)r error_messagehealthyz1Arize-Phoenix credentials are configured properly)rmessage)rr)r-r*s r0async_health_checkz%ArizePhoenixLogger.async_health_checks?557''%!O   J  s'))r3Nrd)$__name__ __module__ __qualname____doc__r1r>rjrLr rQrr(rttuplerZr]r`rrrf staticmethodrermrwrzr{rrr'rrrrr rrr_r2r0rr2s  De:4c4.s~@C@F@2@@%V :L@ :D:V:  T4TsTzTO4OO2cDj2S4Z22  e$ e4 e ed#VZ_bei_i$d##PT*ds0'%6D='%R]^2E2Eh: &8: : x  r2r)(rr# collectionsrtypingrrrlitellm._loggingrlitellm.integrations.arizer!litellm.integrations.arize._utilsr (litellm.types.integrations.arize_phoenixr rOr opentelemetry.sdk.trace.exportr rr_Spanrr"litellm.integrations.opentelemetryr_OpenTelemetryr_OpenTelemetryConfig litellm.types.integrations.arizer _Protocolrj__annotations__r ImportErrorrrrr_r2r0rs #,,+-AG6<14RGH. 3;D"MH D FNHM (JuI ""Y Y  ' sB"" B.-B.