tPjKUddlZddlZddlZddlmZddlmZmZmZmZddl m Z ddl m Z ddl mZddlmZmZddlmZdd lmZdd lmZer dd lmZeezZneZd Zeed <dZeed<dZeed<dZeed<GddeZ y)N)datetime) TYPE_CHECKINGAnyFinalOptional)verbose_logger)_utils)LangfuseLLMObsOTELAttributes) OpenTelemetryOpenTelemetryConfig)safe_json_loads)LangfuseSpanAttributes)StandardCallbackDynamicParams)Spanz*https://cloud.langfuse.com/api/public/otelLANGFUSE_CLOUD_EU_ENDPOINTz-https://us.cloud.langfuse.com/api/public/otelLANGFUSE_CLOUD_US_ENDPOINTzx-langfuse-ingestion-version!LANGFUSE_INGESTION_VERSION_HEADER4LANGFUSE_INGESTION_VERSIONc eZdZd fd ZedefdZededefdZededefd Z edefd Z edefd Z ede dzfd Z defd Zed!dZede de de dzddfdZede de de fdZede dee e ffdZedee e fde fdZdededzfdZdededfdZdedededzfdZdZdZxZS)"LangfuseOtelLoggerNcL||j}t||d|i|y)Nconfig)/_create_open_telemetry_config_from_langfuse_envsuper__init__)selfrargskwargs __class__s p/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/integrations/langfuse/langfuse_otel.pyrzLangfuseOtelLogger.__init__"s/ >IIKF 888spanctj|||t|jddtj |||y)z Sets OpenTelemetry span attributes for Langfuse observability. Uses the same attribute setting logic as Arize Phoenix for consistency. zlangfuse.observation.type generationr#r response_objN)r set_attributesr set_attributer!_set_langfuse_specific_attributesr&s r!set_langfuse_otel_attributesz/LangfuseOtelLogger.set_langfuse_otel_attributes)sB dFL:VW 6 E <<$vdp<qr"rreturnc|jdixsi}|jdxsi}|t|tsi} ddlm}|j ||}|S#t $rY|SwxYw)a Extracts Langfuse metadata from the standard LiteLLM kwargs structure. 1. Reads kwargs["litellm_params"]["metadata"] if present and is a dict. 2. Enriches it with any `langfuse_*` request-header params via the existing LangFuseLogger.add_metadata_from_header helper so that proxy users get identical behaviour across vanilla and OTEL integrations. litellm_paramsmetadatar)LangFuseLogger)get isinstancedict&litellm.integrations.langfuse.langfuser0add_metadata_from_header Exception)rr.r/ _LFLoggers r!_extract_langfuse_metadataz-LangfuseOtelLogger._extract_langfuse_metadata8s!' +;R @ FB!%%j17R  :h#=H  !99.(SH      sA A('A(r/cddlm}tjtjtj tj tjtjtjtjtjtjtjtjtjtj tj"d}|j%d|j%dn|j%d}|"||tj&j(||j+D]|\}}||vs ||||}|dk(r"t-|t.r|j1dd }t-|t2t4fr t7j8|}|||j(|~y#t:$rt/|}Y-wxYw) z/Helper to set metadata attributes from mapping.rsafe_set_attribute)generation_name generation_idparent_observation_id mask_input mask_output trace_user_id session_idtags trace_nametrace_idtrace_metadata trace_releaseexisting_trace_idupdate_trace_keysdebug_langfuse trace_versionNversionrE-)!litellm.integrations.arize._utilsr;rGENERATION_NAME GENERATION_IDPARENT_OBSERVATION_ID MASK_INPUT MASK_OUTPUT TRACE_USER_ID SESSION_IDTAGS TRACE_NAMETRACE_IDTRACE_METADATARELEASEEXISTING_TRACE_IDUPDATE_TRACE_KEYSDEBUG_LANGFUSEr1VERSIONvalueitemsr2strreplacelistr3jsondumpsr6)r#r/r;mappingrLkey enum_attrr`s r!_set_metadata_attributesz+LangfuseOtelLogger._set_metadata_attributesUs I 6EE3AA%;%Q%Q0;;1==3AA0;;*//0;;.774CC3;;!7!I!I!7!I!I4CC &.6\\/-J-VHLL )\d\h\hir\s    t%;%C%C%I%I7 S%mmo ANCh8C=#<  *$E3)?!MM#r2EedD\2+ $ 5 1#4%@ A%+ #E +s&GG)(G)c &ddlm}ddlm}|r t |dsy|j dg}|rg|d}|j di}|j d}|rg}|D]} | j d i} | j d d } t | trtj| n| } |j d d | j dd | j d d d| d} |j| ||tjj||nvi}|j dr|j d|d<|j d|j d|d<|r(||tjj|||j dg}|rIg}|D]}t |ds|j}|dk(rIt |dr=|j D]-}t |ds|jd|j"d/k|dk(r:|jt%|ddt%t%|digddd d|dk(st%|d d } t | tr t'| in| } t%|d d t%|dd t%|dd d| d} |j| |r)||tjj||yyy#tj$ri} YawxYw)z,Helper to set observation output attributes.rr: safe_dumpsr1Nchoicesmessage tool_callsfunction argumentsz{}idrNname function_call)rsrtcall_idtyperrrolecontentoutputrw reasoningsummarytextreasoning_summary)rxry assistant)defaultrv)rOr;*litellm.litellm_core_utils.safe_json_dumpsrmhasattrr1r2rbreloadsJSONDecodeErrorappendrOBSERVATION_OUTPUTr`rwr|r}getattrr )r#r'r;rmrn first_choicerorptransformed_tool_calls tool_callrq arguments_str arguments_objlangfuse_tool_call output_datarzoutput_items_dataitem item_typer|s r!_set_observation_outputz*LangfuseOtelLogger._set_observation_outputs4 II7<#? %)))R8 ")!*L)--i>8$  22<2Xr"ctjjdxstjjdS)z Returns the Langfuse OTEL host based on environment variables. Returned in the following order of precedence: 1. LANGFUSE_OTEL_HOST 2. LANGFUSE_HOST LANGFUSE_OTEL_HOST LANGFUSE_HOST)rrr1r"r!_get_langfuse_otel_hostz*LangfuseOtelLogger._get_langfuse_otel_hosts*zz~~23Vrzz~~o7VVr"c ddlm}tjj dd}tjj dd}|r|s|j St j||t jS)z Creates OpenTelemetryConfig from Langfuse environment variables. Does NOT modify global environment variables. r)r LANGFUSE_PUBLIC_KEYNLANGFUSE_SECRET_KEY public_key secret_key langfuse_host) "litellm.integrations.opentelemetryr rrr1from_envr_build_langfuse_otel_configr)rr rrs r!rzBLangfuseOtelLogger._create_open_telemetry_config_from_langfuse_env ss KJJNN+@$G JJNN+@$G /&//1 1!==!!,DDF>  r"r ctjjdd}tjjdd}|r|s tdtj ||tj S)a2 Retrieves the Langfuse OpenTelemetry configuration based on environment variables. Environment Variables: LANGFUSE_PUBLIC_KEY: Required. Langfuse public key for authentication. LANGFUSE_SECRET_KEY: Required. Langfuse secret key for authentication. LANGFUSE_HOST: Optional. Custom Langfuse host URL. Defaults to US cloud. Returns: OpenTelemetryConfig: A Pydantic model containing Langfuse OTEL configuration. Raises: ValueError: If required keys are missing. rNrz_LANGFUSE_PUBLIC_KEY and LANGFUSE_SECRET_KEY must be set for Langfuse OpenTelemetry integration.r)rrr1 ValueErrorrrrrrs r!get_langfuse_otel_configz+LangfuseOtelLogger.get_langfuse_otel_config!so JJNN+@$G JJNN+@$G q "==!!,DDF>  r"rrrc Z|rC|jdr|nd|}|jdd}tjd|nt}tjd|t j ||}td|t jt j| S) z Builds an OTLP HTTP config pointing at the Langfuse OTEL endpoint for the given host (US cloud when no host is provided), authorized with the given keys. httpzhttps:///z/api/public/otelz*Using Langfuse OTEL endpoint from host: %sz$Using Langfuse US cloud endpoint: %sr otlp_http)exporterendpointheaders) startswithrstriprdebugrr"_get_langfuse_authorization_headerr _format_otel_headers_build_langfuse_otel_headers)rrrnormalized_hostr auth_headers r!rz.LangfuseOtelLogger._build_langfuse_otel_config?s 6C6N6Nv6V]^fgtfu\vO)00566FGH  !Mx X1H  !G R/RR!jS # &;;"?? L  r"c||d|}tj|jj}d|S)zJ Get the authorization header for Langfuse OpenTelemetry. :zBasic )base64 b64encodeencodedecode)rr auth_stringrs r!rz5LangfuseOtelLogger._get_langfuse_authorization_header[sC !+|1ZL9 #--k.@.@.BCJJL  }%%r"rcd|ttiS)z Build the OTLP header set Langfuse expects. `x-langfuse-ingestion-version: 4` selects Langfuse's v4 ingestion path; without it spans fall back to the older transformation path. Authorization)rr)rs r!rz/LangfuseOtelLogger._build_langfuse_otel_headersds [ -/I  r"rcNdjd|jDS)zX Serialize a header mapping into the comma-separated OTLP header string ,c30K|]\}}|d|yw)=Nr).0rhr`s r! z:LangfuseOtelLogger._format_otel_headers..vsKZS%3%q(Ks)joinra)rs r!rz'LangfuseOtelLogger._format_otel_headersqs xxK7==?KKKr"rci}|jd}|jd}|r=|r;tj||}|jtj ||S)z Construct dynamic Langfuse headers from standard callback dynamic params This is used for team/key based logging. Returns: dict: A dictionary of dynamic Langfuse headers langfuse_public_keylangfuse_secret_keyr)r1rrupdater)rrdynamic_headersdynamic_langfuse_public_keydynamic_langfuse_secret_keyrs r!construct_dynamic_otel_headersz1LangfuseOtelLogger.construct_dynamic_otel_headersxsr"$-M-Q-QRg-h#-M-Q-QRg-h# &+F!3!V!V66"W"K  " "#5#R#RS^#_ `r"c|jd}|jd}|r|sy|jdxs|j}tj|||S)az Build a full per-request OTLP config from team/key dynamic Langfuse credentials. Key-scoped credentials must define the export target, not just the auth headers: without this, a proxy with no global LANGFUSE_* env vars keeps its init-time fallback exporter (console), so key-level langfuse_otel silently never reaches Langfuse. rrNrr)r1rrr)rrrrrs r!construct_dynamic_otel_configz0LangfuseOtelLogger.construct_dynamic_otel_configsn=@@AVW <@@AVW ?CCOTvX\XtXtXv !==!!'>  r" start_timecy)aq Override to prevent creating empty proxy request spans. Langfuse should only receive spans for actual LLM calls, not for internal proxy operations (auth, postgres, proxy_pre_call, etc.). By returning None, we prevent the parent span from being created, which in turn prevents empty traces from being sent to Langfuse. Nr)rrrs r!)create_litellm_proxy_request_started_spanzrs 66+-RF>1 3;D D%QEP$SES+I!5I$'E'^ ^ r"