uPj1kUddlZddlZddlZddlZddlZddlmZddlmZddlmZm Z m Z ddl Z ddl m Z mZmZddlmZddlmZddlmZdd lmZmZd Zej4d d Ze ej4eed<ej4dd Ze ej4eed<dZe ed<dedefdZ d eddfdZ!deddfdZ"edurejFdejHdd jKdk7Z&e ed<dedefdZ'dedzdedefd Z(dedefd!Z)d"ejTdedzfd#Z+Gd$d%ejXZ-e-Z.e ed&<de/fd'Z0d(e/defd)Z1d*ed+e/defd,Z2Gd-d.ejXZ3e3Z4e ed/<Gd0d1ejXZ5e5Z6e ed2<d3Z7e ed4<d5Z8e ed6<e7e8zZ9e ed7<d8e7d9e8Z:e ed:<d;e dzde;fd<Ze dzdefd?Z=Gd@dAej|Z?dedzde;fdBZ@e@ejHdCZAe edD<ejHdEdFZBe edG<eCeeBjZEe eedH<e?ZFe edI<eFjeEeFje.eFje6dJedeIeefdzfdKZJdJedeIeefdzfdLZKdeLfdMZMeMZNe edN<eLdOZOe edP<GdQdReZPGdSdTej ZQdUZReAr$eFjePeRePn;eQe=ejejdVWZVe edX<eFjeVejdYZXejdZZYejd[ZZeYjeFeXjeFeZjeFeYje4eXje4eZje4d\Z\d]Z]e e^ed^fed_<dkd`Z_e\e_ejeZeYeXgZ`e eda<dbZadIejfdcZcddZddeZedfZfdgZgdhZhdiZide;fdjZjy)lN)datetime) Formatter)AnyFinalTextIO)LITELLM_TRUNCATED_PAYLOAD_FIELD(LITELLM_TRUNCATION_STDOUT_SAFEGUARD_NOTEMAX_STRING_LENGTH_STDOUT_LOG) get_env_int) safe_dumps)safe_json_loads) redact_stringredact_structured_valueF session_iddefaultsession_id_vartrace_id trace_id_var_MAX_CORRELATION_ID_LENGTHvaluereturncVdjd|D}t|dtS)aStrip control characters, bound length, and redact credential-shaped content before a caller-controlled trace_id/session_id (e.g. litellm_session_id, x-litellm-trace-id) is stamped into log lines. Without the first two, a caller could embed \r/\n or terminal escape sequences to forge fake log entries, or submit an oversized value repeated across every log line for the request. Without the redaction, a caller could smuggle a real credential (e.g. an sk-... key) through this field: CorrelationContextFilter stamps trace_id/session_id onto the record after SecretRedactionFilter has already run, so those two fields never otherwise pass through credential redaction. rc3BK|]}|js|ywN) isprintable).0chs U/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/_logging.py z+_sanitize_correlation_id..*sERBNN4DbEsN)join_redact_stringr)rstrippeds r!_sanitize_correlation_idr&s,ggE5EEH (#>$>? @@zcontextvars.Token[str]c>tjt|Sr)rsetr&)rs r!set_session_idr*.s   6zB CCr'c>tjt|Sr)rr)r&)rs r! set_trace_idr,2s   4X> ??r'Tze`litellm.set_verbose` is deprecated. Please set `os.environ['LITELLM_LOG'] = 'DEBUG'` for debug logs.LITELLM_DISABLE_REDACT_SECRETStrue_ENABLE_SECRET_REDACTIONc(ts|St|Sr)r/rrs r!r$r$>s #  r'keyc*ts|St||Sr)r/r)r2rs r!_redact_structured_valuer4Ds # "3 ..r'c(ts|St|S)u5Public API: redact known secret/credential patterns from an arbitrary string. Use this for code paths that bypass the logging system — e.g. Slack/Teams alerting, HTTP error response bodies, or any other string that may contain secrets and will be sent to an external sink. Not to be confused with redact_message_input_output_from_logging() in litellm_core_utils/redact_messages.py, which redacts LLM prompt/response content for privacy — this function redacts credential patterns (API keys, PEM blocks, tokens, etc.) by shape. )r/r$r1s r!redact_secretsr6Js $ %  r'recordc|jjd}t|tr |jsy ||jzS#t $r|cYSwxYw)aRender a record's ``color_message`` against its args, or None if absent. uvicorn's colorized formatter re-renders `color_message` against record.args at emit time (see uvicorn.logging.ColourizedFormatter) instead of using the already-formatted record.msg, so it has to be substituted before args are cleared or it is later formatted with no args and prints the raw "%s://%s:%d" placeholders instead of the URL. color_messageN)__dict__get isinstancestrargs TypeError)r7r9s r!_substituted_color_messager@[sT"??..?M mS )v{{** sA AAcVeZdZdZej ZdejdefdZ y)SecretRedactionFilterz9Scrubs known secret/credential patterns from log records.r7rctsyt|}|||_ t|j |_d|_|jrQ|jdB t|jxs%|jj|j|_ t|jj!D]5\}}|t"vst|ts t%||t|7y#t$r7t|j trt|j |_YwxYw#t$rYwxYw)NT)r/r@r9r$ getMessagemsgr> Exceptionr<r=exc_infoexc_text _formatterformatExceptionlistr:items_STANDARD_RECORD_ATTRSsetattr)selfr7substituted_color_messager2rs r!filterzSecretRedactionFilter.filterrs',Ff+M! $ 0#;=D;:D;> E  E N __name__ __module__ __qualname____doc__loggingrrJ LogRecordboolrRr'r!rBrBms.C"""$JW..4r'rB_secret_filterc"tdtS)zhRead the limit per record so a value loaded later via proxy config environment_variables is honored.r )r r r[r'r!!_get_max_string_length_stdout_logr^s 57S TTr' skipped_charsc*dtd|dtdS)Nz... (z skipped z chars. z) ...)rr )r_s r!_stdout_truncation_markerras% /0 - 3 4E ;r'textlimitc|ttt|z }|dkr|d|S|dz}||z }|d|tt||z || dS)Nr)lenra)rbrc kept_chars head_chars tail_charss r!_truncate_for_stdout_logrjsz$=c$i$H IIJQFU|"aJ"Z/J;J !:3t9z;Q!R STXZdYdYeTfSg hhr'cVeZdZdZej ZdejdefdZ y)StdoutLogTruncationFiltera9Bounds how much of an oversized log line reaches stdout. A provider error string can echo the whole request payload, so one failed agentic request writes hundreds of KB to stdout, repeatedly as the exception propagates from the router to the proxy handler and into its traceback, all inline on the event loop. DEBUG records pass through untouched, since dumping full payloads is the point of `--detailed_debug`, and logging callbacks (OTEL, Datadog, etc.) don't run through logging filters at all, so they still get the untruncated error. r7rc|jtjkryt}|dkry |j }t||kDrt|||_ d|_ t|jtrR|jxs%|jj!|j}t||kDrt|||_y#t t f$rYywxYw)NTr)levelnorXINFOr^rEr? ValueErrorrfrjrFr>r<rHtuplerIrJrK)rPr7rcmessagerIs r!rRz StdoutLogTruncationFilter.filters >>GLL (8: A: #..0G w<% 1'5AFJFK foou -$ooa1P1PQWQ`Q`1aH8}u$":e#:&  sCC%$C%NrSr[r'r!rlrls2 #""$JW..4r'rl_stdout_truncation_filterc4eZdZdZdej defdZy)CorrelationContextFiltera Stamps each log record with the current request's trace_id and session_id from contextvars. Works in tandem with JsonFormatter: the formatter's record.__dict__ loop picks up these attributes as first-class JSON fields without any formatter-level code. r7rctjsytj}|r||_t j}|r||_y)NT)litellmrequest_correlation_in_logsrr;rrr)rPr7rrs r!rRzCorrelationContextFilter.filtersB22&**, &FO*..0  *F r'N)rTrUrVrWrXrYrZrRr[r'r!rurus  W.. 4 r'ru_correlation_filterz$%(asctime)s - %(name)s:%(levelname)s_LOG_FORMAT_PREFIXz': %(filename)s:%(lineno)s - %(message)s_LOG_FORMAT_SUFFIX_PLAIN_LOG_FORMATzz_COLOR_LOG_FORMATstreamcZ |duxr|jS#ttf$rYywxYw)zTrue when the stream is an open interactive terminal; never raises. A stream can be None (pythonw/embedded interpreters), lack isatty entirely (GUI log-redirect shims), or be closed; import must survive all three. NF)isattyAttributeErrorrp)r~s r!_stream_is_ttyrs4 T!5fmmo5 J 's **stdoutstderrctjjdrtSt |rt |rt StS)zThe plain-text log format, colorized only when both streams are an interactive terminal. Honors the NO_COLOR convention from no-color.org: color is disabled when NO_COLOR is present with a non-empty value. NO_COLOR)osenvironr;r|rr})rrs r!_plain_log_formatrs5  zz~~j!  .v 6>&;Q hWhhr'c@eZdZdZdej ddffd ZxZS)LevelRoutingStreamHandlerzWrites records below WARNING to stdout and WARNING and above to stderr. Collectors that derive severity from the stream report every stderr line as an error. r7rNc|jtjkrtjntj }| t |ddrtj |_n||_t|%|y)NclosedF) rnrXWARNINGsysrrgetattrr~superemit)rPr7 preferred __class__s r!rzLevelRoutingStreamHandler.emitsP)/'//)I3::szz   8U C**DK#DK  Vr')rTrUrVrWrXrYr __classcell__rs@r!rr s& 7,,r'rc0|xsdjdk(S)aStrict opt-in parse for the JSON_LOGS env var: only "true" (any case) enables JSON logs. Matches the reader in litellm-proxy-extras/_logging.py. The previous bool(os.getenv(...)) treated any non-empty value, including "false" and "0", as enabled. rr.)lowerr1s r!_parse_json_logs_envrs KR   F **r' JSON_LOGS json_logs LITELLM_LOGDEBUG log_level numeric_levelhandlerrrc|rt|tsy|j}|jds|jdsyt |d}|t|t sy|S)z Try to parse a log message as JSON. Returns parsed dict if valid, else None. Handles messages that are entirely valid JSON (e.g. json.dumps output). Uses shared safe_json_loads for consistent error handling. N{[r)r<r=strip startswithr dict)rr msg_strippedparseds r!_try_parse_json_messager-s^ *Wc2!--/L  # #C (L,C,CC,H#GT:F ~Z5 Mr'c|rt|trd|vryd}|t|kr|jd|}|dk(r yd}t |t|D]d}||}|dk(r|dz }|dk(s|dz}|dk(s$|||dz} t j |}t|trt|dkDr|cSn|dz}|t|kry#tttf$rY.wxYw)a6 Try to find and parse a Python dict repr (e.g. str(d) or repr(d)) embedded in the message. Handles patterns like: "get_available_deployment for model: X, Selected deployment: {'model_name': '...', ...} for model: X" Uses ast.literal_eval for safe parsing. Returns the parsed dict or None. rNrrD}) r<r=rffindrangeast literal_evalrrp SyntaxErrorr?)rristartdepthjcsubstrresults r!_try_parse_embedded_python_dictr>s *Wc2c6H A c'l  S!$ B; $ #uc'l+ A ACx c A:$UQU3F!$!1!1&!9%fd3F a#)M  AI) c'l *  ' Y?s4CC+*C+c zttjdddddddjj S)z]Standard LogRecord attribute names - excludes extra keys from logger.debug(..., extra={...}).rrr[N) frozensetrXrYr:keysr[r'r!_get_standard_record_attrsrbs3 W&&r1b!RTBKKPPR SSr'rN)rr_RESERVED_CORRELATION_FIELDSc,eZdZfdZddZdZxZS) JsonFormatterc"t|yr)r__init__)rPrs r!rzJsonFormatter.__init__ps r'c`tj|j}|jSr)r fromtimestampcreated isoformat)rPr7datefmtdts r! formatTimezJsonFormatter.formatTimess"**6>>:||~r'c|j}||j|j|d}t|}| t |}|+|j D]\}}||vs |t vs|||<|jj D]\}}|tvs||vs|||<t D]}t||d}|s|||<d|vr|j|d<d|vr|jd|j|d<|jr,|jxs|j|j|d<t!|t"S)N)rrlevel timestamp componentlogger: stacktrace)value_transform)rE levelnamerrrrMrr:rNrnamefilenamelinenorHrIrKr r4)rPr7 message_str json_recordrr2r reserved_keys r!formatzJsonFormatter.formatxsc#..0 "%%0. )5 >4[AF  $lln - Uk)c9U.U',K$ - !////1 )JC00S 5K#( C  )9 2LFL$7E,1 L) 2 k )'-{{K $ ; &'-&7q$HK ! ??(.(`4;O;OPVP_P_;`K %+7OPPr'r)rTrUrVrrrrrs@r!rros 0Qr'rc@eZdZdZdej deffd ZxZS)CorrelationPlainFormatterzAppends trace_id/session_id to plain-text log lines stamped by CorrelationContextFilter. Mirrors JsonFormatter's handling of these two fields so request_correlation_in_logs behaves the same whether or not json_logs is enabled. r7rctt| |}t|dd}t|dd}|s|s|St d|rd|nd|rd|ndfD}|ddj |dS) Nrrc3$K|]}|r| ywrr[)rps r!r"z3CorrelationPlainFormatter.format..s   sz trace_id=z session_id=z [ ])r$rrrrqr#)rPr7 formattedrrpartsrs r!rz CorrelationPlainFormatter.formats)%'.*@A !&*d;#FL$?    08 (,dblkR\Q]D^rvw   Bsxx/q11r') rTrUrVrWrXrYr=rrrs@r!rrs& 2W.. 23 2 2r'rc^tjj|jtjt jt fd}|t_ ddl }fd}|jj|y#t$rYywxYw)Nc tjdtjddt|d|||f}j |y)NLiteLLMrrr[rrpathnamerrFr>rH)rXrYERRORr=handle)exc_type exc_value exc_tracebackr7 error_handlers r!json_excepthookz7_setup_json_exception_handlers..json_excepthooksG))--I =9  V$r'rc |jd}|r]t|}tjdtjddt |d|||j f}j|y|j|y)N exceptionrrrr[r) r;typerXrYrr= __traceback__rdefault_exception_handler)loopcontextrrr7rs r!async_json_exception_handlerzD_setup_json_exception_handlers..async_json_exception_handlersu&{{;7I"&y/ ' 1 1"!--I& 93J3JK!$$V,..w7r') rX StreamHandler setFormatter addFilterr\rsryr excepthookasyncioget_event_loopset_exception_handlerrG) formatterrrrrs @r!_setup_json_exception_handlersrs"002My)N+56/0 %%CN  8"  667ST    s7(B B,+B,z%H:%M:%S)rrz LiteLLM ProxyzLiteLLM Routerrc<tjd}|jtjtjd}|jtjtjd}|jtjy)z$Suppress noisy loggers at INFO levelhttpxapscheduler.executors.defaultapscheduler.schedulerN)rX getLoggersetLevelr) httpx_loggerapscheduler_executors_loggerapscheduler_scheduler_loggers r!_suppress_loggersr sp"++G4L'//*+2*;*;<[*\  ))'//:*1*;*;rQs{  %% =AF^ 5K[5K5KLbd5ek,,S12e3I;3I3I*^`3a eK**3/0a$'E'ACACA"DsD'?D@3@#;@$GOOo#,")),Lb"Q"W"W"Y]c"c%c # # /#*/S/S/ !#!#!"w'8'8S4Z$"GNN"J.//U3U SSi3isisi&&R$=#>5>w~~&67U7CEBEEE-0BB5B%&8%9AS@TU5U 6D= T iftmiVd]isi  5 5 +d +t+(  +(>? 5?299]G4 54#GY__->? uSz?*,,.!%&ST#s(^d-B"ST#s(^d5JHTIT !; << '00J&KeK9QI9Qx2 1 12,. d  )"=?30#**cjj1Iu  #(w((9)))*:;"""9- )('" 9:8923 ;9uU38_5:0G  U( goo 9x 47 )*  M$Mr'