uPj$8rdZddlZddlZddlmZmZmZddlmZm Z ddl m Z Gdde Z Gdd Z y) a Databricks integration utilities for LiteLLM. This module provides authentication, telemetry, and security utilities for the Databricks LLM provider integration. Authentication priority: 1. OAuth M2M (DATABRICKS_CLIENT_ID + DATABRICKS_CLIENT_SECRET) - Recommended for production 2. PAT (DATABRICKS_API_KEY) - Supported for development 3. Databricks SDK automatic auth - Fallback (uses unified auth) N)AnyFinalLiteral)urlsplit urlunsplit)BaseLLMExceptionc eZdZy)DatabricksExceptionN)__name__ __module__ __qualname__i/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/databricks/common_utils.pyr r srr ceZdZdZej dej dfej dej dfej dej dfej dej dfej dej dfej d ej dfgZed e d e fd Z ed e e e fd e e e ffdZ edde dzd e fdZde dzd e fdZde de de d e fdZde dzde dzd e dzd ee e ffdZ dde dzde dzdeddedzd e dzde dzd ee e ffdZy)DatabricksBasezk Base class for Databricks integration with authentication, telemetry, and security utilities. z(Bearer\s+)[A-Za-z0-9\-_\.]+z \1[REDACTED]z(Authorization:\s*)[^\s,}]+z (api[_-]?key["\s:=]+)[^\s,}"\']+z&(client[_-]?secret["\s:=]+)[^\s,}"\']+z(dapi[a-zA-Z0-9]{32,})z[REDACTED_PAT]z%(access[_-]?token["\s:=]+)[^\s,}"\']+datareturnc |yt|tr*|}|jD]\}}|j||}|St|trZi}|j D]C\}}|j t fddDrd||<0|j|||<E|St|tr|Dcgc]}|j|c}S|Scc}w)a Redact sensitive information (tokens, secrets) from data before logging. Handles strings, dicts, and lists recursively. Keys containing sensitive terms (authorization, api_key, token, secret, password, credential) are fully redacted. Args: data: String, dict, or other data structure to redact Returns: Redacted version of the data safe for logging Nc3&K|]}|v ywNr).0 sensitive lower_keys r z7DatabricksBase.redact_sensitive_data..Ns !* s) authorizationapi_keyapikeytokensecretpassword credential [REDACTED]) isinstancestrSENSITIVE_PATTERNSsubdictitemsloweranyredact_sensitive_datalist) clsrresultpattern replacementredactedkeyvalueitemrs @rr,z$DatabricksBase.redact_sensitive_data2s < dC F(+(>(> :$ [&9 :M dD ! H"jjl E UIIK  &  %1HSM$'$=$=e$DHSM! E"O dD !@DEC--d3E E Fs=Cheadersc|siSi}hd}|jD]<\}}|j|vr t|dkDr |ddd||<2d||<8|||<>|S)aR Create a copy of headers with sensitive values redacted for safe logging. Shows first 8 characters of sensitive values for debugging purposes, with the rest redacted. Args: headers: HTTP headers dictionary Returns: New dictionary with sensitive headers redacted >api-key x-api-keyx-databricks-tokenr Nz ...[REDACTED]r#)r)r*len)r.r6r2sensitive_headersr3r4s rredact_headers_for_loggingz)DatabricksBase.redact_headers_for_loggingds}I$ "--/ &JCyy{//u:?',Rayk$?HSM$0HSM %  &rNcustom_user_agentc$ ddlm}|rr|j}d|vr#|j ddj}n|}|r7|j ddj ddj r|d|Sd |S#t$rd}YwxYw) a' Build the User-Agent string for Databricks API calls. If a custom user agent is provided, the partner name (part before /) is extracted and prefixed to the litellm user agent with an underscore. The custom version is ignored; LiteLLM's version is always used. Args: custom_user_agent: Optional custom user agent string (e.g., "mycompany/1.0.0") Returns: User-Agent string in format: - Default: "litellm/{version}" - With custom: "{partner}_litellm/{version}" Examples: - None -> "litellm/1.79.1" - "mycompany/1.0.0" -> "mycompany_litellm/1.79.1" - "partner_product/2.0.0" -> "partner_product_litellm/1.79.1" - "acme" -> "acme_litellm/1.79.1" r)versionz0.0.0/_-z _litellm/zlitellm/)litellm._versionrB Exceptionstripsplitreplaceisalnum)r@rB partner_names r_build_user_agentz DatabricksBase._build_user_agents.  0  1 7 7 9 ''066s;A>DDF 0  4 4S" = E Ec2 N V V X&y ::'### G sB BBapi_basec|) ddlm}|}|jjd}|S|S#t$rt ddwxYw)zx Get the Databricks API base URL. If not provided, attempts to get it from the Databricks SDK. r)WorkspaceClient/serving-endpointsz~Either set the DATABRICKS_API_BASE and DATABRICKS_API_KEY environment variables, or install the databricks-sdk Python library. status_codemessage)databricks.sdkrQconfighost ImportErrorr )selfrOrQdatabricks_clients r _get_api_basezDatabricksBase._get_api_basesh   :+:+<!/66;;<+@+@.BWBWY[]_ac*de +_N;  &mm"6' /')LM, H   3 &%$00:8==/J  %MMO .))(( %:1#>  sBC.B>>Crc|xsddi} ddlm}m}|jd|}|xs|jj d}| |jj }i||}||fS#t$rtdd wxYw) a Get Databricks credentials using the Databricks SDK. Also registers LiteLLM as a partner for proper telemetry attribution in Databricks system.access.audit table. Args: api_key: Optional API key (PAT) api_base: Optional API base URL headers: Optional existing headers Returns: Tuple of (api_base, headers) rdapplication/jsonr)rQ useragentlitellmrRrSa If the Databricks base URL and API key are not set, the databricks-sdk Python library must be installed. Please install the databricks-sdk, set {LLM_PROVIDER}_API_BASE and {LLM_PROVIDER}_API_KEY environment variables, or provide the base URL and API key as arguments.rT) rWrQrz with_partnerrXrY authenticaterZr )r[rrOr6rQrzr\databricks_auth_headerss r_get_databricks_credentialsz*DatabricksBase._get_databricks_credentialss"An.@A  A  " "9 -'6'8 W&7&>&>&C&C%DDV#WHARAYAYAfAfAh'@4@@W$ $ %H  s A"A--B endpoint_type)chat_completions embeddingscustom_endpointcddlm}tjd}tjd} |tjd}|r<| r:|r8|j d|j ||| } |xsi}d| |d<d |d <n=|;|s9|d ur t d d |j d|j|||\}}|&|r t d d|j|||\}}| d|d d}n||jdd|i|d||d<|j||d<|j d|j||dk(r |d ur |d}||fS|dk(r |d ur|d}||fS)a! Validate and configure the Databricks environment. Authentication priority: 1. OAuth M2M (DATABRICKS_CLIENT_ID + DATABRICKS_CLIENT_SECRET) - Recommended 2. PAT (DATABRICKS_API_KEY) - Supported for development 3. Databricks SDK automatic auth - Fallback (uses unified auth) Args: api_key: Personal access token (PAT) api_base: Databricks workspace URL with /serving-endpoints endpoint_type: Type of endpoint (chat_completions or embeddings) custom_endpoint: Whether using a custom endpoint URL headers: Existing headers dict custom_user_agent: Optional custom user agent to prefix Returns: Tuple of (api_base, headers) with authentication configured r)verbose_loggerDATABRICKS_CLIENT_IDDATABRICKS_CLIENT_SECRETDATABRICKS_API_BASEz-Using OAuth M2M authentication for DatabrickszBearer AuthorizationryrdTrSzMissing API Key - A call is being made to LLM Provider but no key is set either in the environment variables ({LLM_PROVIDER}_API_KEY) or via paramsrTz'Using Databricks SDK for authentication)rOrr6zMissing API Base - A call is being made to LLM Provider but no api base is set either in the environment variables ({LLM_PROVIDER}_API_KEY) or via params)rrdz User-AgentzDatabricks request headers: %srz/chat/completionsrz /embeddings) litellm._loggingrosgetenvdebugrwr rupdaterNr?) r[rrOrrr6r@rr^r_ris rdatabricks_validate_environmentz.DatabricksBase.databricks_validate_environment.s8 499%;< !yy)CD   yy!67H 8  !P Q"&";";HiQ^"_LmG)0'?GO $&8GN # _W$&) #r $$%NO$($D$D%w%E%!'  ) #x %)$D$D%w%E%!' ?#*7)!4 2G "77)1DEF  )0 ':GO $!% 6 67H I  =t?^?^_f?gh . .?$3N"#45H  l *d/J";/H  rr)r r r __doc__recompile IGNORECASEr& classmethodrr,r(r%r? staticmethodrNr]rwtuplerrboolrrrrrrs/ 3R]] C_U 2BMM BOT BJJ:BMM J  BJJ@"-- P   -r}} =?PQ BJJ? O  $////b!c3h!DcN!!F)$S4Z)$3)$)$VcDjS.5*5*5* 5* 5*n*Tz*-04Z*BF+* sDy *f)-\!t\!*\!?@ \!  \!  \!:\! sDy \!rr)rrrtypingrrr urllib.parserr)litellm.llms.base_llm.chat.transformationrr rrrrrs7  &&-F * q!q!r