uPjJUddlZddlmZmZddlZddlZddlmZGddeejZ GddeejZ e de DZ eed <e d e DZeed <d ed edzfdZd ed edzfdZdaej&dzed<d ej&fdZGddej*ZGddej,ZGddej.ZGddeZGddej2ZGddej4ZGddej8ZGd d!ej:ZGd"d#eZGd$d%eZGd&d'eZ Gd(d)ejBZ"Gd*d+ejBZ#Gd,d-ejHZ$Gd.d/ejJZ%Gd0d1ejLZ&Gd2d3ejNZ'Gd4d5e'Z(Gd6d7ejRZ)Gd8d9eZ*eeeee*eeeeee e$e"e#e%e&e'e)e$e(gZ+eed:<Gd;dej.Z.Gd?d@ejJZ/GdAdBeZ0GdCdDe,Z1GdEdFe,Z2GdGdHe"Z3GdIdJe,Z4GdKdLe,Z5y)MN)AnyFinal)LiteLLMCommonStringsc&eZdZdZdZ dZ dZ dZy)RateLimitErrorCategoryap Category of a rate limit error, allowing callers to distinguish where the rate limit originated. Exposed on every :class:`RateLimitError` instance via the ``category`` attribute. Use these values to switch on the rate limit source, e.g.:: try: ... except litellm.RateLimitError as e: if e.category == RateLimitErrorCategory.LITELLM_RATE_LIMIT: ... # litellm's own limiter (key/team/user/model RPM/TPM/budget) elif e.category == RateLimitErrorCategory.VENDOR_RATE_LIMIT: ... # the upstream LLM provider returned 429 vendor_rate_limitvendor_batch_rate_limitlitellm_rate_limitlitellm_batch_rate_limitN)__name__ __module__ __qualname____doc__VENDOR_RATE_LIMITVENDOR_BATCH_RATE_LIMITLITELLM_RATE_LIMITLITELLM_BATCH_RATE_LIMITW/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/exceptions.pyrrs- ,U7W-x9prrc,eZdZdZdZ dZ dZ dZ dZy) RateLimitTypeu The dimension that was exceeded when a rate-limit error fired. This is orthogonal to :class:`RateLimitErrorCategory` — *category* tells callers **who** rate-limited the request (the upstream vendor vs. one of litellm's own limiters), while *type* tells them **which limit dimension** was exceeded (an RPM ceiling, a TPM ceiling, a max-parallel-requests ceiling, a budget cap, or a max-iterations cap). Surfaced both on every :class:`RateLimitError` instance via the ``rate_limit_type`` attribute and on the structured ``StandardLoggingPayload.error_information.error_rate_limit_type`` field so custom callbacks / metrics consumers can split rate-limit failures by cause without parsing free-text error messages. requeststokensconcurrent_requestsbudgetmax_iterationsN) r r rrREQUESTSTOKENSCONCURRENT_REQUESTSBUDGETMAX_ITERATIONSrrrrr3s2 HL FH/L FE%NErrc#4K|]}|jywNvalue).0cs r r)Ts.W1qww.W_RATE_LIMIT_CATEGORY_VALUESc#4K|]}|jywr$r%)r'ts rr)r)Us*Jq177*Jr*_RATE_LIMIT_TYPE_VALUESr&returncpt|tr |jSt|tr |tvr|Sy)u\Return ``value`` only if it matches a known :class:`RateLimitErrorCategory`. Used at duck-typed read sites (StandardLoggingPayload extraction, Prometheus labels) to reject `.category` strings set by unrelated third-party exceptions — otherwise those would leak into custom-callback payloads and Prometheus label cardinality. N) isinstancerr&strr+r%s rvalidate_rate_limit_categoryr3Xs3%/0{{%%+F"F rcpt|tr |jSt|tr |tvr|Sy)zReturn ``value`` only if it matches a known :class:`RateLimitType`. See :func:`validate_rate_limit_category` for the rationale. N)r1rr&r2r.r%s rvalidate_rate_limit_typer5gs2 %'{{%%+B"B r_MINIMAL_ERROR_RESPONSEcrt,tjdtjddatS)z;Get a cached minimal httpx.Response object for error cases.GEThttps://litellm.aimethodurl status_coderequest)r6httpxResponseRequestrrr_get_minimal_error_responserDvs3&"'..MM4HI#  #"rc reZdZ d dejdzdedzdedzdedzffd ZdZdZ xZ S) AuthenticationErrorNresponselitellm_debug_info max_retries num_retriesc8d|_d||_||_||_||_||_||_|xs6tj|jtjdd|_ t|1|j|jdy)Nizlitellm.AuthenticationError: r9r:r;r>rGbody) r?message llm_providermodelrHrIrJrArBrCrGsuper__init__ selfrNrOrPrGrHrIrJ __class__s rrRzAuthenticationError.__init__s6wi@ ( "4&&  ENN((MM4HI%    LL4==t  rc|j}|jr|d|jdz }|jr|d|jz }|SN LiteLLM Retried:  times, LiteLLM Max Retries: rNrJrIrT_messages r__str__zAuthenticationError.__str__V<<    ,T-=-=,>fE EH    1$2B2B1CD DHrc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s r__repr__zAuthenticationError.__repr__r_rNNNN r r rrArBr2intrRr^ra __classcell__rUs@rrFrF] +/)-"&"& ..4'   $J  4Z 4Z 2rrFc reZdZ d dejdzdedzdedzdedzffd ZdZdZ xZ S) NotFoundErrorNrGrHrIrJc8d|_d||_||_||_||_||_||_|xs6tj|jtjdd|_ t|1|j|jdy)Nizlitellm.NotFoundError: r9r:r;r>rL) r?rNrPrOrHrIrJrArBrCrGrQrR rTrNrPrOrGrHrIrJrUs rrRzNotFoundError.__init__s0 :  ("4&&  ENN((MM4HI%    LL4==t  rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zNotFoundError.__str__r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazNotFoundError.__repr__r_rrbrcrfs@rririrgrric ~eZdZ d dejdzdedzdedzdedzdedzf fd ZdZ d Z xZ S) BadRequestErrorNrGrHrIrJrMc Rd|_d||_||_||_||_||_||_|;t|tjr!t|drt|dd||_ nt|_ t |=|j|j|y)Nr8zlitellm.BadRequestError: _requestrL)r?rNrPrOrHrIrJr1rArBhasattrgetattrrGrDrQrR rTrNrPrOrGrHrIrJrMrUs rrRzBadRequestError.__init__s27)<  ("4&&  8U^^4*-*d3?$DM79DM  LL4==t  rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zBadRequestError.__str__r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazBadRequestError.__repr__r_rNNNNN) r r rrArBr2rddictrRr^rarerfs@rroroso +/)-"&"&  ..4'   $J  4Z 4Z Tk Brroc veZdZ ddejdzdedzdedzdedzdedzf fd ZxZ S) ImageFetchErrorNrGrHrIrJrMc 4t |||||||||y)N)rNrPrOrGrHrIrJrM)rQrRrts rrRzImageFetchError.__init__ s/ %1##  r)NNNNNNN) r r rrArBr2rdrxrRrerfs@rrzrz so*.)-"&"&  ..4'   $J  4Z 4Z Tk  rrzc jeZdZ d dejdedzdedzdedzffd ZdZdZ xZ S) UnprocessableEntityErrorNrGrHrIrJcd|_d||_||_||_||_||_||_t|!|j|dy)Niz"litellm.UnprocessableEntityError: rL) r?rNrPrOrHrIrJrQrRrks rrRz!UnprocessableEntityError.__init__$s_;G9E  ("4&&  LL8$  rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^z UnprocessableEntityError.__str__9r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rraz!UnprocessableEntityError.__repr__Ar_rNNNrcrfs@rr}r}#U*."&"& ..   $J  4Z 4Z *rr}c jeZdZ d dedzdedzdedzdedzdedzf fd ZdZd ZxZ S) TimeoutNrHrIrJheadersexception_status_codec tjdd} t | | |xsd|_d||_||_||_||_||_ ||_ ||_ y)NPOSThttps://api.openai.com/v1r;)r@izlitellm.Timeout: ) rArCrQrRr?rNrPrOrHrIrJr) rTrNrPrOrHrIrJrrr@rUs rrRzTimeout.__init__Kst+  )07C*7)4  ("4&& rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zTimeout.__str__er_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazTimeout.__repr__mr_rrw) r r rr2rdrxrRr^rarerfs@rrrJsi *."&"&#,0  $J  4Z 4Z #Tz4rrc jeZdZ d dejdedzdedzdedzffd ZdZdZ xZ S) PermissionDeniedErrorNrGrHrIrJcd|_d||_||_||_||_||_||_t|!|j|dy)Nizlitellm.PermissionDeniedError: rL) r?rNrOrPrHrIrJrQrRrSs rrRzPermissionDeniedError.__init__ws_8 B ( "4&&  LL8$  rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zPermissionDeniedError.__str__r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazPermissionDeniedError.__repr__r_rrrcrfs@rrrvrrrceZdZdZddddej dddfdejdzdedzde dzde dzdeezdee zdzd e eefdzd e ffd Z d Zd ZxZS)RateLimitErroru Unified rate-limit error. Every rate-limit condition surfaced by litellm — whether it originated from an upstream LLM provider, a vendor batch endpoint, or one of litellm's own proxy-side limiters (parallel-requests, dynamic-rate, batch-rate, budget, max-iterations, etc.) — is raised as an instance of this class. The :attr:`category` attribute lets callers distinguish the source. See :class:`RateLimitErrorCategory` for the available values. NrGrHrIrJcategoryrate_limit_typerdetailc d|_d||_||_||_||_||_||_t|tr |jn||_ t| tr | jn| |_ | t|ddnd} | r-| jD cic]\} }| t|c}} nd|_| | n |j|_t%j&d| t%j(dd|_t,|]|j|j*dd |_d |_ycc}} w) Nzlitellm.RateLimitError: rr$ https://cloud.google.com/vertex-ai/r;r?rr@rL429throttling_error)r?rNrOrPrHrIrJr1rr&rrrrsitemsr2rrrArBrCrGrQrRcodetype)rTrNrOrPrGrHrIrJrrrr_response_headerskvrUs rrRzRateLimitError.__init__s21'; ( "4&&*4X?U*V\d &0%OO ! !Ud  JRI]78Y#EcgY`W]]_.UTQq#a&y.Ufj !' 2f  %MM:    LL4==t   & !/Vs"D?c|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zRateLimitError.__str__r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazRateLimitError.__repr__r_r)r r rrrrrArBr2rdrrxrrRr^rarerfs@rrrs "+/)-"&"&2H2Z2Z6:)-:' ..4' :'  $J :'4Z:'4Z:'..:'},t3:'c3h$&:':'xrrcZeZdZ ddejdzdedzffd ZdZdZxZ S)ContextWindowExceededErrorNrGrHcd|_||_||_||_t|||j|j||jd|j |_y)Nr8rNrPrOrGrHz$litellm.ContextWindowExceededError: )r?rPrOrHrQrRrN)rTrNrPrOrGrHrUs rrRz#ContextWindowExceededError.__init__si ("4 ****#66  >dll^L rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^z"ContextWindowExceededError.__str__r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rraz#ContextWindowExceededError.__repr__r_r)NN) r r rrArBr2rRr^rarerfs@rrrs> +/)- M ..4' M  $J M.rrc>eZdZ ddededzffd ZdZdZxZS)RejectedRequestErrorN request_datarHc4d|_d||_||_||_||_||_t jdd}t jd|}t|)|j|j|j||jy)Nr8zlitellm.RejectedRequestError: rrr;r>r) r?rNrPrOrHrrArCrBrQrR) rTrNrPrOrrHr@rGrUs rrRzRejectedRequestError.__init__#s7yA  ("4(f:UV..S'J LL****#66  rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zRejectedRequestError.__str__;r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazRejectedRequestError.__repr__Cr_rr$) r r rrxr2rRr^rarerfs@rrr"s/*.     $J  0rrc ~eZdZ d dejdzdedzdedzdedzffd ZdZdZ d efd Z xZ S) ContentPolicyViolationErrorNrGrHprovider_specific_fieldsrMcd|_d||_||_||_||_||_t ||j|j|j||j|y)Nr8z%litellm.ContentPolicyViolationError: )rNrPrOrGrHrM)r?rNrPrOrHrrQrR) rTrNrPrOrGrHrrMrUs rrRz$ContentPolicyViolationError.__init__Nsr>wiH  ("4(@% LL****#66  rc"|jSr$_transform_error_to_stringrTs rr^z#ContentPolicyViolationError.__str__g..00rc"|jSr$rrs rraz$ContentPolicyViolationError.__repr__jrrr/c|j}|jr|d|jdz }|jr|d|jz }|S)z1 Transform the error to a string rXrYrZr[r\s rrz6ContentPolicyViolationError._transform_error_to_stringmsX<<    ,T-=-=,>fE EH    1$2B2B1CD DHrrb) r r rrArBr2rxrRr^rarrerfs@rrrLsi+/)-04  ..4'   $J  #'+ Tk 211 C rrc reZdZ d dejdzdedzdedzdedzffd ZdZdZ xZ S) ServiceUnavailableErrorNrGrHrIrJcTd|_d||_||_||_||_||_||_| t|ddnd}tj|j|tjdd|_ t |5|j|jdy) Nz!litellm.ServiceUnavailableError: rrrr;rrLr?rNrOrPrHrIrJrsrArBrCrGrQrR rTrNrOrPrGrHrIrJrrUs rrRz ServiceUnavailableError.__init__zs:7)D ( "4&&IQI]78Y#Ecg((%MM:    LL4==t  rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zServiceUnavailableError.__str__r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rraz ServiceUnavailableError.__repr__r_rrbrcrfs@rrry] +/)-"&"& ..4'   $J  4Z 4Z <rrc reZdZ d dejdzdedzdedzdedzffd ZdZdZ xZ S) BadGatewayErrorNrGrHrIrJcTd|_d||_||_||_||_||_||_| t|ddnd}tj|j|tjdd|_ t |5|j|jdy) Nizlitellm.BadGatewayError: rrrr;rrLrrs rrRzBadGatewayError.__init__s27)< ( "4&&IQI]78Y#Ecg((%MM:    LL4==t  rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zBadGatewayError.__str__r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazBadGatewayError.__repr__r_rrbrcrfs@rrrrrrc reZdZ d dejdzdedzdedzdedzffd ZdZdZ xZ S) InternalServerErrorNrGrHrIrJcTd|_d||_||_||_||_||_||_| t|ddnd}tj|j|tjdd|_ t |5|j|jdy) Nzlitellm.InternalServerError: rrrr;rrLrrs rrRzInternalServerError.__init__s6wi@ ( "4&&IQI]78Y#Ecg((%MM:    LL4==t  rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zInternalServerError.__str__r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazInternalServerError.__repr__r_rrbrcrfs@rrrrrrc veZdZ d dedej dzdedzdedzdedzf fd ZdZd Z xZ S) APIErrorNr?r@rHrIrJc ||_d||_||_||_||_||_||_|tjdd}t |)|j|dy)Nzlitellm.APIError: rrr;r@rM r?rNrOrPrHrIrJrArCrQrR rTr?rNrOrPr@rHrIrJrUs rrRzAPIError.__init__ sp'+G95 ( "4&& ?mm67RSG wTBrc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zAPIError.__str__!r_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazAPIError.__repr__)r_rrb) r r rrdrArCr2rRr^rarerfs@rrr sk)-)-"&"&CC % C $JC4ZC4ZC,rrc reZdZ d dejdzdedzdedzdedzffd ZdZdZ xZ S) APIConnectionErrorNr@rHrIrJcd||_||_||_d|_||_t j dd|_||_||_ t|-|j|jy)Nzlitellm.APIConnectionError: rrrr;)rNr@) rNrOrPr?rHrArCr@rIrJrQrR) rTrNrOrPr@rHrIrJrUs rrRzAPIConnectionError.__init__4so6gY? ( "4}}F8ST && t||Drc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^zAPIConnectionError.__str__Hr_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rrazAPIConnectionError.__repr__Pr_rrb) r r rrArCr2rdrRr^rarerfs@rrr3sb )-)-"&"&E % E  $J E4ZE4ZE(rrcReZdZ ddedzdedzdedzffd ZdZdZxZS) APIResponseValidationErrorNrHrIrJcd||_||_||_tjdd}tj d|}||_||_||_t |)|d|y)Nz$litellm.APIResponseValidationError: rrr;rr>)rGrMrN) rNrOrPrArCrBrHrIrJrQrR) rTrNrOrPrHrIrJr@rGrUs rrRz#APIResponseValidationError.__init__[so>gYG ( f:UV..S'J"4&& (wGrc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rr^z"APIResponseValidationError.__str__nr_rc|j}|jr|d|jdz }|jr|d|jz }|SrWr[r\s rraz#APIResponseValidationError.__repr__vr_rr) r r rr2rdrRr^rarerfs@rrrZsK *."&"&H  $J H 4Z H4ZH&rrc 4eZdZdededededdf fd ZxZS)JSONSchemaValidationErrorrPrO raw_responseschemar/Ncz||_||_||_d|d|d|d}||_t||||y)Nz)litellm.JSONSchemaValidationError: model=z, returned an invalid response=z , for schema=z+. Access raw response with `e.raw_response`)rPrNrO)rrrPrNrQrR)rTrPrOrrrNrUs rrRz"JSONSchemaValidationError.__init__sd(  =eWDcdpcqq~@FGGst  ugLQr)r r rr2rRrerfs@rrrs9RcRRCRQTRY]RRrrc eZdZdfd ZxZS) OpenAIErrorc0t|d|_y)Nopenai)rQrRrO)rToriginal_exceptionrUs rrRzOpenAIError.__init__s $rr$r r rrRrerfs@rrrs %%rrcxeZdZ d dedzdedzdedej dzdedzdedzdedzfd Zy) UnsupportedParamsErrorNrOrPr?rGrHrIrJc d|_d||_||_||_||_|xs6t j |jt jdd}||_||_ y)Nr8z litellm.UnsupportedParamsError: r9r:r;r>) r?rNrPrOrHrArBrCrIrJ) rTrNrOrPr?rGrHrIrJs rrRzUnsupportedParamsError.__init__sp9'C  ("4 u~~((MM4HI '&r)NNr8NNNN)r r rr2rdrArBrRrrrrrs$( *.)-"&"&'Dj'Tz '  ' ..4' ' $J'4Z'4Z'rrLITELLM_EXCEPTION_TYPEScZeZdZ d dedededzdedzdedzdedzf fd ZxZS) BudgetExceededErrorN current_cost max_budgetrNrO entity_type entity_idc"||_||_d|_|xsd|_||_||_t jj|_ tjj|_ |xsd|d|}||_ t|=|y)Nrz(Budget has been exceeded! Current cost: z, Max budget: )rrr?rOrrrrr&rrr!rrNrQrR)rTrrrNrOrrrUs rrRzBudgetExceededError.__init__s)$(.B&"4FFLL $1$8$8$>$>pG ~Ucdncop  !rrb)r r rfloatr2rRrerfs@rrrse ##'"& $"""t " Dj " 4Z ":""rrceZdZfdZxZS)InvalidRequestErrorcd|_||_||_||_t j dt j dd|_t|%|j|jdy)Nr8r9r:r;r>)rNrGrM) r?rNrPrOrArBrCrGrQrR)rTrNrPrOrUs rrRzInvalidRequestError.__init__sf  (MM4HI   LL4==t  rrrfs@rrrs    rrc jeZdZ ddedej dzdedzdedzdedzf fd ZxZS) MockExceptionNr?r@rHrIrJc ||_d||_||_||_||_||_||_|tjdd}t |)|j|dy)Nzlitellm.MockException: rrr;rrrs rrRzMockException.__init__sp'0 : ( "4&& ?mm67RSG wTBrrb) r r rrdrArCr2rRrerfs@rrrsg)-)-"&"&CC % C $JC4ZC4ZCCrrc6eZdZddededzffd ZdZxZS)LiteLLMUnknownProviderNrPcustom_llm_providerctjjj|||_t ||j||dy)N)rPr)rPrOrG)rllm_provider_not_providedr&formatrNrQrR)rTrPrrUs rrRzLiteLLMUnknownProvider.__init__sK+EEKKRR-@S   UAT_cdrc|jSr$)rNrs rr^zLiteLLMUnknownProvider.__str__ s ||rr$)r r rr2rRr^rerfs@rrrs"eced e rrc JeZdZdZ d dedzdedededef fd ZxZS) GuardrailRaisedExceptiona Raised both when a guardrail judged content and when it could not judge it at all, since a guardrail that fails closed refuses the request the same way a policy violation does. ``blocked_content`` separates the two. Set it only where the guardrail actually reached a verdict on the payload; leave it alone for an unreachable backend, a timeout, or a response the integration could not parse. Callers that treat a block as something other than a plain failure, such as the batch path dropping one record and submitting the rest, must gate on it, because dropping a record no guardrail ever inspected is a silent loss of enforcement. Nguardrail_namerN should_wrap_with_default_messager?blocked_contentcd|d|}||_||_||_|r|n||_t||jy)Nz*Guardrail raised an exception, Guardrail: z , Message: )rr?r rNrQrR)rTrrNr r?r default_messagerUs rrRz!GuardrailRaisedException.__init__sQ$NnM]]hiphq!r,&.*JPW  &r)NrTr8F) r r rrr2boolrdrRrerfs@rrrsW &*15 % 'd  ' '+/ '  '  ' 'rrc8eZdZ ddededzdeffd ZxZS)BlockedPiiEntityErrorNrrr?c~||_||_||_d|d|d|_t||jy)zJ Raised when a blocked entity is detected by a guardrail. zBlocked entity detected: z by Guardrail: z8. This entity is not allowed to be used in this request.N)rrr?rNrQrR)rTrrr?rUs rrRzBlockedPiiEntityError.__init__.sM',&2;-~N^_WX  &r)Nr8)r r rr2rdrRrerfs@rrr-s5&* ' 'd  ' ' 'rrceZdZ ddededededzdej dzdedzdedzd edzd ed effd Z d Z dZ xZ S)MidStreamFallbackErrorNrNrPrOrrGrHrIrJgenerated_contentis_pre_first_chunkc t|dd} | t| nd|_d||_||_||_||_||_||_||_ | |_ | |_ |@tj|jtjdd|d|_n||_|j} t|jd dxstjdd|d} |j}t |E|j|||j|j|j|j | t| nd|_| |_| |_||_|f|_y) Nr?rz litellm.MidStreamFallbackError: rzhttps://z.com/v1/r;r>r@)rNrOrPrGrHrIrJ)rsrdr?rNrPrOrrHrIrJrrrArBrCrGrQrRr@args)rTrNrPrOrrGrHrIrJrroriginal_status_saved_response_saved_request_saved_messagerUs rrRzMidStreamFallbackError.__init__?s|"));]D!Q3B3N3/TW9'C  ("4"4&&!2"4  !NN ,, !"<.9DM%DM"& ' y$ G! 5==,x@L !%  LL%]]#66((((  4C3N3/TW' % % #% rc|j}|jr|d|jdz }|jr|d|jz }|jr2|dt |jj d|jz }|S)NrXrYrZz Original exception: z: )rNrJrIrrr r\s rr^zMidStreamFallbackError.__str__}s<<    ,T-=-=,>fE EH    1$2B2B1CD DH  " " /T5L5L0M0V0V/WWYZ^ZqZqYrs sHrc"|jSr$)r^rs rrazMidStreamFallbackError.__repr__s||~r)NNNNNrF) r r rr2 ExceptionrArBrdr rRr^rarerfs@rrr>s 04*.)-"&"&!##(<&<&<& <& &, <& ..4' <& $J<&4Z<&4Z<&<&!<&|rrcjeZdZdZ d dededeeefdedzdeeefdzdedzf fd ZxZS) ModifyResponseExceptiona Exception raised when a guardrail wants to modify the response. This exception carries the synthetic response that should be returned to the user instead of calling the LLM or instead of the LLM's response. It should be caught by the proxy and returned with a 200 status code. This is a base exception that all guardrails can use to replace responses, allowing violation messages to be returned as successful responses rather than errors. NrNrPrrdetection_infooriginal_responsec||_||_||_||_|xsi|_||_t ||yr$)rNrPrrr r!rQrR)rTrNrPrrr r!rUs rrRz ModifyResponseException.__init__sG  (,,2 "3 !rr) r r rrr2rxrrRrerfs@rrrst "&*04(,"""38n " d " S#X- ":""rrc beZdZdZ d dedededzdeeefdzdedzdef fd ZxZ S) SensitiveDataRouteExceptiona  Exception raised when a guardrail detects sensitive data and wants to reroute the request. Instead of blocking the request, this exception signals that the request should be routed to a different model (typically an on-premise model for data privacy). The proxy catches this exception and: 1. Reroutes the current request to the specified model 2. When sticky_session_routing is True, stores the routing decision in session cache so all subsequent requests in the same session are routed to the same model Nroute_to_model session_idrr rNsticky_session_routingc||_||_||_|xsi|_||_|xsd|d||_t ||j y)NzSensitive data detected by z. Routing to model: )r%r&rr r'rNrQrR)rTr%r&rr rNr'rUs rrRz$SensitiveDataRouteException.__init__s`-$,,2&<#t$??OOcdrcs"t  &r)NNNT) r r rrr2rxrr rRrerfs@rr$r$so  &*04"'+'''d ' S#X- ' t '!%''rr$)6enumtypingrrrArlitellm.types.utilsrr2Enumrr frozensetr+__annotations__r.r3r5r6rBrDrFrirorzr}APITimeoutErrorrrrrrrAPIStatusErrorrrrrrrrrrrrrrrrrrrrr$rrrr1s  4qS$))q<FCFB&/.W@V.W%WUW!**JM*J!JJ  d  C C$J 26$.5#U^^#(&44(X(F(((V0f,,0f o 0$v>>$N)f$$)X$F88$NWV**Wv&&T'?'T*/*Z-f33-`-f++-`-&44-b%v%R#22#N"!B!B"JR :R%&$$% '_'4  )"0")"<  &00  CFOOC2_'y'8'I'"J4JZ "i "F')'r