tPj|0.UdZddlZddlmZmZmZddlmZddlm Z ddl m Z ddl m Z er ddlmZmZmZmZn ddlmZmZmZmZdd lmZdd lmZmZmZmZeZeed <ej;d d gee geej<ee fdede fdZejAdd gee gedee fde!dedde fdZ"ejGdd gee gedee fde!dedde fdZ$y#e$rYwxYw)a/ FALLBACK MANAGEMENT ENDPOINTS Dedicated endpoints for managing model fallbacks separately from general config. POST /fallback - Create or update fallbacks for a specific model GET /fallback/{model} - Get fallbacks for a specific model DELETE /fallback/{model} - Delete fallbacks for a specific model N) TYPE_CHECKINGFinalLiteral)verbose_proxy_logger)UserAPIKeyAuth)get_all_fallbacks)user_api_key_auth) APIRouterDepends HTTPExceptionstatus)ConfigRepository)FallbackCreateRequestFallbackDeleteResponseFallbackGetResponseFallbackResponserouterz /fallbackzFallback Management)tags dependenciesresponse_model status_codedatauser_api_key_dictcDKddlm}m}m}m} |t t jddi|j}|j|vr5t t jd|jdt|d |jDcgc] }||vs| }}|r*t t jd |t|d |j|jvr+t t jdd|jd i|d us|t t jdd i|jd{} | jdi} d} |j dk(rd} n|j dk(rd} | j| g} d} t#| D]2\}}|j|vs|j|ji| |<d } n| s'| j%|j|ji| | | <t'j(| }t+|j,j/ddid|dd|idd{t1|| | t3j4d|j|j|j t7|j|j|j d| rdnddScc}w77#t $rt8$r=}t3j:d |d !t t jdd"|id}~wwxYww)#a Create or update fallbacks for a specific model. This endpoint allows you to configure fallback models separately from the general config. Fallbacks are triggered when a model call fails after retries. **Example Request:** ```json { "model": "gpt-3.5-turbo", "fallback_models": ["gpt-4", "claude-3-haiku"], "fallback_type": "general" } ``` **Fallback Types:** - `general`: Standard fallbacks for any error (default) - `context_window`: Fallbacks specifically for context window exceeded errors - `content_policy`: Fallbacks specifically for content policy violations r llm_router prisma_client proxy_configstore_model_in_dbNerrorRouter not initializedrdetailzModel 'z' not found in router)r available_modelszInvalid fallback models: z' cannot be its own fallbackTcDatabase storage not enabled. Set 'STORE_MODEL_IN_DB=True' in your environment to use this feature.router_settings fallbackscontext_windowcontext_window_fallbackscontent_policycontent_policy_fallbacksF param_namer, param_valuer.createupdatewhererz(Fallback configured: %s -> %s (type: %s)zFallback configuration updatedcreatedz successfully)modelfallback_models fallback_typemessagezError creating fallback: %sexc_infozFailed to create fallback: )litellm.proxy.proxy_serverrrrrr r HTTP_500_INTERNAL_SERVER_ERROR model_namesr6HTTP_404_NOT_FOUNDlistr7HTTP_400_BAD_REQUEST get_configgetr8 enumerateappendjsondumpsrtableupsertsetattrrinfor Exceptionr )rrrrrrr>minvalid_fallback_modelsconfigr& fallback_keyexisting_fallbacksfallback_updatedi fallback_dictrouter_settings_jsones /home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/management_endpoints/fallback_management_endpoints.pycreate_fallbackrX)su>n  "AA!9:  (33 ::[ ("55&tzzl2GH(,[(9 6:5I5I)bQVaMa!)b)b ""7789P8QR(,[(9  ::-- -"7774::,6R!ST  D (M,A"77C +5577!',=r!B#   !1 15L   #3 35LAP@S@ST`bd@e! )*< =  A}zz]*)-T5I5I(J"1%#'     % %tzz43G3G&H I); %'+jj&A}-33::!23#4#7)*>? ;    L*<=!! 6 DDXDXZ^ZlZl  ** 00,,-;KiQZ-[[hi   Y*c68> 2   ""#@!dS==:1#>?   si L A? ;    L*;<!!"CUMZ%'A  c8B ,   ""#@!dS==:1#>?   sN GAE1%E,&CE15E/65E1+G,E1/E11G8F;;GG)%__doc__rFtypingrrrlitellm._loggingrlitellm.proxy._typesrlitellm.proxy.auth.model_checksr$litellm.proxy.auth.user_api_key_authr fastapir r r r ImportError&litellm.repositories.config_repositoryrrts 001/=BAA EE D   +,-#""  )00A(BM M %M M `  +,-&  MV(/0A(B0 0 HI0 &0  0 f  +,-) MV(/0A(Bf f HIf &f  f K    s D DD