uPj UddlmZmZddlmZmZmZmZddlZddl m Z ddl m Z ddl mZddlmZddlmZmZdd lmZdd lmZmZeZeed <ed d gZeed<deeeffdZej?deeegdZ ejCdd geegdefdZ"de#e$e%ffdZ&ej?deegdZ'ejCdd geegdZ(y))AnyFinal) APIRouterDepends HTTPExceptionRequestN)verbose_proxy_logger) RedisCache) safe_dumps)SensitiveDataMasker)ProxyErrorTypesProxyException)user_api_key_auth)CachePingResponseHealthCheckCacheParamsmaskerz/cachecaching)prefixtagsrouterreturnc:tjiS ttjj}|rtdi|j ni}t j |S#ttf$r"}tjd|icYd}~Sd}~wwxYw)a Safely extracts and cleans cache parameters. The health check UI needs to display specific cache parameters, to show users how they set up their cache. eg. { "host": "localhost", "port": 6379, "redis_kwargs": {"db": 0}, "namespace": "test", } Returns: Dict containing cleaned and masked cache parameters Nz!Error extracting cache params: %s) litellmcachevarsr model_dumpr mask_dictAttributeError TypeErrorr debug) cache_paramscleaned_paramses a/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/caching_routes.py_extract_cache_paramsr&s"}} "7==#6#67 Wc 6 F F Q Q Sik// I &""#FJ sAA))B8BBBz/ping)response_model dependenciesc &Ki}i}tj*ttddddtj dd t jttj}|jddt}tjjd k(rtjjd{}tjd t|ztjj!d d d ddgd{tjdt#dttjjddt||St#dttjjt|S77#t$$rt&$rTtj(ddt|t|d}tt|tj ddwxYww)z6 Endpoint for checking if cache can be pinged N,Cache not initialized. litellm.cache is Nonez{})messagelitellm_cache_paramshealth_check_cache_params cache_ping)r+typeparamcoderredisz/cache/ping: ping_response: test_keyz test-modeluserztest from litellm)rolecontent)resultmodelmessagesz"/cache/ping: done with set_cache()healthyTsuccess)status cache_type ping_responseset_cache_responser,r-)r=r>r,zCache health check failedzService Unhealthy)rrrr r cache_ping_errorrrrpopr&r0pingr r!strasync_add_cacherr Exception exception)r,cleaned_cache_paramsr? error_messages r%r.r.2s,.+-}}M,015!11  - %//W]]0CD  $/46 ==   ()0););)=#=M & &'EMHZ'Z [--//!"#)6IJK0   ! & &'K L$ w}}112"#,%/0D%E*>  % w}}112%/0D%E '$> *    &&'BC*$./C$D)34H)I }- 11     sQ?HBF(F$ AF(F&AF(+H,7F(#H$F(&F((A&HHz/delete)rr(requestcK tj tdd|jd{}|j dd}tjj dk(r,tjj |d{dd iStd d tjj d 773#t$r}td d |dd}~wwxYww)a Endpoint for deleting a key from the cache. All responses from litellm proxy have `x-litellm-cache-key` in the headers Parameters: - **keys**: *Optional[List[str]]* - A list of keys to delete from the cache. Example {"keys": ["key1", "key2"]} ```shell curl -X POST "http://0.0.0.0:4000/cache/delete" -H "Authorization: Bearer sk-1234" -d '{"keys": ["key1", "key2"]}' ``` Nr/r* status_codedetailkeysr3)rOr=r< Cache type z; does not support deleting a key. only `redis` is supportedzCache Delete Failed())rrrjsongetr0delete_cache_keysrF)rJ request_datarOr$s r% cache_deleterWzs& == C8fg g$+LLN2 "&&vt4 ==   (--11t1< < <)  $W]]%7%7$88st 3 =  )!A.   sKC#0CB=AC B? CC#*C?C C  CC  C#c |j}|t|fS#t$r%}tjd|dgdfcYd}~Sd}~wwxYw)z Helper function to safely get Redis client list information. Returns: tuple: (client_list, num_clients) where num_clients is -1 if CLIENT LIST is unavailable zCCLIENT LIST command failed (likely restricted on managed Redis): %sz8CLIENT LIST command not available on this Redis instanceN) client_listlenrFr warning)cache_instancerZr$s r%_get_redis_client_infor^sXP+779 C ,,, P$$%jlmnJKROOPs A AA A z /redis/info)r(cK tj tddtjjdk(r(t tjjt s)tddtjjdt tjj\}}tjjj}|||d S#t$r}tdd |d d}~wwxYww) z* Endpoint for getting /redis/info Nr/r*rLr3rPrQz does not support redis info) num_clientsclientsinfoService Unhealthy (rR) rrrr0 isinstancer r^rbrF)rZr` redis_infor$s r%cache_redis_inforfs == C8fg g ""g-*W]]=P=PR\2]$W]]%7%7$88TU  $:'--:M:M#N [$MM//446 '"   (1-   s)DCC#"D# D,C==DDz /flushallcK tj tddtjjdk(rTt tjjt r,tjjj ddiStdd tjjd #t$r}tdd |d d}~wwxYww) a A function to flush all items from the cache. (All items will be deleted from the cache with this) Raises HTTPException if the cache is not initialized or if the cache type does not support flushing. Returns a dictionary with the status of the operation. Usage: ``` curl -X POST http://0.0.0.0:4000/cache/flushall -H "Authorization: Bearer sk-1234" ``` Nr/r*rLr3r=r<rPrQz does not support flushingrcrR)rrrr0rdr flushallrF)r$s r%cache_flushallris  == C8fg g ==   (Z 8K8KZ-X MM   ( ( *)  $W]]%7%7$88RS   (1-   s/CB B;C)B;; CCCC))typingrrfastapirrrrrlitellm._loggingr litellm.caching.cachingr *litellm.litellm_core_utils.safe_json_dumpsr 0litellm.litellm_core_utils.sensitive_data_maskerr litellm.proxy._typesr r$litellm.proxy.auth.user_api_key_authrlitellm.types.cachingrrr__annotations__rdictrDr&rTr.postrWtuplelistintr^rfrirr%rzsW>>1.AP@BK#%%   tCH~8 $+,-  @  @ F +,-  # #  # L PeD#I.> P+,-   @ +,-     ry