tPjk'UdZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z m Z ddlmZej Ze ed<dadadaej Ze ed<dae dzed <ej Ze ed <iZe eeefed <d ed efdZd ed dfdZd ed efdZ de d dfdZ!ddefdZ"ddZ#de ded efdZ$ded efdZ%d dedzd dfdZ&d dedzd dfdZ'y)!aD Performance utilities for LiteLLM proxy server. This module provides performance monitoring and profiling functionality for endpoint performance analysis using cProfile with configurable sampling rates, and line_profiler for line-by-line profiling. See performance_utils.md for detailed usage examples and documentation. N)Callable)Path)AnyFinal)verbose_proxy_logger _profile_lock_sample_counter_lock_line_profiler_line_profiler_lock_wrapped_functionsprofile_sampling_ratereturnc|dk\ry|dkryt5tdz attd|z zdk(}|cdddS#1swYyxYw)zFDetermine if current request should be sampled based on sampling rate.?TgFrN)r _sample_counterint)r should_samples q/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/proxy/common_utils/performance_utils.py_should_sampler#sZ# # % 1 /#ctjatj t j d|dddy#1swYyxYw)z'Start cProfile profiling once globally.Nz(Profiling started with sampling rate: %s)r _profilercProfileProfileenablerinfor s r_start_profilingr3sR i   ((*I     % %&PRg h iiis AAAc2t|r t|yy)z> C CB32C3 B?<C>B??CCC  CC sampling_ratecfd}|S)a8Decorator to sample endpoint hits and save to a profile file. Args: sampling_rate: Rate of requests to profile (0.0 to 1.0) - 1.0: Profile all requests (100%) - 0.1: Profile 1 in 10 requests (10%) - 0.0: Profile no requests (0%) cdtddfdtjr!tjfd}|Stjfd}|S)Npathrc|ayN)_last_profile_file_path)r/s rset_last_profile_pathzBprofile_endpoint..decorator..set_last_profile_pathes&* #r!cKt}td}| |i|d{}|r t||S7#t$r|r t|wxYwwNzendpoint_profile.pstatr PathLibr+r(argskwargs is_sampling file_path_objresultfuncr,r3s r async_wrapperz:profile_endpoint..decorator..async_wrapperkso%A-%P './G'H %m4*.*?*?$?F"#M2!M%@!"#M2s,A AAAAAAAct}td}| |i|}|r t||S#t$r|r t|wxYwr5r6r8s r sync_wrapperz9profile_endpoint..decorator..sync_wrapper}sa%A-%P './G'H %m4$($$9&$9F"#M2!M "#M2s 8A)r7inspectiscoroutinefunction functoolswraps)r>r?rAr3r,s` @r decoratorz#profile_endpoint..decoratordsn + +D +  & &t , __T " # ! __T " #  r!)r,rFs` rprofile_endpointrHZs( T r!cddlm}t5t|at j ddddy#1swYyxYw)z|Enable line_profiler for dynamic function wrapping. Raises: ImportError: If line_profiler is not available r LineProfilerNzLine profiler enabled) line_profilerrKr r rrrJs renable_line_profilerrMs;+ ?  !)^N % %&= >???s #9Amodule function_namec tty t||d}|"t j d||j y|tvr |t|<t|}t|||t jd|j |y#t$rYywxYw#t$r!}t jd||Yd}~yd}~wwxYw)zDynamically wrap a function with line_profiler. Args: module: The module containing the function function_name: Name of the function to wrap Returns: True if wrapping was successful, False otherwise FNz"Function %s not found in module %sz Wrapped %s.%s with line_profilerTz(Error wrapping %s with line_profiler: %s) rM ImportErrorr getattrrwarning__name__r setattrrr(r))rNrOoriginal_functionprofiled_functionr*s r wrap_function_with_line_profilerrXs#*6=$#G  $ ( ()M}^d^m^m n  2 20A } -$22C#D '89!!"DfooWde+ , ""#M}^_`s/ B0BA B BB C (CC r>c>ddl}tt td|j 5|j ddt tj|t|}dddtjd|jS#1swY+xYw)aWrap a function directly with line_profiler. This is the recommended way to profile functions, especially closures or functions created dynamically (like wrapper_async in litellm/utils.py). Args: func: The function to wrap Returns: The wrapped function that will be profiled when called Raises: ImportError: If line_profiler is not available RuntimeError: If line_profiler cannot be enabled or function cannot be wrapped rNz!Line profiler was not initializedignorez.*__wrapped__.*)messagecategoryz&Wrapped function %s with line_profiler) warningsrMr RuntimeErrorcatch_warningsfilterwarnings UserWarning add_functionrrrT)r>r]rWs rwrap_function_directlyrcs >??  "82CkZ##D)#1$#7 8 F V 88s 9BB output_filect5ttjd dddy |r@t |}tj t |tjd|nKddlm }|}tj||j}tjd|zdddy#t$r }tjd|Yd}~-d}~wwxYw#1swYyxYw) aCollect and save line_profiler statistics. This can be called manually to collect stats at any time, or it's automatically called on shutdown if register_shutdown_handler() was used. Args: output_file: Optional path to save stats. If None, prints to stdout. Nz-Line profiler not enabled, nothing to collectzLine profiler stats saved to %sr)StringIO)streamzLine profiler stats: z(Error collecting line profiler stats: %s)r r rr'r7r%r&riorf print_statsgetvaluer(r))rd output_pathrfrg stats_outputr*s rcollect_line_profiler_statsrms V  ! & &'V W VV  V%,[%9 ))#k*:;$))*K[Y( ( **&*9&,oo&7 $))*B\*QR%VV& V & &'QST U U V'VVs/C0B C C- C(#C0(C--C00C9cndfd}tj|tjdy)awRegister a shutdown handler to collect line_profiler stats. This registers an atexit handler that will automatically save profiling statistics when the Python process exits. Safe to call multiple times (only registers once). Args: output_file: Optional path to save stats on shutdown. Defaults to 'line_profile_stats.lprof' Nzline_profile_stats.lprofcty)Nrd)rmrpsrshutdown_handlerz3register_shutdown_handler..shutdown_handlers # rsb$#1&y~~' u'  ,inn.e."d !+Y^^-U-13E$sH}-.3 % D  iEidi$g$*4E4n ?$S$$$NhDVS4ZV4VD`3:``r!