uPjUdZddlZddlmZddlmZej dejej dejej dejej dejej d gZee d <d e d e d e e de fdZd e de de fdZd e de de fdZy)zF Replace messages with compact stubs and extract human-readable keys. N)Final)detect_content_typez^#\s*(\S+\.\w+)z^//\s*(\S+\.\w+)z^File:\s*(\S+)z^---\s*(\S+\.\w+)z`(\S+\.\w{1,5})`_FILE_PATH_PATTERNSmessagefallback_index used_keysreturncp|jdd}t|trdjd|D}d}tD]?}|j |dd}|s|j d}|jdd }n|d |}|}d } ||vr|d | }| dz } ||vr|j||S) z Extract a human-readable key for the message. Looks for file path patterns in the content. Falls back to message_{index}. Handles duplicates by appending _2, _3, etc. content c3vK|]1}t|tr|jddn t|3ywtextr N isinstancedictgetstr.0ps i/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/compression/message_stubbing.py zextract_key...aTU 1d0C155,QOa79Ni/message__) rrlistjoinrsearchgroupsplitadd) rrrr keypatternmatchpathbase_keycounters r extract_keyr/skk)R(G'4 ((aY`aa C&wu~. ;;q>D**S/"%C   {()HG   !G9%1   MM# Jr)c|jdd}t|trdjd|D}|j ddz}t |}d|d|d |d }i|d|iS) z Replace message content with a compact stub. Returns a new message dict with the same role but content replaced with a short description referencing the retrieval tool. r r r c3vK|]1}t|tr|jddn t|3ywrrrs rrzstub_message..?rr rz [Compressed: u — z lines, z9. Use litellm_content_retrieve tool to get full content.])rrr#r$countr)rr)r line_count content_type stub_contents r stub_messager86skk)R(G'4 ((aY`aa d+a/J-g6L uE*Xl^DB C 0g /y, //r0 max_tokensc |jdd}t|trdjd|D}t d|dz}t ||kri|d|iS|j d}t dt |t dt |z}t d ||z}t ||kri|d|iS|d zd z}||z }dj|d |d zdj|| d z} i|d| iS)a Truncate a message's content to approximately max_tokens by keeping the first 70% and last 30% of lines with a separator in between. Uses line-based splitting to preserve code structure (function boundaries, indentation) rather than word-based splitting which mangles code. Used when a message is too large to fit entirely in the budget but too relevant to fully stub out. r r r c3vK|]1}t|tr|jddn t|3ywrrrs rrz#truncate_message..Zrrdr3rr! Nz& ...[truncated for context window]... )rrr#r$maxlenr') rr9r target_charslines avg_line_len target_lines first_count last_count truncateds rtruncate_messagerILs+kk)R(G'4 ((aY`aac:>2L 7||#.'.9g..==&EaWQE 1C!CDLa!=>L 5z\!.'.9g..&*r1K${2J % %&)SSVZV_V_`egqfqfr`sVtt -g ,y) ,,r0)__doc__retypingr%litellm.compression.content_detectionrcompile MULTILINEr__annotations__rintsetrr/r8rIr0rrTs EBJJ!2<<0BJJ"BLL1BJJ ",,/BJJ#R\\2BJJ"# Uss3xCD0$0S0T0,$-d$-$-$-r0