tPjOGdZddlmZmZddlmZmZddlmZddl m Z ddl m Z m Z ddlmZddlmZdd lmZd d lmZGd d ZGddZGdde Zy)z Arize Phoenix prompt manager that integrates with LiteLLM's prompt management system. Fetches prompt versions from Arize Phoenix and provides workspace-based access control. )AnyFinal) DictLoaderselect_autoescape)ImmutableSandboxedEnvironment)CustomPromptManagement)PromptManagementBasePromptManagementClient)AllMessageValues) PromptSpec)StandardCallbackDynamicParams)ArizePhoenixClientc ReZdZdZ d dedeeeefdeeefdedzfdZdZ y) ArizePhoenixPromptTemplatezA Represents a prompt template loaded from Arize Phoenix. N template_idmessagesmetadatamodelcp||_||_||_|xs|jd|_|jd|_|jd|_|jd|_|jdi|_|jdd|_ |jdd |_ y) N model_namemodel_provider temperature max_tokensinvocation_parameters descriptiontemplate_formatMUSTACHE) rrrgetrrrrrrr)selfrrrrs |/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/integrations/arize/arize_phoenix_prompt_manager.py__init__z#ArizePhoenixPromptTemplate.__init__s'    8hll<8 &ll+;<#<< 6",,|4%-\\2I2%N"#<< r:'||,=zJc<d|jd|jdS)NzArizePhoenixPromptTemplate(id='z ', model='z'))rrr!s r"__repr__z#ArizePhoenixPromptTemplate.__repr__.s#01A1A0B*TZZLXZ[[r$N) __name__ __module__ __qualname____doc__strlistdictrr#r'r$r"rrs[! KKtCH~&KsCx. K Tz K$\r$rceZdZdZ ddedzdedzdedzfdZdeddfd Zd eeefdede fd Z dd ed eeefdzde e fdZ d ede dzfdZde efdZy)ArizePhoenixTemplateManageram Manager for loading and rendering prompt templates from Arize Phoenix. Supports: - Fetching prompt versions from Arize Phoenix API - Workspace-based access control through Arize Phoenix permissions - Mustache/Handlebars-style templating (using Jinja2) - Model configuration and invocation parameters - Multi-message chat templates Napi_keyapi_base prompt_idc 0||_||_||_i|_t |j|j|_t titddgdddddd |_ |jr|j|jyy) N)r3r4htmlxmlz{{z}}z{%z%}z{#z#})loader autoescapevariable_start_stringvariable_end_stringblock_start_stringblock_end_stringcomment_start_stringcomment_end_string) r3r4r5promptsr arize_clientrrr jinja_env_load_prompt_from_arize)r!r3r4r5s r"r#z$ArizePhoenixTemplateManager.__init__>s    ">@ .t||dmm\7b>(&%9"& $#!!%#   >>  ( ( 8 r$prompt_version_idreturnc |jj|}|r"|j||}||j|<yt d|d#t $r}t d|d|d}~wwxYw)z2Load a specific prompt version from Arize Phoenix.zPrompt version ' ' not foundzFailed to load prompt version 'z' from Arize Phoenix: N)rBget_prompt_version_parse_prompt_datarA ValueError Exception)r!rE prompt_datatemplatees r"rDz3ArizePhoenixTemplateManager._load_prompt_from_arize`s l!%!2!2!E!EFW!XK"&"9"9+GX"Y2: ./ #34E3Fk!RSS l=>O=PPfghfijk k ls>AA A/A**A/datac |jdi}|jdg}|jdi}i}d|vr|d}n6d|vr|d}n,|jD]\}}t|ts|}n|jd|jd|jdd |jd |jd d ||jd |jdd} t ||| S)zBParse Arize Phoenix prompt data and extract messages and metadata.rNrropenai anthropicrrrr template_typerrrr)rrrrTrrrr)rrr)r items isinstancer/r) r!rPrE template_datarinvocation_paramsprovider_paramskeyvaluers r"rJz.ArizePhoenixTemplateManager._parse_prompt_datans#xx B7 '++J;$(88,CR#H ( (/9O - -/ D;P!\`aq\r!@--0JT0Q-)S )r$r2ceZdZdZ ddedzdedzdedzffd ZedefdZedefd Z d ded e ee fdzde e ee ee fffd Z d!d edzd e ede ee fezdzde ee fdzdedzd e ee fdzde e ee ee fdzffdZde efdZd"dZdedzdedzdedefdZ d#dedzdedzd e dzdededzdedzdefdZ ddedzd e dzdededzdedzdedzdefdZ d$ded e ede dedzd e dzdededzdedzdedzdedzdedzde ee ee ffdZxZS)%ArizePhoenixPromptManagera  Arize Phoenix prompt manager that integrates with LiteLLM's prompt management system. This class enables using prompt versions from Arize Phoenix with the litellm completion() function by implementing the PromptManagementBase interface. Usage: # Configure Arize Phoenix access arize_config = { "workspace": "your-workspace", "access_token": "your-token", } # Use with completion response = litellm.completion( model="arize/gpt-4o", prompt_id="UHJvbXB0VmVyc2lvbjox", prompt_variables={"question": "What is AI?"}, arize_config=arize_config, messages=[{"role": "user", "content": "This will be combined with the prompt"}] ) Nr3r4r5c \t|di|||_||_||_d|_y)Nr0)superr#r3r4r5_prompt_manager)r!r3r4r5kwargs __class__s r"r#z"ArizePhoenixPromptManager.__init__s2 "6"   "CGr$rFcy)z9Integration name used in model names like 'arize/gpt-4o'.arizer0r&s r"integration_namez*ArizePhoenixPromptManager.integration_namesr$c|j1t|j|j|j|_|jS)z*Get or create the prompt manager instance.)r3r4r5)r{r2r3r4r5r&s r"prompt_managerz(ArizePhoenixPromptManager.prompt_managers@    '#> ..$D ###r$prompt_variablescp|jj|}|std|d|jj||xsi}|j|j |j d}|j}i}d|vr|d}n d|vr|d}|jD]\}} ||vs | ||<||fS)a Get a prompt template and render it with variables. Args: prompt_id: The ID of the prompt version prompt_variables: Variables to substitute in the template Returns: Tuple of (rendered_messages, metadata) zPrompt template 'rH)rrrrRrS) rrrrKrprrrrrU) r!r5rrNrhrrXrYrZr[s r"get_prompt_templatez-ArizePhoenixPromptManager.get_prompt_templates--::9E0 ;GH H$(#6#6#F#FyRbRhfh#i^^#//"-- $,#A#A ( (/9O - -/ 1 1 ,     1 1 7 78ikl m^+ +  ,s$AA4& A44 B5=-B0*B50B5c6|jjS)z!Get list of available prompt IDs.)rrur&s r"get_available_promptsz/ArizePhoenixPromptManager.get_available_promptsWs""1133r$cD|jrd|_|jyy)z"Reload prompts from Arize Phoenix.N)r5r{rr&s r"reload_promptsz(ArizePhoenixPromptManager.reload_prompts[s >>#'D    r$ prompt_specdynamic_callback_paramsc |duS)z Determine if prompt management should run based on the prompt_id. Arize Phoenix needs a prompt_id to compile, so it declines requests without one; prompt loading itself happens in the _compile_prompt_helper method. Nr0)r!r5rrs r"should_run_prompt_managementz6ArizePhoenixPromptManager.should_run_prompt_managementas$$r$ prompt_labelprompt_versionc`| td ||jjvr|jj||j ||\}}|j d} i} dD]} | |vs|| | | <t ||| | dS#t$r} td|d| d} ~ wwxYw)aM Compile an Arize Phoenix prompt template into a PromptManagementClient structure. This method: 1. Loads the prompt version from Arize Phoenix 2. Renders it with the provided variables 3. Returns formatted chat messages 4. Extracts model and optional parameters from metadata N6prompt_id is required for Arize Phoenix prompt managerrr)r5prompt_templateprompt_template_modelprompt_template_optional_paramscompleted_messageszError compiling prompt 'z': )rKrrArDrr r rL) r!r5rrrrrrhrtemplate_modeloptional_paramsrrOs r"_compile_prompt_helperz0ArizePhoenixPromptManager._compile_prompt_helperos$  UV V K 3 3 ; ;;##;;IF261I1I)Ue1f . %4$7$7$@N&(O DO+->       ##%)(C2W  r$rvr()NNNN)rFN)NN)NNNFF)r)r*r+r,r-r#propertyrr2rr/rtupler.r rrrrr r boolrintr rrr __classcell__)r}s@r"rxrxsY2## $ Ht H* H: H#$ ;$$37++++sCx.4/++ t$%tCH~5 6 ++b6:04 $265,t5,'(5,CH~+d2 5, S#X- 5, : 5,sCx.4/5, t$%tCH~'<< =5,n4tCy4 %: % $& %"? %  %($(%)4K:4K $&4K+ 4K "? 4K Dj 4Kd 4K 4Kv*.#'%) : + "?   $&  Dj  d    @*.#'%)38=B  '( !  :  +  "?  $& Dj d  &*D[ 04d{  sD)*D0 1 r$rxN)r,typingrrjinja2rrjinja2.sandboxr-litellm.integrations.custom_prompt_managementr+litellm.integrations.prompt_management_baser r litellm.types.llms.openair "litellm.types.prompts.init_promptsr litellm.types.utilsr arize_phoenix_clientrrr2rxr0r$r"rsS 08P79=4\\6I)I)X] 6] r$