uPjddlZddlmZddlmZmZmZmZmZddl Z ddl m Z ddl m Z ddlmZddlmZGdd e Zy) N) Coroutine)AnyFinalLiteralcastoverload)MIN_NON_ZERO_TEMPERATURE)OpenAIGPTConfigget_secret_str)AllMessageValuescReZdZUdZededzfdZdZedze d<dZ ee zdze d<dZ e dze d<dZe dze d<dZedze d <dZedze d <dZedze d <dZee zdze d <dZedze d <dZedze d<dZe dze d<dZe dze d<dZee zdze d< d%dedzdee zdzde dzde dzd edzd edzd edzd ee zdzd edzdedzde dzde dzdee zdzddfdZefdZdefdZde de dedede f dZde ede efdZe de edede!dde"e#e#e effdZ$e d&de edede!dde efd Z$ d&de ededede ee"e#e#e efzffd! Z$d"edzd#edzde%edzedzffd$Z&xZ'S)'DeepInfraConfigz Reference: https://deepinfra.com/docs/advanced/openai_api The class `DeepInfra` provides configuration for the DeepInfra's Chat Completions API interface. Below are the parameters: returnNcy)N deepinfra)selfs o/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/deepinfra/chat/transformation.pycustom_llm_providerz#DeepInfraConfig.custom_llm_providersfrequency_penalty function_call functions logit_bias max_tokensnpresence_penaltystop temperaturetop_presponse_formattools tool_choicectj}|jD]%\}}|dk7s |t|j||'y)Nr)localscopyitemssetattr __class__)rrrrrrrrrr r!r"r#r$locals_keyvalues r__init__zDeepInfraConfig.__init__%sF  !--/ 4JCf}!2U3 4rc t|SN)super get_config)clsr*s rr2zDeepInfraConfig.get_config:sw!##rmodelcrgd}tj||jr|jd|S)N)streamrrrrrmax_completion_tokensrrrr r!r"r#r$)r4rreasoning_effort)litellmsupports_reasoningrappend)rr4supported_openai_paramss rget_supported_openai_paramsz+DeepInfraConfig.get_supported_openai_params>s=* $  % % $ 8 8  $ * *+= >&&rnon_default_paramsoptional_params drop_paramscR|j|}|jD]\}}|dk(r|dk(r |dk(rt}|dk(rJ|dk7s&|dk7s,tjdus|durd}Etj j d |d d |d k(r||d<u||vsz|}|||<|S)N)r4r rz"mistralai/Mistral-7B-Instruct-v0.1r$autononeTz&Deepinfra doesn't support tool_choice=zS. To drop unsupported openai params from the call, set `litellm.drop_params = True`i)message status_coder7r)r=r(r r9r@utilsUnsupportedParamsError)rr>r?r4r@r<paramr-s rmap_openai_paramsz!DeepInfraConfig.map_openai_paramsXs*.)I)IPU)I)V.446 3LE5&5A:%Cg:g0 %F?u**d2kT6I $%mmBB&LUGTg%h(+C1105 -11$-2OE*' 3(rmessagescH|D]}|jddk(s|jd}t|ts:t|dk(r=t|dtr*|djddk(rd|dvr |dd|d<t j ||d<|S)a Transform tool message content from array to string format for DeepInfra compatibility. DeepInfra requires tool message content to be a string, not an array. This method converts tool message content from array format to string format. Example transformation: - Input: {"role": "tool", "content": [{"type": "text", "text": "20"}]} - Output: {"role": "tool", "content": "20"} Or if content is complex: - Input: {"role": "tool", "content": [{"type": "text", "text": "result"}]} - Output: {"role": "tool", "content": "[{"type": "text", "text": "result"}]"} roletoolcontentrtypetext)get isinstancelistlendictjsondumps)rrJrDrNs r_transform_tool_message_contentz/DeepInfraConfig._transform_tool_message_contentvs  AG{{6"f,!++i0gt,G )&wqz48#AJNN62f<"gaj0.5QZ-? *.2ZZ-@ *# A&ris_asyncTcyr0rrrJr4rZs r_transform_messagesz#DeepInfraConfig._transform_messagess7:rFcyr0rr\s rr]z#DeepInfraConfig._transform_messagess "%rc|rfd}|Stttdd}j |S)zv Transform messages for DeepInfra compatibility. Handles both sync and async transformations. cKtt ttdd}|d{}j |S7w)NTrJr4rZ)r1rr]rrrY) parent_resulttransformed_messagesr*rJr4rs r_async_transformz=DeepInfraConfig._transform_messages.._async_transformsU',_d'W%UT'$-QU=V(X( 5B.A$;;!gene9T$?$M77 F Frapi_baseapi_keycN|xstdxsd}|xs td}||fS)NDEEPINFRA_API_BASEz#https://api.deepinfra.com/v1/openaiDEEPINFRA_API_KEYr )rrerfdynamic_api_keys r$_get_openai_compatible_provider_infoz4DeepInfraConfig._get_openai_compatible_provider_infos5l~.BClGl!(!ON;N,O((r) NNNNNNNNNNNNN)F)(__name__ __module__ __qualname____doc__propertystrrrint__annotations__rrVrrTrrrrrr r!r"r#r$r. classmethodr2r=boolrIr rYrrrrr]tuplerk __classcell__)r*s@rrr s S4Z%)sTz('+M3:$+!Itd{!"Jt "!Jd !AsTz#'cDj'"D#*t ""Kt"E3:#'OTD['E4$;%)Ktd"))-+/!%"&!%'+"&"& '+!)-4:4TzD(4$; 4 4K 4 $J 4 :4*4Dj444Z4Tz44d{44Z$&4 4*$$''4      <"=M8N"SWXhSi"H:-.:7::FMdm: 3T"233 4:: $) %'(%%%. %   %%NSG-.G7:GFJG  )Cd;K6L,L"M MG4)d )-04Z) sTz3:% &)rr)rWcollections.abcrtypingrrrrrr9litellm.constantsr +litellm.llms.openai.chat.gpt_transformationr litellm.secret_managers.mainr litellm.types.llms.openair rrrrr~s. %666G76{)o{)r