uPj U d dl Z d dlmZ d dlmZmZ d dlZd dlmZ dZ ee
d< G d de Z ed Z g d Z
ee
d
< d efd Z ed
dedefd Zy) N) lru_cache)FinalLiteral)BaseLLMExceptionzhttps://huggingface.co
HF_HUB_URLc e Zd Z ddej dz dej
dz dej ez dz f fd
Z xZ S )HuggingFaceErrorNrequestresponseheadersc . t | ||||| y )N) status_codemessager
r r )super__init__)selfr r r
r r __class__s j/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/huggingface/common_utils.pyr zHuggingFaceError.__init__
s& #
)NNN)
__name__
__module__ __qualname__httpxRequestResponseHeadersdictr
__classcell__)r s @r r r sV
)-*./3
%
..4'
%,
r r )ztext-generation-inferenceconversationalztext-classificationztext-generation hf_task_listgenerated_textc g d}|D ]k }| j j | r| j |dd } | j | sG| ddd j |ddd dd ddd } m | S )z
Parse the output text to remove any special characters. In our current approach we just check for ChatML tokens.
Initial issue that prompted this - https://github.com/BerriAI/litellm/issues/763
)z
<|assistant|>z
<|system|>z<|user|>zz N)strip
startswithreplaceendswith)r! chat_template_tokenstokens r
output_parserr, - s #]% T ! , ,U 3 + 3 3E2q AN " "5 ) +DbD 1 9 9%"+r1 MdPRd SN T
r )maxsizemodelreturnc ddi}t j d rdt j d |d< t d| }ddgi} t j ||| }|j |j
j d }|t d | |S # t j $ rU}t |d r/t |j d
d }t |j di }nd}i }t d| || d
}~ww xY w)aT
Fetch provider mappings for a model from the Hugging Face Hub.
Args:
model: The model identifier (e.g., 'meta-llama/Llama-2-7b')
Returns:
dict: The inference provider mapping for the model
Raises:
ValueError: If no provider mapping is found
HuggingFaceError: If the API request fails
Acceptzapplication/jsonHUGGINGFACE_API_KEYzBearer
Authorizationz /api/models/expandinferenceProviderMapping)r paramsNz$No provider mapping found for model r r i r z"Failed to fetch provider mapping: )r r r )
osgetenvr r getraise_for_statusjson
ValueError HTTPErrorhasattrgetattrr r )r/ r pathr7 r provider_mappinger s r !_fetch_inference_provider_mappingrD < s +,G yy&'%,RYY7L-M,N#O L UG4D : ;rL s} ! F,
E ,
'
$ e # 3)
S )
T )
)
r