uPjddlmZmZmZmZddlmZddlmZddl m Z ddl Z ddl m Z erddlmZneZde j d eeefd ZGd d eZGd dee Zy)) TYPE_CHECKINGAnyFinalOptional) ConfigDict) DenseEncoder)AsymmetricDenseMixinN)verbose_router_logger)Routerembedsreturnc|r&t|tjr |js t d|jDcgc]}|d c}Scc}w)zConvert a LiteLLM embedding response to a list of embeddings. :param embeds: The LiteLLM embedding response. :return: A list of embeddings. z2No embeddings found in LiteLLM embedding response. embedding) isinstancelitellmEmbeddingResponsedata ValueError)r xs x/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/router_strategy/auto_router/litellm_encoder.pylitellm_to_listrsD FG,E,EFfkkMNN$*KK 0qAkN 00 0s Ac>eZdZedZddedffd ZxZS)CustomDenseEncoderallow)extralitellm_router_instancer c \d|vr|jd}t|di|||_y)Nr)popsuper__init__r)selfrkwargs __class__s rr!zCustomDenseEncoder.__init__s3 $ .&,jj1J&K # "6"'>$)N)__name__ __module__ __qualname__r model_configrr! __classcell__r$s@rrrs#G,L?0B??r%rc 8eZdZUdZdZeed< ddddededzd effd Z d e ed e efd Z d e e d e e efdZ d e e d e e efdZd e ed e e efdZd e ed e e efdZd e ed e e efdZd e ed e e efdZxZS)LiteLLMRouterEncoderaiLiteLLM encoder class for generating embeddings using LiteLLM. The LiteLLMRouterEncoder class is a subclass of DenseEncoder and utilizes the LiteLLM Router SDK to generate embeddings for given documents. It supports all encoders supported by LiteLLM and supports customization of the score threshold for filtering or processing the embeddings. internal_litellm_routertypeNrr model_namescore_thresholdmax_input_charscZt||||nd||_||_||_y)a2Initialize the LiteLLMEncoder. :param litellm_router_instance: The instance of the LiteLLM Router. :type litellm_router_instance: Router :param model_name: The name of the embedding model to use. Must use LiteLLM naming convention (e.g. "openai/text-embedding-3-small" or "mistral/mistral-embed"). :type model_name: str :param score_threshold: The score threshold for the embeddings. :type score_threshold: float :param max_input_chars: Longest doc, in characters, sent to the embedding model; anything longer is cut to this length. Opt-in, defaulting to 0 (send docs whole), because a caller that has to see the entire text to be correct must not be cut silently: a semantic guard that inspects only a prefix can be walked past with a benign opener. Callers that only rank text against short utterances, such as the auto-router, pass a limit so the encoder's context window cannot fail their request. :type max_input_chars: int Ng333333?)namer1)r r!r0rr2)r"rr0r1r2r$s rr!zLiteLLMRouterEncoder.__init__1s>0 />/JOPS  %'>$.r%docsr c|j}|dkr|S|Dcgc]}|d| }}||k7r!tjd||j|Scc}w)zCut every doc to `max_input_chars`, keeping the head, or return them whole when unset. The head carries the ask often enough to place it against a route, and a cut prompt still routes where an over-long one just errors out. rNzBLiteLLMRouterEncoder: cut input to %s chars for embedding model %s)r2r debugr0)r"r5limitdocclampeds r_clampzLiteLLMRouterEncoder._clampQsd ++ A:K156##fu+66 d? ! ' 'TV[]a]l]l  7s Ac (|j|fi|S)zEncode a list of text documents into embeddings using LiteLLM. :param docs: List of text documents to encode. :return: List of embeddings for each document.)encode_queriesr"r5r#s r__call__zLiteLLMRouterEncoder.__call__as #t""42622r%cDK|j|fi|d{S7w)zEncode a list of documents into embeddings using LiteLLM asynchronously. :param docs: List of documents to encode. :return: List of embeddings for each document.N)aencode_queriesr>s racallzLiteLLMRouterEncoder.acallhs& *T))$9&9999s   c ,|j td |jjd|j||jd|}t |S#t $r.}t|jjd||d}~wwxYwNz"litellm_router_instance is not set)inputmodelz API call failed. Error: r rrrr;r0r Exceptionr/ capitalizer"r5r#r es rr=z#LiteLLMRouterEncoder.encode_querieso  ' ' /AB B ]BD88BBkk$'tBHF#6* * ] 4 4 677PQRPSTU[\ \ ]AA B%)BBc ,|j td |jjd|j||jd|}t |S#t $r.}t|jjd||d}~wwxYwrDrGrJs rencode_documentsz%LiteLLMRouterEncoder.encode_documentszrLrMcHK|j td |jjd|j||jd|d{}t |S7#t $r.}t|jjd||d}~wwxYwwrD rr aembeddingr;r0rrHr/rIrJs rrAz$LiteLLMRouterEncoder.aencode_queries  ' ' /AB B ]"I$">">"I"I#kk$'t#BH#F#6* * ] 4 4 677PQRPSTU[\ \ ]:B";A(A&A(%B"&A(( B1)BBB"cHK|j td |jjd|j||jd|d{}t |S7#t $r.}t|jjd||d}~wwxYwwrDrQrJs raencode_documentsz&LiteLLMRouterEncoder.aencode_documentsrSrT)Nr)r&r'r(__doc__r/str__annotations__floatintr!listr;rr?rBr=rOrArVr*r+s@rr-r-'s3*D#) )- /!)// /  /@49c 3T#Y3T$u+5F3:S :T%[8I: ]49 ]4U ;L ] ]T#Y ]T$u+=N ] ]$s) ]$tE{BS ] ]DI ]DeDU ]r%r-)typingrrrrpydanticrsemantic_router.encodersrsemantic_router.encoders.baser rlitellm._loggingr litellm.routerr rr\rZrrr-rr%rrcsg661>2% F1G551$tE{:K1 ? ?r]-/Cr]r%