uPj:lUdZddlmZddlZddlmZmZddlmZddl Z ddl m Z m Z ddl mZddlmZdd lmZdd lmZdd lmZmZdd lmZe eeeezezezfZ d e!d<e e"eZ#d e!d<e e$eZ%d e!d<dZ&d e!d<dZ'd e!d<dZ(d e!d<GddeZ)ddZ*ddZ+ddZ,y)zm TinyFish Search API. Endpoint: GET https://api.search.tinyfish.ai Docs: https://docs.tinyfish.ai/search-api ) annotationsN)FinalLiteral) urlencode) TypeAdapterValidationError)verbose_logger)process_response_headers)Logging)BaseLLMException)BaseSearchConfigSearchResponse)get_secret_strr_UrlEncodableParams_StrList _StrFrozenSet_tinyfish_params_TINYFISH_PARAMS_KEYz#https://docs.tinyfish.ai/search-api_TINYFISH_DOCS_URL _TINYFISH_RESULT_CAPceZdZdZd fd Zed dZd dZ d ddZ d ddZ ddZ ddZ dd Z xZ S)TinyfishSearchConfigzhttps://api.search.tinyfish.aic0t|d|_yN)super__init___caller_max_results)self __class__s p/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/litellm/llms/tinyfish/search/transformation.pyrzTinyfishSearchConfig.__init__&s  04 cy)NTinyFishr%r"r!ui_friendly_namez%TinyfishSearchConfig.ui_friendly_name.sr"cy)NGETr%)rs r!get_http_methodz$TinyfishSearchConfig.get_http_method2sr"c n|j||dd|j}|s tdi||ddS)N)TINYFISH_API_KEYTINYFISH_API_BASE)caller_api_keycaller_api_base key_env_vars base_env_vardefault_api_basezITINYFISH_API_KEY is not set. Set `TINYFISH_API_KEY` environment variable.zapplication/json)z X-API-KeyAccept)resolve_server_api_keyr, ValueError)rheadersapi_keyapi_basekwargs resolved_keys r!validate_environmentz)TinyfishSearchConfig.validate_environment5sR#99"$.,!33 : hi iS'S @RSSr"c |xstdxs |j}t|tr6t|vr.t j |t}|dt|dS|S)Nr,?T)doseq)rr, isinstancedictrrvalidate_pythonr)rr7optional_paramsdatar8 resolved_basevalidated_paramss r!get_complete_urlz%TinyfishSearchConfig.get_complete_urlGsi (h>:M+NhRVRhRh dD !&:d&B&9&I&I$OcJd&e #_Ai0@&M%NO Or"c lt|trdj|n|} tj |j d}|r t||}d|i}|j d}t|tr||d<|j d}t|tttfr) tdtt|t|_|j)} t*j | } |j-D]X\} } | | vs | |vst| t.tfrt1j2| d } nt| t4r| rd nd } | || <Zt6|iS#t tf$rg}Y9wxYw#t tt"f$rt%j&d|YwxYw) u, Transform a LiteLLM search request to TinyFish's querystring format. Maps LiteLLM's unified-spec params (see ``BaseSearchConfig.get_supported_perplexity_optional_params``) to TinyFish equivalents: - ``query`` (str or list[str]) → ``query`` (list joined by spaces) - ``country`` → ``location`` - ``search_domain_filter`` (list[str]) → folded into the query using search operators - ``max_results`` → not sent on the wire; stashed on ``self._caller_max_results`` for client-side response truncation (TinyFish doesn't honor it server-side) - ``max_tokens_per_page`` → silently dropped (no TinyFish equivalent) Any other ``optional_params`` keys are forwarded to TinyFish as-is. dict and list values are JSON-encoded so structured payloads survive ``urlencode``. Returns: ``{_TINYFISH_PARAMS_KEY: }``. ``get_complete_url`` reads this back to build the final URL.  search_domain_filterquerycountrylocation max_resultszATinyFish Search: max_results=%r is not a valid integer; ignoring.),:) separatorstruefalse)r>listjoinrr@getr TypeError_append_domain_filtersstrintfloatmaxminrrr4 OverflowErrorr warning(get_supported_perplexity_optional_paramsritemsr?jsondumpsboolr) rrIrAr8resolved_querydomains request_datarJraw_max raw_supportedsupported_perplexityparamvalues r!transform_search_requestz-TinyfishSearchConfig.transform_search_requestTs:-7ud,C% ../B/BCY/Z[G 3NGLN29>1J (,,Y7 gs #'.L $ ),,]; gUC0 1 +.q#c'lDX2Y+Z(  9 9 ; '4&C&CM&R+113 ,LE500U,5NedD\2 JJuDE t,&+FE&+ U# ,%l33S + G $ =9 &&W s#$E..(F.FF*F32F3c d|jcxkrdks=n|j|j|jt|j |j }t| tj|}t||jxst}|jd||_t|j}|j} || d<t!|| d<|S#t j $rB|jd|jdd|jt|jwxYw#t$r9}|jd||jt|jd}~wwxYw) uF Transform a TinyFish response to LiteLLM's unified ``SearchResponse``. Per-result field handling: - ``title``, ``url``, ``snippet`` are declared on ``SearchResult`` and populated by ``SearchResponse.model_validate`` when present. Missing or ``None`` values are defaulted to ``""`` beforehand by ``_default_missing_result_fields`` so a degraded result flows through instead of failing the whole call. - All undeclared per-result fields (``position``, ``site_name``, and any others TinyFish returns) ride through as extras via ``SearchResult``'s ``extra="allow"`` config — accessible as attributes on the result object or enumerable via ``result.model_extra``. Top-level ``parameter_warnings`` is read when present and each entry is re-fired via ``verbose_logger.warning``. Absent or malformed entries are silently skipped — never throws. Top-level extras (``query``, ``total_results``, ``page``, and any future TinyFish additions) ride through via ``SearchResponse.extra="allow"``. The validated response is returned in place after truncating ``results`` to the caller's ``max_results``, so every field pydantic populated survives regardless of which storage bucket (declared attribute or ``__pydantic_extra__``) holds it. TinyFish response headers (e.g. ``x-request-id``, ``retry-after``, ``x-ratelimit-limit`` — httpx normalizes header names to lowercase) are stashed on ``response._hidden_params["headers"]`` (raw) and ``response._hidden_params["additional_headers"]`` (sanitized via ``process_response_headers``) so callers can correlate a search with server-side logs. Error paths routed through ``self._wrap_error`` for uniform ``"TinyFish Search: . See for details."`` wrapping: - non-2xx HTTP status (caught here because ``AsyncHTTPHandler.get`` does not call ``raise_for_status``) - 200 with non-JSON body - 200 with valid JSON whose shape doesn't satisfy ``SearchResponse`` Returns: ``SearchResponse`` truncated to ``self._caller_max_results`` (or ``_TINYFISH_RESULT_CAP`` when the caller didn't set ``max_results``). i,) error_message status_coder5zExpected JSON response, got: Nz?Response shape does not match LiteLLM's SearchResponse schema: r5additional_headers)rp _wrap_errortextr?r5raJSONDecodeError_default_missing_result_fieldsrmodel_validater_emit_parameter_warningsrrresults_hidden_paramsr ) r raw_response logging_objr8raw_jsonparsederL raw_headershiddens r!transform_search_responsez.TinyfishSearchConfig.transform_search_responsesj|//5#5""*//(44\112#   &2&7&7&9H 'x0 *99(CF !(!55M9M  5!,"6"67 --'y'? 'L#$ 5## "" =l>O>OPTQT>U=VW(44\112#   ""!`ab`cd(44\112#  s%C.0E.AE F4FFcN|} tj|}t|trF|j d}t|tr%|j d}t|t r|r|}t|d|dtd|S#tj tf$rY4wxYw)u Build an attributed ``BaseLLMException`` from a TinyFish error body. Used only at the call sites we control inside ``transform_search_response`` (non-2xx, JSONDecodeError, ValidationError). Not an override of ``BaseSearchConfig.get_error_class``: that path is left to inherit from the base so it auto-picks-up any future LiteLLM improvements. Trade-off: network failures (routed through LiteLLM core's ``_handle_error`` → ``BaseSearchConfig.get_error_class``) won't carry the ``TinyFish Search:`` prefix — the bare error already names the host in the URL, so attribution is implicit there. errormessagezTinyFish Search: z. See z for details.)rprr5) raloadsr>r?rUrXrtrVr r)rrorpr5 inner_messagebody error_obj candidates r!rrz TinyfishSearchConfig._wrap_errors*&  "&**]";D$%+/88G+< i./8}}Y/GI!)S1i(1  #' f=Oz)_append_domain_filters..#s'E%s 'Es(z) ())rT)rIredomain_clausess r!rWrW"s,"KK'EW'EEN ugS( **r"ct|tsy|jd}t|tsy|D]?}t|tsdD]'}t|j|tr#d||<)Ay)zDefault missing/null title/url/snippet to "" on each result item in place. SearchResult requires these three fields; a degraded TinyFish result flows through with empty strings instead of failing the whole call. Nrx)titleurlsnippet)r>r?rUrSrX)r| results_initemfields r!ruru'sr h % Y/J j$ '!$% 0 !Edhhuos3 U  !!r"cxt|dd}t|tsy|D]}t|ts|j d}|j d}|j d}t|t r|sZt|t r|smt|t r|st jd|||y)aRe-fire TinyFish-side ``parameter_warnings`` as warnings. Defensive: skip silently on any shape we don't recognize so a malformed entry (or an early/partial rollout of the field) never throws. Schema per entry: ``{type, parameter, message, docs_url?}``. parameter_warningsNtype parameterrz/TinyFish Search parameter_warning (%s) `%s`: %s)getattrr>rSr?rUrXr r^)r}warnings_fieldentry warning_typerrs r!rwrw:s%,F4H$$ON nd + %& $yy0 !IIk2 ))I.,,L )S) '3'w  =      r")rIrXrez list[str]rrX)r|rrr)r}rrr)-__doc__ __future__rratypingrr urllib.parserhttpxpydanticrrlitellm._loggingr 'litellm.litellm_core_utils.core_helpersr *litellm.litellm_core_utils.litellm_loggingr LiteLLMLoggingObj)litellm.llms.base_llm.chat.transformationr +litellm.llms.base_llm.search.transformationr rlitellm.secret_managers.mainrr?rXrYrZrcr__annotations__rSr frozensetrrrrrrWrurwr%r"r!rs # !" 1+LSF8(c39u3Dt3K.K)LMUMd3i(%("9S>2 u20e0AEA e | +| ~+ !& r"