kQj \dZddlmZddlZddlZddlmZmZmZm Z m Z m Z ddl m Z ejdk\rddlmZnddlmZddlmZdd lmZddlZdd lmZdd lmZdd lmZdd lmZddlm Z ddl!m"Z"ddl#m$Z$ddl%m&Z&ddl'm(Z(m)Z)m*Z*ddl+m,Z-m.Z/ddl0m1Z1ddl2m3Z3ddl4m5Z5m6Z6ddl7m8Z8m9Z9ddl:m;Z;mZ>m?Z?m@Z@ddlAmBZCddlAmDZDmEZEddlFmGZGmHZImJZJmKZKmLZLmMZMmNZNddlOmPZPmQZQmRZRmSZSddlTmUZUmVZVmWZWddlXmYZYddlZm[Z[dd l\m]Z]dd!l^m_Z_d"d#l`maZad$Zb d6d%Zc d7d&Zd d8d'Ze d9 d:d(Zfd;d)Zgdd,Zj d?d-Zkd@d.ZlGd/d0e6ZmGd1d2Znddddd3 dAd4Z,ddddd3 dBd5Zoy)Cz LanceDB Namespace integration module. This module provides integration with lance_namespace for managing tables through a namespace abstraction. ) annotationsN)AnyDictIterableListOptionalUnion)UUID) )overrideQuery) timedelta)JsonArrowDataType)JsonArrowField)JsonArrowSchema)QueryTableRequest)QueryTableRequestColumns)QueryTableRequestFullTextQuery)QueryTableRequestVector)StringFtsQuery)NamespaceNotEmptyErrorNamespaceNotFoundErrorTableNotFoundError)connect_namespaceconnect_namespace_client)LOOP)AsyncRecordBatchReader)AsyncConnection DBConnection)AsyncJobJob) AsyncListingAsyncNamespaceListingAsyncTableListingListingNamespaceListing TableListing) AsyncQuery)QueryDescriptionQueryParameters)LanceNamespaceconnectCreateNamespaceResponseDescribeNamespaceResponseDropNamespaceResponseNamespaceExistsRequestTableExistsRequest)AsyncMaterializedViewMaterializedViewMaterializedViewSource SelectArg) AsyncTable LanceTableTable)validate_table_name)DATA) LanceModel)EmbeddingFunctionConfig)Sessionic|||St|xsi}d|fd|ffD]Y\}}| tjd|dtdt |t rt |jn||d|<[|S)Ndata_storage_versionenable_v2_manifest_pathszsetting zE directly on create_table is deprecated. Use storage_options instead.r  stacklevel new_table_)dictwarningswarnDeprecationWarning isinstanceboolstrlower)storage_optionsrBrCoptionsnamevalues V/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/lancedb/namespace.py_create_table_storage_optionsrT[s #(@(H?(b)G !56 #%=>  e   MM4&!//"  '1&=E   "5 j' (  Nc ddlm}t||stdt ||j t dd}|jt|jtjr|jj}nt|jtr[|jrOt|jdtjr(|jDcgc]}|j}}n |j}t|tr"|r t|dtr t|}n t|}d}|jGt|jtrt|j}nt|j }d}|j x|j }t|t"rt%t'|  }nEt)|d r9t%t'|j*t)|d r |jnd }d} |j, |j, } |j. |j.} n!|j|j t0} nd} || ||n td} |j2|j2| d<|j4|j4| d<| | | d<||| d<||| d <|j6|j6| d<|j8|j8| d<|j:|j:| d<|j<|j<| d<|j>|j>| d<|j@|j@| d<|jB|jB| d<|jD|jD| d<|jF|jF| d<|jH|jH| d<|jJ|jJ| d<|jL|jL| d <| jOddk(r.| jQd} tSd"i| jUd| i!StSd"i| Scc}w)#a^ Convert a LanceDB Query object to a QueryTableRequest for server-side query. Parameters ---------- table_id : List[str] The table identifier (namespace path + table name) query : Query The LanceDB Query object to convert Returns ------- QueryTableRequest The namespace QueryTableRequest rrzExpected Query, got NzNnamespace QueryTable does not support search_effort; execute the query locally) multi_vector) single_vector)column_aliases) column_names)query) string_queryr[columns)r[r] )idkvector vector_columnfilter prefilterfull_text_queryoffset with_row_idefnprobesminimum_nprobesmaximum_nprobes refine_factor lower_bound upper_boundbypass_vector_index fast_search distance_type)update)+ lancedb.queryrrK TypeErrortype search_effort ValueErrorrapaArray to_pylistlistrr]rGrrerMrrhasattrr[ postfilterlimit _MAX_QUERY_Krbrcrfrgrhrirjrkrlrmrnrorprqgetpopr model_copy) table_idr[rvector_request vector_listvcolumns_requestfull_text_query_request fts_queryrdr`kwargsrks rS_query_to_namespace_requestrts2&$ eU #.tE{m<== & (  N || ellBHH -,,002K u||T * 5<<?BHH527,,?Q1;;=?K?,,K {D );q>404+NN4;ONO }} emmT *6emmTO6EMMRO" ()) i %&D+)<' #Y (&D+#//y)4&-- ' #I #(((  {{ KK  %"7"7"?      %! $ & F &"'"5"5 || <<x'{*$; !"+y || <<x $ % 1 1} xxxxt  }} !MMy ($)$9$9 ! ($)$9$9 ! &"'"5"5 $ % 1 1} $ % 1 1}   ,(-(A(A$% $ % 1 1} &"'"5"5 zz#$)!**%67 *6*55%76    &v &&K@s)Q+cRt||}|j|}t|S)a Execute a query on the namespace server and return results as RecordBatchReader. Parameters ---------- namespace_client : LanceNamespace The namespace client to use table_id : List[str] The table identifier (namespace path + table name) query : Query The LanceDB Query object Returns ------- pa.RecordBatchReader The query results as a RecordBatchReader )r query_table!_arrow_ipc_to_record_batch_reader)namespace_clientrr[request ipc_bytess rS_execute_server_side_queryrs+,*(E:G ,,W5I ,Y 77rUc&ddlm}ddlm}t |t r t |tr|j}|j}|r|j|}n| |j}nd}||| td|r|j|}tj} tj j#| |5} ddd| j%j'S||||||} tj} tj j#| | j(5} | D]} | j+|  ddd| j%j'S#1swYxYw#1swY3xYw)a? Convert data to Arrow IPC format (file format) for server-side create_table. If data is None but schema is provided, creates an empty IPC stream with just the schema in the header (zero batches). This is used to create empty tables with just a schema. Returns the serialized Arrow IPC bytes. r)EmbeddingFunctionRegistry)_sanitize_dataNz>Either data or schema is required for server-side create_table) target_schemametadataon_bad_vectors fill_value)lancedb.embeddingsr lancedb.tablerrKrv issubclassr=to_arrow_schema get_instanceget_table_metadatarrx with_metadataryBufferOutputStreamipc new_streamgetvalue to_pybytesschema write_batch) datarembedding_functionsrrrrregistryrsinkwriterreaderbatchs rS_data_to_arrow_ipcrsq =,&$Jvz$B''))557H../BC  ?? | >P  ))(3F$$& VV  tV ,   }}))++  % F  "D   4 /&6 &E   u % && ==? % % ''#  &&sE;;F;FFc*tj|}tjj|}t |j Dcgc]}|j |}}tjj|j|Scc}w)z9 Convert Arrow IPC bytes to a RecordBatchReader. ) ry py_bufferr open_filerangenum_record_batches get_batchRecordBatchReader from_batchesr)rbufribatchess rSrrZsr ,,y !C VV  c "F,1&2K2K,LMqv"MGM   , ,V]]G DDNs BcX|j}|dk(ry|dk(rytd|d)z5Normalize create table mode string for namespace API.createCreate overwrite OverwritezInvalid mode: z!. Must be 'create' or 'overwrite')rNrx)mode mode_lowers rS_normalize_create_table_moderds8JX { ">$/PQRRrUctjj|rd}ntjj|rd}ntjj |rd}ntjj |rd}ntjj |rd}ntjj|rd}natjj|rd}n>tjj|rd}ntjj|rd }ntjj|rd }ntjj|rd }ntjj|rd }ntjj|rd }nqtjj|rd}nOtjj!|rd}n-tjj#|rd}n t%|}t'|S)z.Convert PyArrow DataType to JsonArrowDataType.nullrLint8uint8int16uint16int32uint32int64uint64float32float64utf8binaryr|fixed_size_list)rv)rytypesis_null is_booleanis_int8is_uint8is_int16 is_uint16is_int32 is_uint32is_int64 is_uint64 is_float32 is_float64 is_string is_binaryis_listis_fixed_size_listrMr) arrow_type type_names rS_convert_pyarrow_type_to_jsonros xx #   Z (   * %   : &   : &   J '   : &   J '   : &   J '   Z (   Z (   J '   J '   * %  $ $Z 0%  O ) ,,rUcg}|D]S}t|jt|j|j|j }|j |Ud}|j rK|j jDcic]&\}}|jd|jd(}}}t||Scc}}w)z*Convert PyArrow Schema to JsonArrowSchema.)rQrvnullablerNzutf-8)fieldsr) rrQrrvrrappenditemsdecoder)rrfield json_fieldmetar`rs rS_convert_pyarrow_schema_to_jsonrs F"#.uzz:^^^^   j!" D =C__=R=R=T 59QAHHW qxx0 0   &4 88  s+Cc&|dk(xr t|S)aWhether ``connect_namespace_client`` builds the namespace client natively in Rust (installing the read-freshness context provider) rather than wrapping the pre-built Python client. Must mirror Rust ``build_namespace_natively`` in ``python/src/connection.rs``. rest)rL)namespace_client_implnamespace_client_propertiess rS_builds_namespace_nativelyrs !F * Pt4O/PPrUc |dvS)N>dirrrs)rs rS_supports_native_namespacers O 33rUc eZdZdZ d&dddddddd d'dZed(dZed)dZed*dZe d+dd d,d Z e d-ddddd  d.d Z edddddd  d/dZ edddd ddd d0dZ edddd ddd d1dZ ed2dZeddd d3dZe d& d4dZe d& d5dZed&d6dZe d& d7dZe d+ d8dZedZed&d9dZe d: d;dZe d+ ddZed?d Zed@d!Ze d: dAd"Zdddddd# dBd$ZedCd%Zy)DLanceNamespaceDBConnectionz A LanceDB connection that uses a namespace for table management. This connection delegates table URI resolution to a lance_namespace instance, while using the standard LanceTable for actual table operations. Nread_consistency_intervalrOsession$namespace_client_pushdown_operationsrr_innerc ||_||_|xsi|_||_t |xsg|_||_||_|duxs t|||_ |||_ n`| tdtt|||jnd|jxsd|t|j |||_ |jj |_y)a Initialize a namespace-based LanceDB connection. Parameters ---------- namespace_client : LanceNamespace The namespace client to use for table management read_consistency_interval : Optional[timedelta] The interval at which to check for updates to the table from other processes. If None, then consistency is not checked. storage_options : Optional[Dict[str, str]] Additional options for the storage backend session : Optional[Session] A session to use for this connection namespace_client_pushdown_operations : Optional[List[str]] List of namespace operations to push down to the namespace server. Supported values: - "QueryTable": Execute queries on the namespace server via namespace.query_table() instead of locally. - "CreateTable": Execute table creation on the namespace server via namespace.create_table() instead of using declare_table + local write. Default is None (no pushdown, all operations run locally). namespace_client_impl : Optional[str] The namespace implementation name used to create this connection. Stored for serialization purposes. namespace_client_properties : Optional[Dict[str, str]] The namespace properties used to create this connection. Stored for serialization purposes. N4namespace_client is required without a native _innerrrOrrrr)_namespace_clientrrOrset%_namespace_client_pushdown_operations_namespace_client_impl_namespace_client_propertiesr_route_pushdown_to_rustrrxr _connect_namespace_client total_secondsr|uri_uri selfrrrOrrrrrs rS__init__z#LanceNamespaceDBConnection.__init__sV"2)B&.4" 58 0 6B6 2'<#,G) (.T'9( =W !#>> $   DK' !WXX))$5@2??A!$($8$8$@D#TGGH*?0KDK"KKOO rUc6|jjSN)ris_openrs rSrz"LanceNamespaceDBConnection.is_opens{{""$$rUc8|jjyr)rclosers rSrz LanceNamespaceDBConnection.closes rUc ddl}|jd|j|jt |j |j xsd|jr |jjdSddS)Nr namespace)connection_typerrrrO!read_consistency_interval_seconds) jsondumpsrrsortedrrOrr )rrs rS serializez$LanceNamespaceDBConnection.serialize#szz#.)-)D)D/3/P/P8>>>9$(#7#7#?45522@@B      rUnamespace_pathcddl}|jdtd|g}tj|j j |||S)z List table names in the database. If limit is None, return all table names; zero returns an empty list. .. deprecated:: Use :meth:`list_tables` instead, which provides proper pagination support. rN6table_names() is deprecated, use list_tables() insteadrDr start_afterr)rHrIrJrrunr table_namesr page_tokenrrrHs rSr&z&LanceNamespaceDBConnection.table_names8sZ  D   !Nxx KK # #-:U $   rUFrrOrBrCc D| g} |jdvr tdt|t| | | } t j |j j||||||||| |  } t||| |j|j|j| S)Nrr+mode must be either 'create' or 'overwrite')rrexist_okrrrrrOrrpushdown_operationsroute_pushdown_to_rust_async) rNrxr;rTrr%r create_tabler9rrr)rrQrrrr-rrrrrOrBrC async_tables rSr2z'LanceNamespaceDBConnection.create_tableWs"  !N ::<6 6JK KD!7 13K hh KK $ $!-%$7- / %     )!33 $ J J#'#?#?  rUrrOindex_cache_sizebranchversionc |g} tj|jj||||}t||||j|j|j|} || jj||} | S|| j|| S#tt f$rC}dt |vs dt |vr#||gz} tddj| d}~wwxYw)NrrOr5Table not found was not foundTable not found: $r.)rr%r open_table RuntimeErrorrxrMrjoinr9rrrbranchescheckout) rrQrrOr5r6r7r3ertbls rSr>z%LanceNamespaceDBConnection.open_tables  !N (( &&#1$3%5 'K  )!33 $ J J#'#?#?   ,,''8C  LL ! 'j)  CF*oQ.G)TF2(+C**C/selectwherer with_no_dataauto_refresh_enabledauto_refresh_interval_secondsct|jtj|jj ||||||||j S)zDefine a materialized view over a table in the root namespace. See [DBConnection.create_materialized_view][lancedb.DBConnection.create_materialized_view]. rE)r5r>rr%rcreate_materialized_viewrQ rrQsourcerFrGrrHrIrJs rSrLz3LanceNamespaceDBConnection.create_materialized_views_" OOKK88%##%1-A6S9  $   rUc tj|jj||||||||} t | S)NrE)rr%rcreate_materialized_view_asyncr#) rrQrNrFrGrrHrIrJjobs rSrPz9LanceNamespaceDBConnection.create_materialized_view_asyncsLhh KK 6 6)%9.K 7   3xrUcRt|j|}|j|S)*Open the materialized view named ``name``.)r5r> definitionrrQviews rSopen_materialized_viewz1LanceNamespaceDBConnection.open_materialized_views#  56  rUr( page_limitcNt|jj||Sa5The names of the materialized views in the root namespace. Returns a lazy iterator. ``page_limit`` limits each request, not the total; ``page_token`` resumes from a saved token. Requests and errors occur during iteration. See [pagination state][lancedb.listing.AsyncListing]. rX)r'rlist_materialized_viewsrr(rYs rSr\z2LanceNamespaceDBConnection.list_materialized_viewss- KK / /%* 0   rUcl|g}tj|jj||yNr)rr%rdrop_materialized_viewrrQrs rSr`z1LanceNamespaceDBConnection.drop_materialized_views2  !N  KK . .tN . S rUc||g}ttj|jj ||Sr_)r#rr%rdrop_materialized_view_asyncras rSrcz7LanceNamespaceDBConnection.drop_materialized_view_asyncsD  !N HH 889   rUcl|g}tj|jj||yr_)rr%r drop_tableras rSrez%LanceNamespaceDBConnection.drop_table s-  !N ''^'LMrUc|g}tj|jj||}t t |t r|St |S)2Start dropping a table and return its cleanup job.r)rr%rdrop_table_asyncr#rKr")rrQrrQs rSrhz+LanceNamespaceDBConnection.drop_table_async&sV  !Nhh KK ( (n ( M *S(33GG#GGrUc|g}|g} tj|jj||||y#t$r}dt |vr t d|d}~wwxYw)Ncur_namespace_pathnew_namespace_pathrename_table not implemented)rr%r rename_tabler?rMNotImplementedErrorrcur_namenew_namerkrlrCs rSrnz'LanceNamespaceDBConnection.rename_table2s  %!#   %!#   HH (('9'9 )  -Q7)*HIqP  s2= A%A  A%ctd)N8drop_database is deprecated, use drop_all_tables insteadrors rS drop_databasez(LanceNamespaceDBConnection.drop_databaseLs! F  rUcj|g}tj|jj|yr_)rr%rdrop_all_tablesrrs rSrxz*LanceNamespaceDBConnection.drop_all_tablesRs+  !N ,,N,KLrUcX|g}t|jj|||Sa List child namespaces under the given namespace. Parameters ---------- namespace_path : Optional[List[str]] The parent namespace path to list children from. If None, lists root-level namespaces. page_token : Optional[str] Token for pagination. Use the token from a previous response to get the next page of results. limit : int, optional Maximum number of namespaces to return. Returns ------- NamespaceListing Response containing namespace names and optional page_token for pagination. rr(r)r(rlist_namespacesrrr(rs rSr}z*LanceNamespaceDBConnection.list_namespacesXs:4  !N KK ' '-*E (   rUcdtj|jj|||S)8 Create a new namespace. Parameters ---------- namespace_path : List[str] The namespace path to create. mode : str, optional Creation mode - "create" (fail if exists), "exist_ok" (skip if exists), or "overwrite" (replace if exists). Case insensitive. properties : Dict[str, str], optional Properties to set on the namespace. Returns ------- CreateNamespaceResponse Response containing the properties of the created namespace. rr properties)rr%rcreate_namespacerrrrs rSrz+LanceNamespaceDBConnection.create_namespacezs52xx KK ( (-% )   rUc tj|jj|||S#t$r(}dt |vrt t ||d}~wwxYw)+ Drop a namespace. Parameters ---------- namespace_path : List[str] The namespace path to drop. mode : str, optional Whether to skip if not exists ("SKIP") or fail ("FAIL"). Case insensitive. behavior : str, optional Whether to restrict drop if not empty ("RESTRICT") or cascade ("CASCADE"). Case insensitive. Returns ------- DropNamespaceResponse Response containing properties and transaction_id if applicable. rrbehaviorNamespace not emptyN)rr%rdrop_namespacer?rMrrrrrrCs rSrz)LanceNamespaceDBConnection.drop_namespacesj2 88 **#1%+  $A.,SV4!;  s03 A$#AA$c^tj|jj|S)  Describe a namespace. Parameters ---------- namespace_path : List[str] The namespace identifier to describe. Returns ------- DescribeNamespaceResponse Response containing the namespace properties. )rr%rdescribe_namespacerys rSrz-LanceNamespaceDBConnection.describe_namespaces""xx 66~FGGrUcrt|} |jj|y#t$rYywxYwa Check if a namespace exists. Parameters ---------- namespace_id : List[str] The namespace identifier to check. Returns ------- bool True if the namespace exists, False otherwise. r_TFr2rnamespace_existsrr namespace_idrs rSrz+LanceNamespaceDBConnection.namespace_existss<)L9   " " 3 3G <%   * 66crt|} |jj|y#t$rYywxYwaB Check if a table exists. Parameters ---------- table_id : List[str] The table identifier to check (full path including namespace segments and table name). Returns ------- bool True if the table exists, False otherwise. rTFr3r table_existsrrrrs rSrz'LanceNamespaceDBConnection.table_existss< %1   " " / / 8!  rcX|g}t|jj|||Sa| List all tables in this database with pagination support. Parameters ---------- namespace_path : List[str], optional The namespace to list tables in. None or empty list represents root namespace. page_token : str, optional Token for pagination. Use the token from a previous response to get the next page of results. limit : int, optional The maximum number of results to return. Returns ------- TableListing Response containing table names and optional page_token for pagination. r|)r)r list_tablesr~s rSrz&LanceNamespaceDBConnection.list_tabless:4  !N KK # #-*E $   rU)rrOr5rmanaged_versioningc |g}tj|jj||||d||}t |||||||j |S)N)rrOr5locationrr)rrrrr/r1)rr%rr>r9r) rrQ table_urirrOr5rrr3s rS_lance_table_from_uriz0LanceNamespaceDBConnection._lance_table_from_uri#sv  !Nhh KK " "- /!1!1#5 #     )-1 $ J J  rUc|jH|j |j tdt |j|j|_|jSa!Get the namespace client for this connection. For namespace connections, this returns the backing namespace client that was provided during construction. Returns ------- LanceNamespace The namespace client for this connection. zVCannot construct a Python namespace client without namespace implementation propertiesrrrrxnamespace_connectrs rSrz+LanceNamespaceDBConnection.namespace_clientLsh  ! ! )++344< :&7++T-N-N&D "%%%rUrrzOptional[LanceNamespace]rOptional[timedelta]rOOptional[Dict[str, str]]rOptional[Session]rOptional[List[str]]r Optional[str]rrrzOptional[AsyncConnection])returnrL)rNone)rrMNNr(rr Optional[int]rrrz Iterable[str]NNrFerrorN)rQrMrOptional[DATA]r&Optional[Union[pa.Schema, LanceModel]]rrMr-rLrrMrfloatr'Optional[List[EmbeddingFunctionConfig]]rrrOrrBrrCOptional[bool]rr:)rQrMrrrOrr5rr6rr7rrr:)rQrMrNr6rF 'SelectArg'rGrrrrHrLrIrrJOptional[float]r'MaterializedView')rQrMrNr6rFrrGrrrrHrLrIrrJrr Job[None])rQrMrr)r(rrYrrz Listing[str]rQrMrrrr)rQrMrrrrrQrMrr)rQrMrrrr#rqrMrrrMrkrrlrrrNNN)rrr(rrrrr(r List[str]rrrrrr/rrrrrrrr1rrrr0rrrrLrrrrL)rrr(rrrrr))rQrMrrMrrrOrr5rrz Optional[Any]rrrr9rr-) __name__ __module__ __qualname____doc__rr rrrr&r2r>rLrPrWr\r`rcrerhrnrvrxr}rrrrrrrrrsrUrSrrsn6:Q$:>48%)DH/3@D,0Q$2Q$$7 Q$ 2 Q$ # Q$/BQ$ -Q$&>Q$*Q$f%%  (%)# /3  !  ,     < $9=%GK/ /348.237/ / / 7 /  /  / / / E/ ,/ 2/ ,/ #1/  / / b /348*. $!%((, ( 2 ( ( ((( ((T ###"/39=  '       - (7    B ###"/39='    -(7 4 -1t  *  ?L      ?C  )<   ?C    )<      NN ?C H H)< H  H H 3726 0  0 2  MM /3$(#  + "      B#/3  !  -  !   @#"& #!## #  ##JH'H "HH$*,/3$(#  + "      L/348*.*.-1' ' ' , ' 2 ' (' (' +'  ' R&&rUrc eZdZdZ d%dddddddd d&dZ d'dd d(dZ d)ddddd d*d Zdddddd  d+d Zddddddd  d,d Zddddddd  d-dZ d.dZ ddd d/dZ d% d0dZ d% d1dZ d%d2dZ d% d3dZ d' d4dZdZd%d5dZ d6 d7dZ d' d8dZ d' d9dZ d:dZd;dZdd!Zddd  d?d"Zd@d#ZdAd$Zy)BAsyncLanceNamespaceDBConnectionz An async LanceDB connection that uses a namespace for table management. This connection delegates table URI resolution to a lance_namespace instance, while providing async methods for all operations. Nrc ||_||_|xsi|_||_t |xsg|_||_||_|duxs t|||_ |||_ y| tdtt|||jnd|jxsd|t|j |||_ y)a Initialize an async namespace-based LanceDB connection. Parameters ---------- namespace_client : LanceNamespace The namespace client to use for table management read_consistency_interval : Optional[timedelta] The interval at which to check for updates to the table from other processes. If None, then consistency is not checked. storage_options : Optional[Dict[str, str]] Additional options for the storage backend session : Optional[Session] A session to use for this connection namespace_client_pushdown_operations : Optional[List[str]] List of namespace operations to push down to the namespace server. Supported values: - "QueryTable": Execute queries on the namespace server via namespace.query_table() instead of locally. - "CreateTable": Execute table creation on the namespace server via namespace.create_table() instead of using declare_table + local write. Default is None (no pushdown, all operations run locally). namespace_client_impl : Optional[str] The namespace implementation name used to create this connection. Required (with ``namespace_client_properties``) for the Rust client to be built natively and install the read-freshness provider. namespace_client_properties : Optional[Dict[str, str]] The namespace properties used to create this connection. Nrr)rrrOrrrrrrrrrxr r r r|r s rSrz(AsyncLanceNamespaceDBConnection.__init__osV"2)B&.4" 58 0 6B6 2'<#,G) (.T'9( =W !#>> $   DK' !WXX))$5@2??A!$($8$8$@D#TGGH*?0KDKrUrcKddl}|jdtd|g}|jj |||d{S7w)z List table names in the namespace. If limit is None, return all table names; zero returns an empty list. .. deprecated:: Use :meth:`list_tables` instead, which provides proper pagination support. rNr!r"rDr#)rHrIrJrr&r's rSr&z+AsyncLanceNamespaceDBConnection.table_namess\  D   !N[[,,)z-    sAA A A Fr)c  @K| g} |jdvr tdt|t| | | } |jj |||||||| ||  d{} | j | |j|j|jS77w)z$Create a new table in the namespace.Nr+r,)rrr-rrrrrOrrr/r0) rNrxr;rTrr2_set_namespace_contextrrr)rrQrrrr-rrrrrOrBrCtables rSr2z,AsyncLanceNamespaceDBConnection.create_tables"  !N ::<6 6JK KD!7 13K kk..  )!) 3+/   ++)!33 $ J J#'#?#? ,    sA"B$B%8Br4c K|g} |jj||||d{}|*|dk7r%|jj||d{}n||j|d{|j||j|j|jS7~#ttf$rC}dt |vs dt |vr#||gz} t ddj | d}~wwxYw77w) z*Open an existing table from the namespace.Nr9r:r;r<r=mainr) rr>r?rxrMrr@rArBrrrr) rrQrrOr5r6r7rrCrs rSr>z*AsyncLanceNamespaceDBConnection.open_table s!  !N ++00- /!1 1E  &F"2..11&'BBE  ..) ) )++)!33 $ J J#'#?#? ,  # j)  CF*oQ.G)TF2(+C88C==DDrEc K|jj||||||||d{} t|j| jd{S707 w)z>Define a materialized view over a table in the root namespace.rEN)rrLr4r>rQ) rrQrNrFrGrrHrIrJrVs rSrLz8AsyncLanceNamespaceDBConnection.create_materialized_view/sg[[99  %!5*G:   %4??499+E%EFF  &Fs!'AA'AA AAc dK|jj||||||||d{S7w)z5Submit materialized-view creation and return its job.rEN)rrPrMs rSrPz>AsyncLanceNamespaceDBConnection.create_materialized_view_asyncJsG[[??  %!5*G@    s '0.0cKt|j|d{}|jd{|S7"7w)rSN)r4r>rTrUs rSrWz6AsyncLanceNamespaceDBConnection.open_materialized_viewbs;$4??4+@%@Aoo &AsA?AAAArXcNt|jj||Sr[)r$rr\r]s rSr\z7AsyncLanceNamespaceDBConnection.list_materialized_viewshs- KK / /%* 0   rUcbK|g}|jj||d{y7w)z,Drop a materialized view from the namespace.Nr)rr`ras rSr`z6AsyncLanceNamespaceDBConnection.drop_materialized_viewws0  !Nkk00n0UUU %/-/c`K|g}|jj||d{S7w)z>Start dropping a materialized view and return its cleanup job.Nr)rrcras rSrcz  !N[[== >    %.,.cbK|g}|jj||d{y7w)z Drop a table from the namespace.Nr)rreras rSrez*AsyncLanceNamespaceDBConnection.drop_tables.  !Nkk$$T.$IIIrc`K|g}|jj||d{S7w)rgNr)rrhras rSrhz0AsyncLanceNamespaceDBConnection.drop_table_asyncs3  !N[[11$~1VVVVrcK|g}|g} |jj||||d{y7#t$r}dt|vr t d|d}~wwxYww)z Rename a table in the namespace.Nrjrm)rrnr?rMrorps rSrnz,AsyncLanceNamespaceDBConnection.rename_tables  %!#   %!#  ++**#5#5 +    -Q7)*HIqP  s0 A!"646A!6 AAAA!c Ktdw)zDeprecated method.rtrurs rSrvz-AsyncLanceNamespaceDBConnection.drop_databases! F  s c`K|g}|jj|d{y7w)z!Drop all tables in the namespace.Nr)rrxrys rSrxz/AsyncLanceNamespaceDBConnection.drop_all_tabless,  !Nkk)))HHHs $.,.cF|g}|jj|||Sr{)rr}r~s rSr}z/AsyncLanceNamespaceDBConnection.list_namespacess22  !N{{**)j+  rUcZK|jj|||d{S7w)rrN)rrrs rSrz0AsyncLanceNamespaceDBConnection.create_namespaces70[[11)!2    "+)+cK |jj|||d{S7#t$r(}dt|vrt t||d}~wwxYww)rrNr)rrr?rMrrs rSrz.AsyncLanceNamespaceDBConnection.drop_namespacesk0 33-!4   $A.,SV4!;  s0A !,*,A , A#AAA cTK|jj|d{S7w)rN)rrrys rSrz2AsyncLanceNamespaceDBConnection.describe_namespaces# [[33NCCCC (&(czKt|} |jj|y#t$rYywxYwwrrrs rSrz0AsyncLanceNamespaceDBConnection.namespace_exists-s?)L9   " " 3 3G <%   ;,; 8;8;czKt|} |jj|y#t$rYywxYwwrrrs rSrz,AsyncLanceNamespaceDBConnection.table_existsBs?%1   " " / / 8!  rcF|g}|jj|||Sr)rrr~s rSrz+AsyncLanceNamespaceDBConnection.list_tablesXs22  !N{{&&)j'  rUdefault_namespace_path parameterscZK|jj|||d{S7w)z8Execute SQL when supported by the underlying connection.rN)r execute_queryrr[rrs rSrz-AsyncLanceNamespaceDBConnection.execute_queryws7[[.. #9!/    rcZK|jj|||d{S7w)zStart executing SQL when supported by the underlying connection. Namespace-backed local connections do not support SQL. rN)rexecute_query_asyncrs rSrz3AsyncLanceNamespaceDBConnection.execute_query_asyncs7[[44 #9!5    rcTK|jj|d{S7w)z.Describe a submitted SQL query when supported.N)rdescribe_query)rquery_ids rSrz.AsyncLanceNamespaceDBConnection.describe_querys![[//9999rcK|jH|j |j tdt |j|j|_|jSwrrrs rSrz0AsyncLanceNamespaceDBConnection.namespace_clientsl  ! ! )++344< :&7++T-N-N&D "%%%sA!A#rrrrr)rQrMrrrrrrMr-rLrrMrrrrrrrOrrBrrCrrr8)rQrMrrrOrr5rr6rr7rrr8)rQrMrNr6rFrrGrrrrHrLrIrrJrr'AsyncMaterializedView')rQrMrNr6rFrrGrrrrHrLrIrrJrrAsyncJob[None])rQrMrr)r(rrYrrzAsyncListing[str]r)rQrMrrrrr)rQrMrrrr"rrr)rrr(rrrrr%rrrrr)rrr(rrrrr&)r[rMrrrOptional[QueryParameters]rr)r[rMrrrrr AsyncSqlQuery)rzUnion[UUID, str]rr+r)rrrrrr&r2r>rLrPrWr\r`rcrerhrnrvrxr}rrrrrrrrrrrsrUrSrrgs6:P:>48%)DH/3@D,0P2P$7 P 2 P # P/BP -P&>P*Ph%)# /3  !  ,    > $9=%GK* /348.237* * * 7 *  *  * * * E* ,* 2* ,* #1*  * `/348*. $!%$ $ , $ 2 $ ( $ $ $  $ V###"/39=GG'G  G  GGG-G(7G !G@###"/39=  '       - (7   0.2t  *  ?L    @DVV)<V V@D  )<  J@DWW)<W W3726 0  0 0 I/3$(#  + "     D#/3  !  -  !  B#"& !!!! !  !FD'D "D$*0/3$(#  + "     F7;04    !4  .   $7;04   !4  .    ":&rUrrrOrrc t|r?tt||||jnd|||}t d|||||||St ||}t |||||||S)a1 Connect to a LanceDB database through a namespace. Parameters ---------- namespace_client_impl : str The namespace client implementation to use. For examples: - "dir" for DirectoryNamespace - "rest" for REST-based namespace - Full module path for custom implementations namespace_client_properties : Dict[str, str] Configuration properties for the namespace client implementation. Different namespace implementations have different config properties. For example, use DirectoryNamespace with {"root": "/path/to/directory"} read_consistency_interval : Optional[timedelta] The interval at which to check for updates to the table from other processes. If None, then consistency is not checked. storage_options : Optional[Dict[str, str]] Additional options for the storage backend session : Optional[Session] A session to use for this connection namespace_client_pushdown_operations : Optional[List[str]] List of namespace operations to push down to the namespace server. Supported values: - "QueryTable": Execute queries on the namespace server via namespace.query_table() instead of locally. - "CreateTable": Execute table creation on the namespace server via namespace.create_table() instead of using declare_table + local write. Default is None (no pushdown, all operations run locally). Returns ------- LanceNamespaceDBConnection A namespace-based connection to LanceDB NrrrrOrrrrrrrrOrrrr)rr _connect_namespacer rrrrrrOrrinnerrs rSrrs^""78 %+1<.;;= /5Y   *!&?+1U"7(C  ): &)";'-Q3$? rUc t|r?tt||||jnd|||}t d|||||||St ||}t |||||||S)aa Connect to a LanceDB database through a namespace (returns async connection). This function is synchronous but returns an AsyncLanceNamespaceDBConnection that provides async methods for all database operations. Parameters ---------- namespace_client_impl : str The namespace client implementation to use. For examples: - "dir" for DirectoryNamespace - "rest" for REST-based namespace - Full module path for custom implementations namespace_client_properties : Dict[str, str] Configuration properties for the namespace client implementation. Different namespace implementations have different config properties. For example, use DirectoryNamespace with {"root": "/path/to/directory"} read_consistency_interval : Optional[timedelta] The interval at which to check for updates to the table from other processes. If None, then consistency is not checked. storage_options : Optional[Dict[str, str]] Additional options for the storage backend session : Optional[Session] A session to use for this connection namespace_client_pushdown_operations : Optional[List[str]] List of namespace operations to push down to the namespace server. Supported values: - "QueryTable": Execute queries on the namespace server via namespace.query_table() instead of locally. - "CreateTable": Execute table creation on the namespace server via namespace.create_table() instead of using declare_table + local write. Default is None (no pushdown, all operations run locally). Returns ------- AsyncLanceNamespaceDBConnection An async namespace-based connection to LanceDB Examples -------- >>> import lancedb >>> # This function is sync, but returns an async connection >>> db = lancedb.connect_namespace_async("dir", {"root": "/path/to/db"}) >>> # Use async methods on the connection >>> async def use_db(): ... tables = await db.table_names() ... table = await db.create_table("my_table", schema=schema) Nrrr)rr rr rrrs rSconnect_namespace_asyncr sx""78 %+1<.;;= /5Y   /!&?+1U"7(C  ): +)";'-Q3$? rU)rOrrBrrCrrr)rrr['Query'rr)rr-rrr[r rpa.RecordBatchReader)Nrr) rzOptional['DATA']rrrrrrMrrrbytes)rr rr )rrMrrM)rz pa.DataTyperr)rz pa.Schemarr)rrrrrrL)rrMrrL)rrMrDict[str, str]rrrOrrrrrrr)rrMrr rrrOrrrrrrr)pr __future__rsysrHtypingrrrrrr uuidr version_infor overridesrtrdatetimerpyarrowry:lance_namespace_urllib3_client.models.json_arrow_data_typer6lance_namespace_urllib3_client.models.json_arrow_fieldr7lance_namespace_urllib3_client.models.json_arrow_schemar9lance_namespace_urllib3_client.models.query_table_requestrAlance_namespace_urllib3_client.models.query_table_request_columnsrIlance_namespace_urllib3_client.models.query_table_request_full_text_queryr@lance_namespace_urllib3_client.models.query_table_request_vectorr6lance_namespace_urllib3_client.models.string_fts_queryrlance_namespace.errorsrrrlancedb._lancedbrrrr lancedb.background_loopr lancedb.arrowr lancedb.dbr r! lancedb.jobr"r#lancedb.listingr$r%r&r'r(r) lancedb.sqlr*rr+r,lance_namespacer-r.rr/r0r1r2r3lancedb.materialized_viewr4r5r6r7rr8r9r: lancedb.utilr;lancedb.commonr<lancedb.pydanticr=rr>_lancedbr@rrTrrrrrrrrrrrrrsrUrSr+s# ==w"XQSWR )04%49 87,'6 -'- 2K'K' K'K'\8$88 8 8<DH! :( :( 2:(A:( :(  :(  :(zES'-T9, Q( Q!9 Q  Q4d &d &NJ &J &b6:04!%@DUU!/U 3 U . U  U+>U Ux6:04!%@Dbb!/b 3 b . b  b+>b%brU