kQj-%@dZddlZddlZddlmZmZddlZddlZerddl m Z dZ dZ dZ ejdjZej"ej$d ej&d ej$d ej(d ej$d ej*d ej$dej*d gZdaGddej0ZdedefdZdedefdZdedefdZdej@defdZ!dej@defdZ"dejFde$e%eeffdZ&dejFde$efdZ'dejFde$efdZ(dejFde$efdZ)dejFdefdZ*d ej0dejVfd!Z,d"Z- d.dddd#d$ed%ed&ee.d'ee.d(ee.dej@f d)Z/ej`fd*e.d+ejVdejVfd,Z1d$efd-Z2y)/z&Schema helpers for Lance blob columns.N) TYPE_CHECKINGOptional)BlobTypez lance.blob.v2zlance-encoding:blobzARROW:extension:namedataTnullableuripositionsizec\eZdZdZd dZdefdZedejdeddfdZ d Z y) _FallbackBlobTypez@lance.blob.v2 extension type used when pylance is not installed.returnNcVtjj|ttyN)pa ExtensionType__init___BLOB_V2_STORAGE_TYPE_BLOB_EXTENSION_NAMEselfs S/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/lancedb/schema.pyrz_FallbackBlobType.__init__#s !!$(=?STcy)Nrrs r__arrow_ext_serialize__z)_FallbackBlobType.__arrow_ext_serialize__&sr storage_type serializedc|Srr)clsrrs r__arrow_ext_deserialize__z+_FallbackBlobType.__arrow_ext_deserialize__)s u rcdt|j|j|jffSr)typer"rrrs r __reduce__z_FallbackBlobType.__reduce__/s3Dz33     ( ( *6   r)rN) __name__ __module__ __qualname____doc__rbytesr classmethodrDataTyper"r%rrrrr sLJU;;49   rrmetadatakeycf|j|jxs|j|Sr)getencode)r-r.s r_metadata_valuer26s% << % :c)::rrc`|syt|t}|ttjfvS)NF)r2_ARROW_EXT_NAME_KEYrr1)r-extension_names r_metadata_marks_blob_v2r6:s0 $X/BCN 24H4O4O4QR RRrc,|syt|tdvS)NF)truestrue)r2 _BLOB_V1_KEY)r-s r_metadata_marks_legacy_blobr:Bs  8\ 26G GGrfieldc|j}t|tjr|jt k(ryt |jxsiS)z;Return True if `field` declares a blob v2 extension column.T)r$ isinstancerrr5rr6r-)r; field_types ris_blob_v2_fieldr?IsAJ:r//0  % %)= = "5>>#7R 88rcNt|xst|jxsiS)a,Blob detection for ``to_pandas(blob_mode=...)`` and scanner paths only. Matches v2 extension fields on table schema, legacy ``lance-encoding:blob`` storage columns, and v2 query descriptor fields (the engine tags those with the same metadata). Not used for fetch or auto ``_rowid``. )r?r:r-)r;s ris_blob_like_fieldrATs$ E " W&A%..BVTV&WWrschemacPgdtdtddffd |ddS)zIWalk the schema and return (path, has_list_ancestor) for each blob field.prefixhas_list_ancestorrNc@|D]}|r|d|jn |j}|rj||f?tjj |j r|j ||}tjj |j sStjj|j s*tjj|j s|j jg|dy)N.T) nameappendrtypes is_structr$is_list is_large_listis_fixed_size_list value_field)fieldsrDrEr;pathis_blobpathswalks rrTz!_collect_blob_paths..walkbs ;E/5fXQuzzl+5::Du~ d$567##EJJ/UZZ'89  ,88))%**588..uzz:ejj,,-tT: ;rF)strbool)rBrRrSrTs `@@r_collect_blob_pathsrX^s5$&E ;S ;T ;d ; U LrcTt|tDcgc]\}}| c}}Scc}}w)zDDotted paths of blob-like columns (v2 extension or legacy metadata).)rXrArBrQ_s rblob_column_pathsr\ts" 3F>' " ' ''rcttS tjd}t|dd}|Qt |}t ||ur0t |}t d|jd|j|a|S tjttatS#t$r}|jdvrYd}~Gd}~wwxYw#tj$r}t d|d}~wwxYw)zReturn the BlobType class this process should use. pylance's class when it owns the lance.blob.v2 registry entry, otherwise LanceDB's fallback. A different registered class is an error. N lance.blobrz'lance.blob.v2 is already registered by rG)lancernz>lance.blob.v2 is already registered by another extension class)_resolved_blob_type importlib import_modulegetattrrlr$ ValueErrorr'r(ModuleNotFoundErrorrHrregister_extension_typer ArrowKeyError) blob_module blob_typeregistered_typeregistered_clserrs r_resolve_blob_typer}s&""--l; KT:  :9;GOO$I5!%o!6 =%001>3N3N2OQ#,   ""#4#67 , -  882 2  3"    L  s/B-C- C6C  CC6% C11C6)inline_size_thresholddedicated_size_thresholdpack_file_size_thresholdrHr r~rrci}d|ddfd|ddfd|ddffD]\}}}} | t|tst|ts#t|d t |j |d ks|d k(r|s|rd nd } t |d | |tkDrt|dt||| <t} tj|| |} |r| j|S| S)aLCreate a Lance blob v2 column field. When pylance is installed this is ``lance.blob.BlobType``. Parameters ---------- name: Field name. nullable: Whether the column accepts null values. inline_size_threshold: Maximum payload size in bytes to keep inline in the data file before using packed blob storage. Zero is allowed. dedicated_size_threshold: Maximum payload size in bytes to store in packed blob storage before using dedicated blob storage. Must be positive. pack_file_size_threshold: Maximum size in bytes of a single packed blob sidecar file before a new one is started. Must be positive. Thresholds are validated and stored as Arrow field metadata, with the same format as ``lance.blob_field``. They do not require pylance. r~Tz)lance-encoding:blob-inline-size-thresholdrFz,lance-encoding:blob-dedicated-size-thresholdrz,lance-encoding:blob-pack-file-size-thresholdz must be an int, got rz non-negativepositivez must be z must fit in a Rust usizer)r=rWint TypeErrorr$r&rt_MAX_RUST_USIZE OverflowErrorrVr}rr; with_metadata) rHr r~rrr- thresholdrg allow_zeror.boundryr;s rblobrs'>H $ !  7   ' $  :   ' $  :  .#) 5*c( =  eT "*UC*@yk)>tE{?S?S>TUV V 19!J&0NjE {)E7;< < ? "9+-F GH HE  ;#>#$I HHT9; :E,45  x (?%?r dimension value_typec.tj||S)aA help function to create a vector type. Parameters ---------- dimension: The dimension of the vector. value_type: pa.DataType, optional The type of the value in the vector. Returns ------- A PyArrow DataType for vectors. Examples -------- >>> import pyarrow as pa >>> import lancedb >>> schema = pa.schema([ ... pa.field("id", pa.int64()), ... pa.field("vector", lancedb.vector(756)), ... ]) )rlist_)rrs rvectorrs. 88J **rch|dk(rt}|td<|Stdtd|)Nrzmodule z has no attribute )r}globalsAttributeErrorr&)rHrys r __getattr__rs= z&( ) * 78,.@I JJr)T)3r)ctypesrqtypingrrpyarrowr pyarrow.ipc lance.blobrrr9r4c_size_trgrstructr; large_binaryutf8uint64rrprrdictrVr2rWr6r:Fieldr?rASchemalisttuplerXr\r`rbrdr,rlr}rrfloat32rrrrrrs - */&$ ,!&//"%++! *T: D1YRYY[48t4  (( ,;d;;SdStSH$H4H9BHH99XbhhX4X tE#t)