rPj>\$dZddlmZmZddlmZddlZddlmZddl m Z m Z m Z m Z mZddlmZd d lmZmZmZmZd d lmZd d lmZmZd d lmZmZd dlmZm Z ejBe"Z#edZ$e$jKdgd ddee&edfdee'eddfdeedzeddfdee'eddfded df d!Z(d"e&d e'fd#Z)e$jKd$gd% dd"ee&dzed&fd'ee'ed(d)d*fd+ee'ed,d-fd.ee'ed/d0d1fd2eded dfd3Z*d4e&dzd2e&dzd'e'd+e'd.e'de&dzd dfd5Z+d6ee e zd7e&d ee e zfd8Z,d"e&d'e'd+e'd.e'de&dzd df d9Z-e$jKd:d;dZ.e$jKd?gd@ ddee&ed=fdAee'edBdCdDfdEee'edFdGfded df dHZ/e$jKdIgdJ dd"ee&edKfd.ee'ed/d0dLfdAee'edBdCdDfdMee'edNdOfdPee0e&dzedQfdRee0e&dzedSfded dfdTZ1e$jKdUgdV ddWee&edXfdYee&edZfded dfd[Z2e$jKd\gd] ddee&ed=fdee'edd^fd_ee'ed`dafded df dbZ3e$jKdcgdd ddeee&dzedffdgee&dzedhfd?ee'edifdjee'edkdlfdmee'edndofdpee&dzedqfdree&dzedsfdMee'edNdtfdPee0e&dzedufdRee0e&dzedvfdwee&dzedxfdyee'edzd{fd|ee'ed}d~fdee'edddfded df dZ4e$jKdgdedy)z7Contains commands to interact with buckets via the CLI.)IterableIterator) AnnotatedN)logging) BUCKET_PREFIX BucketFile BucketFolder FilterMatcher_parse_bucket_uri) REPO_REGIONS) SearchOptTokenOpt get_hf_api typer_factory)make_cp) format_sizeprint_file_listing)ArgumentOption) OutputFormatoutz"Commands to interact with buckets.)helpcreate)zhf buckets create my-bucketz hf buckets create user/my-bucketz-hf buckets create hf://buckets/user/my-bucketz*hf buckets create user/my-bucket --privatez+hf buckets create user/my-bucket --exist-okz,hf buckets create user/my-bucket --region us)nameexamples bucket_idzTBucket ID: bucket_name, namespace/bucket_name, or hf://buckets/namespace/bucket_nameprivatez --privatezCreate a private bucket.regionz--regionzdCloud region in which to create the bucket. Can be one of 'us' or 'eu'. Requires Team plan or above.exist_okz --exist-okz3Do not raise an error if the bucket already exists.tokenreturncrt|}|jtrCt|}|jr t j d|dtd|j}|j||r|nd||}tjd|jj|jy) zCreate a new bucket.r"z-Cannot specify a prefix for bucket creation: . Use namespace/bucket_name or namespace/bucket_name.N)rr r!zBucket created)uriurl)r startswithrr path_in_repoclick BadParameterid create_bucketrresultr(to_urir))rrr r!r"apiparsed bucket_urls `/home/oem/CyberBrain26-unified/.venv/lib/python3.12/site-packages/huggingface_hub/cli/buckets.pyrr1sT 5 !CM*"9-   $$? {K11>?UW II """ #J JJZ^^%:%:%<*..Qargumentcd|jtr|ttd}d|vS|}d|vS)zFCheck if argument is a bucket ID (namespace/name) vs just a namespace.N/)r*rlen)r7paths r5 _is_bucket_idr<os?=)M*,- $; $;r6z list | ls) zhf buckets listzhf buckets list huggingfacez$hf buckets list --search "my-prefix"zhf buckets list user/my-bucketz!hf buckets list user/my-bucket -Rz!hf buckets list user/my-bucket -hz%hf buckets list user/my-bucket --treez(hf buckets list user/my-bucket --tree -hz+hf buckets list hf://buckets/user/my-bucketz%hf buckets list user/my-bucket/sub -RzyNamespace (user or org) to list buckets, or bucket ID (namespace/bucket_name(/prefix) or hf://buckets/...) to list files.human_readablez--human-readablez-hz$Show sizes in human readable format.as_treez--treez3List files in tree format (only for listing files). recursivez --recursivez-Rz0List files recursively (only for listing files).searchc|duxr t|}|r(|tjdt|||||yt ||||||y)zList buckets or files in a bucket. When called with no argument or a namespace, lists buckets. When called with a bucket ID (namespace/bucket_name), lists files in the bucket. Nz'Cannot use --search when listing files.)r7r=r>r?r") namespacer@r=r>r?r")r<r,r- _list_files _list_buckets)r7r=r>r?r@r" is_file_modes r5list_cmdrFxsgr4'CM(,CL  $$%NO O)   )  r6rBc |rtjd|rtjd|8|jtr#|t td}|j d}t |}|j||Dcgc]T}|j|j|rt|j|n |j|j|jdV}}tj|dd i ycc}w) zList buckets in a namespace.z'Cannot use --tree when listing buckets.z,Cannot use --recursive when listing buckets.Nr9r%)rBr@)r.rsize total_files created_atrHright) alignments)r,r-r*rr:rstripr list_bucketsr.rrrHrIrJrtable) rBr@r=r>r?r"r2bucketitemss r5rDrDs  !JKK  !OPP!5!5m!Dc-023 $$S) 5 !C&&6&J   ))~~@NK ^ keep only what's actually under the prefix. r9N)rMr;r*)rQrRitems r5_iter_under_prefixrUsO ]]3 Ff, 0D0Dxq\0RJs AA Ac R|r6tjtjk(rt j dt |}t|}tt|j|j|jxsd||j}t||||y)zList files in a bucket.z%Cannot use --tree with --format json.r%NrRr?)r=r>r?)rmoderjsonr,r-rr listrUlist_bucket_treer.r+r)r7r=r>r?r"r2r3rQs r5rCrCs388|000  !HII 5 !C x (F    **2d# !       Eu^WXabr6infozhf buckets info user/my-bucketz+hf buckets info hf://buckets/user/my-bucketzFBucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namect|}t|}|j|j}t j |dy)zGet info about a bucket.r%r.)id_keyN)rr bucket_infor.rdict)rr"r2r3rPs r5r\r\s8" 5 !C y )F __VYY 'FHHVD!r6delete)z hf buckets delete user/my-bucketz-hf buckets delete hf://buckets/user/my-bucketz&hf buckets delete user/my-bucket --yesz-hf buckets delete user/my-bucket --missing-okyesz--yesz-yzSkip confirmation prompt. missing_okz --missing-okz3Do not raise an error if the bucket does not exist.c|jtrDt|}|jr t j d|dtd|j }n$d|vr t j d|dtdtjd|d| t| }|j|| tjd | y)zDelete a bucket. This deletes the entire bucket and all its contents. Use `hf buckets rm` to remove individual files. z-Cannot specify a prefix for bucket deletion: r&r'r9Invalid bucket ID: -. Must be in format namespace/bucket_name or z(Are you sure you want to delete bucket ''?rbr%)rczBucket deleted)rN) r*rr r+r,r-r.rconfirmr delete_bucketr0)rrbrcr"r3r2s r5rara)sJM*"9-   $$? {K11>?UW II I   !)-;;H/I_ a  KK:9+RHcR 5 !CiJ7JJ95r6z remove | rm)z)hf buckets remove user/my-bucket/file.txtz2hf buckets rm hf://buckets/user/my-bucket/file.txtz.hf buckets rm user/my-bucket/logs/ --recursivez:hf buckets rm user/my-bucket --recursive --include "*.tmp"z8hf buckets rm user/my-bucket/data/ --recursive --dry-runzBucket path: namespace/bucket_name/path or hf://buckets/namespace/bucket_name/path. With --recursive, namespace/bucket_name is also accepted to target all files.z0Remove files recursively under the given prefix.dry_runz --dry-runz8Preview what would be deleted without actually deleting.includezQInclude only files matching pattern (can specify multiple). Requires --recursive.excludezLExclude files matching pattern (can specify multiple). Requires --recursive.cNt|}|j|j}|dk(r|stjddd|s|r|stjdt |} |rt jd} g} t| j|xsdd |D]B} t| ts| j| | jd t| d D| jd t| d |s|r9t!|| } | Dcgc] }| j#|j$s|"}}n| }|Dcgc]}|j$}}t'd|D}t)|d }|st j*dyt|d|}|sK|sIt j*dj-d|Dt j.d|ddd|rGt j*dj-fd|Dt j*d|dy| j1|t j2d|ddt||y|}|stjd |r7t j*d!t4d"|t j*d#yt j.d$|d%d|| j1|gt j2d&|'ycc}wcc}w)(zbRemove files from a bucket. To delete an entire bucket, use `hf buckets delete` instead. z?No file path specified. To remove files, provide a path (e.g. 'zd/FILE') or use --recursive to remove all files. To delete the entire bucket, use `hf buckets delete z`.z,--include and --exclude require --recursive.r%zListing files from remoteNTrWzListing files from remote (z files))include_patternsexclude_patternsc34K|]}|jywN)rH).0fs r5 zremove..s7A7s)r=zNo files to remove.z file(s) totaling  c3&K|] }d| yw)z N)rtr;s r5rvzremove..sBtD6{BszRemove z from 'rgFrhc3:K|]}dtd|yw)delete: r9N)r)rtr;rs r5rvzremove..s#cPT- 1TFKcsz (dry run) z would be removed.)razRemoved ')r files_deletedrHzFile path cannot be empty.r{r9z"(dry run) 1 file would be removed.zRemove 'z' from 'z File removed)r;r)r r.r+r,r-rrstatusrUr[ isinstancerappendupdater:doner matchesr;sumrtextjoinribatch_bucket_filesr0r)r7r?rbrkrlrmr"r3rRr2r~ all_filesrTmatcherru matched_files file_paths total_sizesize_str count_label file_pathrs @r5removercszx (F I  F |I   k"DDM;b R  7I  !OPP 5 !C78&( &  ~ !    UD$ +  & ;C N;K7ST U  1#i.1AIJ g#WwWG(1M1W__QVV5LQMMM%M&34aff4 4777 z$? HH* + Z));H:F 7 HHTYYBzBB C KK'+gi[C O  HHTYYcXbcc d HHz+.@A B  y< {m79+Q 7j/   $$%AB B  HHx yk9+F G HH9 :  hyk)B?SI y)= > YGYN5s# LLL"move)z/hf buckets move user/old-bucket user/new-bucketz/hf buckets move user/my-bucket my-org/my-bucketzIhf buckets move hf://buckets/user/old-bucket hf://buckets/user/new-bucketfrom_idzMSource bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_nameto_idzRDestination bucket ID: namespace/bucket_name or hf://buckets/namespace/bucket_namect|}|jr tjd|dtdt|}|jr tjd|dtdt |}|j |j|jtjd|j|jy)z2Move (rename) a bucket to a new name or namespace.z)Cannot specify a prefix for bucket move: r&r'r%)rrz Bucket movedN) r r+r,r-rr move_bucketr.rr0)rrr" parsed_from parsed_tor2s r5rrs2$G,K  7yA--:O;Q S  "%(I  7w?--:O;Q S  5 !COOKNN),,O?JJ~{~~Y\\Jr6settings)z,hf buckets settings user/my-bucket --privatez+hf buckets settings user/my-bucket --publicz9hf buckets settings hf://buckets/user/my-bucket --privatezMake the bucket private.publicz--publiczMake the bucket public.c||k(rtjd|jtrDt |}|j r tjd|dtd|j }n$d|vr tjd|dtdt|}|j|| tjd || tjd |d y)z$Update bucket settings (visibility).z-Specify exactly one of --private or --public.z-Cannot specify a prefix for bucket settings: r&r'r9rerfr%)rzBucket settings updated)rrzRun `hf buckets info z` to view bucket details.N) r,r-r*rr r+r.rupdate_bucket_settingsrr0hint)rrrr"r3r2s r5rrs@&  !PQQM*"9-   $$? {K11>?UW II I   !)-;;H/I_ a  5 !Cy':JJ(IwOHH$YK/H IJr6sync)z2hf buckets sync ./data hf://buckets/user/my-bucketz2hf buckets sync hf://buckets/user/my-bucket ./dataz;hf buckets sync ./data hf://buckets/user/my-bucket --deletez^hf buckets sync hf://buckets/user/my-bucket ./data --include "*.safetensors" --exclude "*.tmp"zIhf buckets sync ./data hf://buckets/user/my-bucket --plan sync-plan.jsonlz'hf buckets sync --apply sync-plan.jsonlzrs >. #" :(&   H %!EF    0   90R g  0R  +  0R t w   0R*  F  +0R8 90R: ;0R 0RfCD   0    E>  d W  >    7  > $  F  %> 2   C  3> B C> D E> F G> > B 3Tz 3 $J 3 3 3  3 : 3  3F hzL'@A 3 S[\fiu\uSv cccc c : c  c6  (5 " Y   "  "  " "   .  -.6 Y  .6    ,   .6  F  .6, -.6. /.6.6b   6    [BH a  BH   C  BH$    ,   %BH4  K  5BHB S Dd  CBHN S D_  OBHZ [BH\ ]BH BHJ  *"K  `  "K  e   "K "K "K"KJ  *  +,K Y  ,K  +  ,K   *   ,K* +,K, -,K,Kh    &         yrP  d ^   rP  d c   rP  B   rP&  N  'rP4  O  5rPB  d P   CrPN  d 6   OrPZ  H  [rPh S DI  irPt S DI  urP@ d ;  ArPL  T  MrPZ  V  [rPh   8  irPx yrPz {rP rPv    )r6