Code

Hugging Face Hub Integration!#4193

Code

Merged

jacobmarks merged 69 commits intodevelopvoxel51/fiftyone:developfrom hf-hub-integration-v2voxel51/fiftyone:hf-hub-integration-v2Copy head branch name to clipboardApr 5, 2024

+2,279-31

Commits

Commits on Mar 24, 2024

• initial sketch

  jacobmarks

  committed
  a9eb9c7

Commits on Mar 25, 2024

• always add filepath to sample dict

  jacobmarks

  committed
  cadc1be

• image shape util usage

  jacobmarks

  committed
  7214599

• change load_from_hub kwargs to named

  jacobmarks

  committed
  8eaf809

• robust label field kwarg handling

  jacobmarks

  committed
  558497a

• enable config spec through kwargs

  jacobmarks

  committed
  80b946e

• Speedup media download with threadpools

  jacobmarks

  committed
  0de7125

• adds support for loading from gated repos

  jacobmarks

  committed
  72b381f

• use threadpool to download masks

  jacobmarks

  committed
  3090f37

• default batch size config

  jacobmarks

  committed
  50d8deb

• adds push_to_hub()

  jacobmarks

  committed
  7225363

• adds loading FiftyOne datasets from hub

  jacobmarks

  committed
  3664981

• clean up

  jacobmarks

  committed
  b63cdbf

Commits on Mar 26, 2024

• handle no-label classification case

  jacobmarks

  committed
  74e214c

Commits on Mar 28, 2024

• rename hf util file

  jacobmarks

  committed
  639a7c2

• adds standard module docstring

  jacobmarks

  committed
  a539d76

• removes detection_format and mask_targets for now

  jacobmarks

  committed
  8d49821

• lazy import huggingface_hub

  jacobmarks

  committed
  cbafc83

• remove unused import

  jacobmarks

  committed
  7fd50ba

• use TmpDir eta util

  jacobmarks

  committed
  45aaefc

• fixes docstring indentation

  jacobmarks

  committed
  0463937

• fix api docstring bullet list indent

  jacobmarks

  committed
  047947a

• changing heading levels

  jacobmarks

  committed
  4e2f674

• change default push to public

  jacobmarks

  committed
  750c75a

• basic push_to_hub docs

  jacobmarks

  committed
  025a61e

• updating code snippet for loading dataset

  jacobmarks

  committed
  97a7241

• pushing to hub advanced usage section

  jacobmarks

  committed
  8eb5a0e

• examples for advanced push section

  jacobmarks

  committed
  a9d6801

• loading from hub via local config docs

  jacobmarks

  committed
  cc7f2c0

• hub loading from kwargs docs

  jacobmarks

  committed
  edcbc4c

• starting supported config fields section

  jacobmarks

  committed
  c6fe103

Commits on Mar 29, 2024

• documenting all supported config args

  jacobmarks

  committed
  75b997d

• documents split and subset config

  jacobmarks

  committed
  cc64b7b

• documents download process params

  jacobmarks

  committed
  fc9cfa8

• documents loading classification datasets

  jacobmarks

  committed
  4c49b32

• documents loading detection datasets

  jacobmarks

  committed
  0404864

• adds note about other detection formats

  jacobmarks

  committed
  e45317d

• documents loading segmentation datasets

  jacobmarks

  committed
  b510fff

• Documents loading unlabeled datasets

  jacobmarks

  committed
  b79fdf6

• documents advanced loading

  jacobmarks

  committed
  75b60ef

• adds breadcrumb to config args

  jacobmarks

  committed
  6114d74

• Documents loading gated datasets

  jacobmarks

  committed
  d619c0e

• adds num_workers arg for downloading

  jacobmarks

  committed
  f0e82c2

• remove unnecessary max_samples

  jacobmarks

  committed
  75ee44c

• access warning

  jacobmarks

  committed
  de658d8

• removes globals cache

  jacobmarks

  committed
  c771667

Commits on Apr 3, 2024

• implementation/doc updates

  brimoor

  committed
  b1e3882

• Merge pull request #4223 from voxel51/hf-hub-integration-v2-brian

  Show description for 7801a0a
  jacobmarks

  authored
  7801a0a

• bump huggingface_hub version for token auth

  jacobmarks

  committed
  3951c2c

Commits on Apr 4, 2024

• Update docs/source/integrations/huggingface.rst

  Show description for 8b74e3d
  

  jacobmarks

  and

  davanstrien

  authored
  8b74e3d

• Update docs/source/integrations/huggingface.rst

  Show description for dc3af96
  

  jacobmarks

  and

  davanstrien

  authored
  dc3af96

• Update docs/source/integrations/huggingface.rst

  Show description for cd72833
  

  jacobmarks

  and

  davanstrien

  authored
  cd72833

• Update docs/source/integrations/huggingface.rst

  Show description for 9318690
  

  jacobmarks

  and

  davanstrien

  authored
  9318690

• docs pass

  brimoor

  committed
  43e6ce1

• Merge branch 'hf-hub-integration-v2' of https://github.com/voxel51/fiftyone into hf-hub-integration-v2

  brimoor

  committed
  4484c2f

• makes fiftyone version req optional

  jacobmarks

  committed
  6cab1d0

• document min_fiftyone_version

  jacobmarks

  committed
  e50e353

• validation min_fiftyone_version

  jacobmarks

  committed
  9e1e7d5

• remove unused import

  jacobmarks

  committed
  df1db86

• adds preview_path option to preview dataset

  jacobmarks

  committed
  e4e78ac

• documents preview_path

  jacobmarks

  committed
  40f7b92

• improve name resolution

  jacobmarks

  committed
  d5ea06e

• only download necessary media files for FiftyOneDatasets

  jacobmarks

  committed
  b71e3fb

• removing version validation

  jacobmarks

  committed
  e2f55af

Commits on Apr 5, 2024

• improve efficiency

  jacobmarks

  committed
  6937faa

• Merge pull request #4231 from voxel51/hf-hub-upgrades

  Show description for 1179d9a
  jacobmarks

  authored
  1179d9a

• Adds context without progress bars for upload/download

  jacobmarks

  committed
  a5291a6

• Merge pull request #4234 from voxel51/hf-hub-progress-bars

  Show description for 91f026d
  jacobmarks

  authored
  91f026d

• Update install instructions

  Show description for fd624fa
  jacobmarks

  authored
  fd624fa