Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Datasets] Add local and S3 filesystem test coverage for file-based datasources. #17158

Merged
merged 14 commits into from
Aug 12, 2021
Merged

[Datasets] Add local and S3 filesystem test coverage for file-based datasources. #17158

Changes from 1 commit
Commits
Show all changes
14 commits
Select commit Hold shift + click to select a range
8b4caa9
Ensure that S3 protocols are sliced off of S3 URIs.
clarkzinzow Jul 16, 2021
82e25e6
Add local and S3 filesystem test coverage for JSON/CSV readers.
clarkzinzow Jul 16, 2021
358f971
Formatting.
clarkzinzow Jul 16, 2021
2960c12
Use urllib to parse and trim URI to path.
clarkzinzow Jul 16, 2021
0e81906
Bump Pandas to >=1.2.0.
clarkzinzow Jul 16, 2021
c583368
Update Workflow/Datasets to use Python 3.7.
clarkzinzow Jul 16, 2021
ac7fba8
pandas>=1.2.0 for Python 3.7+.
clarkzinzow Jul 17, 2021
c4aef87
Reinstall Ray in Workflows/Datasets Buildkite job since the Python ve…
clarkzinzow Jul 17, 2021
710892b
Bump dataset tests to large timeout.
clarkzinzow Jul 18, 2021
167047f
Revert "Bump dataset tests to large timeout."
clarkzinzow Jul 19, 2021
c4b633b
Fixes after rebase.
clarkzinzow Aug 11, 2021
cbd363c
Formatting.
clarkzinzow Aug 11, 2021
59c4f61
Remove stale pickle5 files before rebuilding Ray.
clarkzinzow Aug 12, 2021
be86d06
Add s3fs as a test dependency.
clarkzinzow Aug 12, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
pandas>=1.2.0 for Python 3.7+.
  • Loading branch information
@clarkzinzow
clarkzinzow committed Aug 11, 2021
commit ac7fba8f89e833a8d1945bdb4dba440313882464
3 changes: 2 additions & 1 deletion python/requirements.txt
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,8 @@ gym
lz4
scikit-image
opencv-python-headless==4.3.0.36
pandas>=1.2.0
pandas>=1.0.5; python_version < '3.7'
pandas>=1.2.0; python_version >= '3.7'
scipy==1.4.1
tabulate
tensorboardX >= 1.9
Expand Down