Skip to content

Commit

Permalink
Use 50 GB Parquet+PyArrow dataset
Browse files Browse the repository at this point in the history
  • Loading branch information
hendrikmakait committed Aug 15, 2024
1 parent 16dc57c commit bbb4c71
Show file tree
Hide file tree
Showing 2 changed files with 3 additions and 3 deletions.
4 changes: 2 additions & 2 deletions AB_environments/config.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -35,8 +35,8 @@ h2o_datasets:
# - 0.5 GB (parquet)
# - 5 GB (parquet)
# - 50 GB (parquet)
- 5 GB (parquet+pyarrow)
# - 50 GB (parquet+pyarrow)
# - 5 GB (parquet+pyarrow)
- 50 GB (parquet+pyarrow)
# - 500 GB (parquet+pyarrow)

# AWS implements limiters to how many EC2 instances you can spawn in parallel on the
Expand Down
2 changes: 1 addition & 1 deletion tests/benchmarks/test_h2o.py
Original file line number Diff line number Diff line change
Expand Up @@ -31,7 +31,7 @@
raise ValueError("Unknown h2o dataset(s): ", unknown_datasets)
else:
enabled_datasets = {
"5 GB (parquet)",
"50 GB (parquet+pyarrow)",
}


Expand Down

0 comments on commit bbb4c71

Please sign in to comment.