From 21dbbab5e3ecc6e8ae2a68971477a0162f4e9393 Mon Sep 17 00:00:00 2001 From: Huihuo Zheng Date: Tue, 11 Jun 2024 11:44:34 -0500 Subject: [PATCH] sync up (#205) * Request changes from MLPerf Storage (#199) * added au metric to the configuration file; set shuffling and shuffle buffer size to be 2 for cosmoflow * removed dependencies on dlioprofiler * fixed bugs * Fixed potential insufficient samples due to num_files is not divisible by comm.size (#200) * added au metric to the configuration file; set shuffling and shuffle buffer size to be 2 for cosmoflow * removed dependencies on dlioprofiler * fixed bugs * recovered back dlio_profiler * fixed potential not enough samples * Update tf_reader.py * Mlperf requests (#201) * added au metric to the configuration file; set shuffling and shuffle buffer size to be 2 for cosmoflow * removed dependencies on dlioprofiler * fixed bugs * fixed issue with dlio_profiler * bring back dlio_profiler_py * Bring v1.0 to the most recent commit (#202) (#203) * Request changes from MLPerf Storage (#199) * added au metric to the configuration file; set shuffling and shuffle buffer size to be 2 for cosmoflow * removed dependencies on dlioprofiler * fixed bugs * Fixed potential insufficient samples due to num_files is not divisible by comm.size (#200) * added au metric to the configuration file; set shuffling and shuffle buffer size to be 2 for cosmoflow * removed dependencies on dlioprofiler * fixed bugs * recovered back dlio_profiler * fixed potential not enough samples * Update tf_reader.py * Mlperf requests (#201) * added au metric to the configuration file; set shuffling and shuffle buffer size to be 2 for cosmoflow * removed dependencies on dlioprofiler * fixed bugs * fixed issue with dlio_profiler * bring back dlio_profiler_py * Fix requirements file (#204) Signed-off-by: Johnu George --------- Signed-off-by: Johnu George Co-authored-by: Johnu George --- requirements.txt | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/requirements.txt b/requirements.txt index 6def223f..537a6552 100644 --- a/requirements.txt +++ b/requirements.txt @@ -20,7 +20,7 @@ Markdown>=3.4.1 MarkupSafe>=2.1.1 mpi4py>=3.1.4 numpy>=1.23.5 ---extra-index-url https://pypi.nvidia.com nvidia-dali-cuda110>=1.34.0 +nvidia-dali-cuda110>=1.34.0 oauthlib>=3.2.2 omegaconf>=2.2.3 opt-einsum>=3.3.0