Skip to content

Commit

Permalink
Update the README file
Browse files Browse the repository at this point in the history
  • Loading branch information
arcturus5340 committed Aug 17, 2024
1 parent 56c6d0f commit 33281ad
Showing 1 changed file with 14 additions and 4 deletions.
18 changes: 14 additions & 4 deletions dlio/README.md
Original file line number Diff line number Diff line change
@@ -1,9 +1,19 @@
# DLIO benchmark

The benchmark is designed to measure the performance of training and evaluation of deep learning models on data stored
as HDF5 files. Based on collected and analysed I/O patterns from [DLIO Benchmark](https://github.com/argonne-lcf/dlio_benchmark),
this benchmark simulates the learning process and evaluation of deep learning models using PyTorch and Tensorflow
frameworks, while gathering valuable information about system performance.
The benchmark is designed to measure the performance of training and evaluation of deep learning models on data stored
as HDF5 files. Based on collected and analysed I/O patterns from [DLIO Benchmark](https://github.com/argonne-lcf/dlio_benchmark),
this benchmark simulates the learning process and evaluation of deep learning models that use PyTorch and Tensorflow
frameworks, while gathering valuable information about system performance. Most importantly, this extension allows users
to test AI workloads without the need to install machine learning libraries, reducing complexity and enhancing the
usability of the benchmark. Another advantage is that from our experiments, our extension ran faster than DLIO Benchmark,
which we suspect was due to the difference in the overhead introduced by the C application in our extension and the
Python application in the original benchmark. While the quicker runtime could be beneficial for faster testing, it also
suggests that the benchmark might not fully capture the complexity of real AI workloads, such as high metadata
operations introduced by the use of Python-based libraries. I/O pattern produced by this extension is based on the
implementation of [DLIO benchmark version 1.1](https://github.com/argonne-lcf/dlio_benchmark/releases/tag/v1.1).
Changes in the main DLIO Benchmark configurations after version 1.1 will not be reflected in this h5bench pattern. To
reproduce them, DLIO Benchmark behavior can be studied using various I/O analysis tools. We recommend using Log VFD.


## Configuration
As in the case with other extensions, the following parameters should be specified in the configuration section of the
Expand Down

0 comments on commit 33281ad

Please sign in to comment.