-
Notifications
You must be signed in to change notification settings - Fork 27
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Merge branch 'master' into jeanbez-patch-8
- Loading branch information
Showing
15 changed files
with
667 additions
and
23 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,61 @@ | ||
# This CITATION.cff file was generated with cffinit. | ||
# Visit https://bit.ly/cffinit to generate yours today! | ||
|
||
cff-version: 1.2.0 | ||
title: h5bench | ||
message: >- | ||
If you use this software, please cite it using the | ||
metadata from this file. | ||
type: software | ||
authors: | ||
- given-names: Suren | ||
family-names: Byna | ||
email: [email protected] | ||
affiliation: Lawrence Berkeley National Laboratory | ||
orcid: 'https://orcid.org/0000-0003-3048-3448' | ||
- given-names: Jean Luca | ||
family-names: Bez | ||
email: [email protected] | ||
affiliation: Lawrence Berkeley National Laboratory | ||
orcid: 'https://orcid.org/0000-0002-3915-1135' | ||
- given-names: Tonglin | ||
family-names: Li | ||
affiliation: Lawrence Berkeley National Laboratory | ||
- given-names: Quincey | ||
family-names: Koziol | ||
affiliation: National Energy Research Scientific Computing Center | ||
- given-names: Houjun | ||
family-names: Tang | ||
email: [email protected] | ||
affiliation: Lawrence Berkeley National Laboratory | ||
orcid: 'https://orcid.org/0000-0001-7038-8360' | ||
- given-names: Qiao | ||
family-names: Kang | ||
affiliation: Lawrence Berkeley National Laboratory | ||
identifiers: | ||
- type: url | ||
value: >- | ||
https://sdm.lbl.gov/~sbyna/research/papers/2021/202106-CUG_2021_h5bench.pdf | ||
description: CUG Paper | ||
- type: url | ||
value: 'https://github.com/hpc-io/h5bench' | ||
description: Github Repository | ||
- type: url | ||
value: 'https://h5bench.readthedocs.io' | ||
description: h5bench Documentation | ||
repository-code: 'https://github.com/hpc-io/h5bench' | ||
abstract: >- | ||
h5bench is a suite of parallel I/O benchmarks or kernels | ||
representing I/O patterns that are commonly used in HDF5 | ||
applications on high performance computing systems. | ||
h5bench measures I/O performance from various aspects, | ||
including the I/O overhead, observed I/O rate, etc. | ||
keywords: | ||
- HDF5 | ||
- I/O | ||
- HPC | ||
- I/O benchmark | ||
- I/O kernel | ||
commit: ' 67a3e6d91508e5ab77db79c6187b2eb3c96119e0' | ||
version: v.1.4 | ||
date-released: '2023-05-31' |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,2 +1,4 @@ | ||
sphinx==6.2.1 | ||
sphinx-rtd-theme==1.2.2 | ||
sphinxemoji | ||
urllib3==1.26.15 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,37 @@ | ||
## Additions to H5Bench_read | ||
4 new patterns are added to the h5bench read benchmark: | ||
1. CS: Refers to the Cross Stencil data access pattern. A block of fixed sides is used to read data from HDF5. This block is given a fixed stride in each dimension and data till end of file is read. | ||
2. LDC: Refers to the Left Diagonal Corner data access pattern. Data is read from two identical blocks of fixed sides, one in the top left corner and the other in the bottom right corner in the 2D HDF5 file | ||
3. RDC: Refers to the Right Diagonal Corner data access pattern. Data is read from two identical blocks of fixed sides, one in the top right corner and the other in the bottom left corner in the 2D HDF5 file | ||
4. PRL: Refers to the Peripheral data access pattern. Data is read from the periphery of the file, which is a frame of fixed width and height around the file. | ||
|
||
These patterns work with a single MPI process. In case multiple processes are used, only the root performs the read operations and all other processes skip the reads. Illustrations of the patterns are given in the table below: | ||
|
||
| Pattern -> | CS | LDC | RDC | PRL | | ||
| ---------- | ---------- | ---------- | ---------- | ---------- | | ||
|Illustration | ![CS Pattern](./images/CS.png) | ![LDC Pattern](./images/LDC.png) | ![RDC Pattern](./images/RDC.png) | ![PRL Pattern](./images/PRL.png) | | ||
|
||
|
||
|
||
Steps for running these benchmarks are the same as the other benchmarks. All parameter and requirements and running instructions remain same, except for the following parameters which are additionally required to be provided in the configuration: | ||
1. CS | ||
| Parameter | Description | | ||
| --------- | ----------- | | ||
| `BLOCK_SIZE` | Size of the block of data along `dim_1` | | ||
| `BLOCK_SIZE_2` | Size of the block of data along `dim_2` | | ||
| `STRIDE_SIZE` | Size of the block of data along `dim_1` | | ||
| `STRIDE_SIZE_2` | Size of the block of data along `dim_2` | | ||
|
||
2. LDC/RDC | ||
| Parameter | Description | | ||
| --------- | ----------- | | ||
| `BLOCK_SIZE` | Size of the block of data along `dim_1` | | ||
| `BLOCK_SIZE_2` | Size of the block of data along `dim_2` | | ||
|
||
3. PRL | ||
| Parameter | Description | | ||
| --------- | ----------- | | ||
| `BLOCK_SIZE` | Size of the frame along `dim_1` | | ||
| `BLOCK_SIZE_2` | Size of the frame along `dim_2` | | ||
|
||
Exmaples of some configurations are provided in `h5bench/samples/sync-write-1d-contig-contig-read-<pattern>.json` |
Oops, something went wrong.