Parallel I/O and Portable Data Formats (PRACE course, online)

22nd February 2022 08:00 AM
23rd February 2022 15:30 PM

(Course no. 1702022 in the training programme 2022 of Forschungszentrum Jülich)

This course will take place as an online event. The link to the streaming platform will be provided to the registrants only.


Numerical simulations conducted on current high-performance computing (HPC) systems face an ever growing need for scalability. Larger HPC platforms provide opportunities to push the limitations on size and properties of what can be accurately simulated. Therefore, it is needed to process larger data sets, be it reading input data or writing results. Serial approaches on handling I/O in a parallel application will dominate the performance on massively parallel systems, leaving a lot of computing resources idle during those serial application phases.

In addition to the need for parallel I/O, input and output data is often processed on different platforms. Heterogeneity of platforms can impose a high level of maintenance, when different data representations are needed. Portable, selfdescribing data formats such as HDF5 and netCDF are examples of already widely used data formats within certain communities.

This course will start with an introduction of different parallel I/O strategies. The course will introduce the use of the HDF5, the NetCDF and the SIONlib library interfaces. Optimization potential and best practices are discussed.

This course is a PRACE training course.

Contents level

in hours

in %

Beginner's contents:

0 h

0 %

Intermediate contents:

10 h

85 %

Advanced contents:

2 h

15 %

Community-targeted contents:

0 h

0 %


Experience in parallel programming with MPI, and programming language either C/C++ or Fortran.

Target audience:

Supercomputer users


This course is given in English.


2 days


22-23 February 2022, 9:00-16:30



Number of Participants:

maximum 25


Sebastian Lührs, JSC


Course material:

Slides and exercises

Last Modified: 08.07.2022