PRACE-Trainingskurs "Parallel I/O and Portable Data Formats"

27.01.2020 08:00 Uhr
29.01.2020 15:30 Uhr
Jülich Supercomputing Centre, Ausbildungsraum 1, Geb. 16.3, Raum 213a

(Kurs-Nr. 972020 im Trainingsprogramm 2020 des Forschungszentrums)


Numerical simulations conducted on current high-performance computing (HPC) systems face an ever growing need for scalability. Larger HPC platforms provide opportunities to push the limitations on size and properties of what can be accurately simulated. Therefore, it is needed to process larger data sets, be it reading input data or writing results. Serial approaches on handling I/O in a parallel application will dominate the performance on massively parallel systems, leaving a lot of computing resources idle during those serial application phases.

In addition to the need for parallel I/O, input and output data is often processed on different platforms. Heterogeneity of platforms can impose a high level of maintenance, when different data representations are needed. Portable, selfdescribing data formats such as HDF5 and netCDF are examples of already widely used data formats within certain communities.

This course will start with an introduction to the basics of I/O, including basic I/O-relevant terms, an overview over parallel file systems with a focus on GPFS, and the HPC hardware available at JSC. Different I/O strategies will be presented. The course will introduce the use of the HDF5, the NetCDF and the SIONlib library interfaces as well as MPI-I/O. Optimization potential and best practices are discussed.

This course is a PRACE training course.

Level der vermittelten Inhalte

in Stunden

in %

Inhalte für Anfänger:

0 h

0 %

Mittlere Inhalte:

14 h

87,5 %

Fortgeschrittene Inhalte:

2 h

12,5 %

Inhalte für Fach-Communities:

0 h

0 %


Erfahrungen im parallelen Programmieren mit MPI, Kenntnisse in den Programmiersprachen C, C++ oder Fortran


Mitarbeiter, die Parallelrechner nutzen


Der Kurs wird auf Englisch gehalten.


3 Tage


27. - 29. Januar 2020, 9.00 - 16.30 Uhr


Jülich Supercomputing Centre, Ausbildungsraum 1, Geb. 16.3, Raum 213a


maximal 25


Sebastian Lührs, Benedikt Steinbusch, JSC


Photo Sebastian Lührs

Sebastian Lührs

Telefon: +49 2461 61-2863




Letzte Änderung: 11.04.2022