Navigation and service

PRACE training course "Parallel I/O and Portable Data Formats"

(Course no. 972020 in the training programme 2020 of Forschungszentrum Jülich)

27 Jan 2020 09:00
29 Jan 2020 16:30
Jülich Supercomputing Centre, Ausbildungsraum 1, building 16.3, room 213a
Target audience:
Supercomputer users

Numerical simulations conducted on current high-performance computing (HPC) systems face an ever growing need for scalability. Larger HPC platforms provide opportunities to push the limitations on size and properties of what can be accurately simulated. Therefore, it is needed to process larger data sets, be it reading input data or writing results. Serial approaches on handling I/O in a parallel application will dominate the performance on massively parallel systems, leaving a lot of computing resources idle during those serial application phases.

In addition to the need for parallel I/O, input and output data is often processed on different platforms. Heterogeneity of platforms can impose a high level of maintenance, when different data representations are needed. Portable, selfdescribing data formats such as HDF5 and netCDF are examples of already widely used data formats within certain communities.

This course will start with an introduction to the basics of I/O, including basic I/O-relevant terms, an overview over parallel file systems with a focus on GPFS, and the HPC hardware available at JSC. Different I/O strategies will be presented. The course will introduce the use of the HDF5, the NetCDF and the SIONlib library interfaces as well as MPI-I/O. Optimization potential and best practices are discussed.

This course is a PRACE training course.

Experience in parallel programming with MPI, and either C/C++ or Fortran in particular.
This course is given in English.
3 days
27-29 January 2020, 9:00-16:30
Jülich Supercomputing Centre, Ausbildungsraum 1, building 16.3, room 213a
Number of participants:
maximum 25
Sebastian Lührs, Benedikt Steinbusch, JSC
Photo Sebastian Lührs
Sebastian Lührs
Phone: +49 2461 61-2863
Please register until 10 January 2020 via the form at the PRACE web site

Additional Information

JSC Events - Measures Regarding the Coronavirus Pandemic

29.06.2020, 15:15

Due to the preventive measures at Forschungszentrum Jülich regarding the spread of the Coronavirus, JSC courses were cancelled or postponed. For the time being and with the rapidly changing situation in mind, JSC cannot foresee whether courses and events in the next months can take place as scheduled as face-2-face events. Seminars will preferably be streamed as video conferences, courses might be postponed or partly given as online events. We still take registrations for the upcoming courses. All participants who registered for courses so far will be notified by e-mail after the regular registration deadline whether and how the courses will be held.

Please check regularly with the webpage whether upcoming events will take place at all or be streamed.