Parallel I/O and Portable Data Formats (training course, on-site)
Ilya Zhukov, Jolanta Zjupa, Junxian Chew
(Kurs-Nr. 842025 im Trainingsprogramm 2025 des Forschungszentrums Jülich)
Dieser Kurs findet als Vor-Ort-Veranstaltung und in Person statt. Es ist nicht möglich, online teilzunehmen.
Inhalt:
The focus of this course is on the concept of performing I/O operations (reading/writing from/to file) in parallel, as well as demonstrating the usage of common libraries to perform such parallel I/O tasks. This course will start with an introduction of different parallel I/O strategies. It will then cover the netCDF-4 and HDF5 libraries. The course will have a dedicated session on I/O guidelines for Machine/Deep Learning with PyTorch. Lastly, optimization potential and best practices for parallel I/O are discussed.
The three day course consist of lectures as well as practical exercises on implementing the techniques presented in the course.
The time table is preliminary. Final agenda will be shared via a separate email to registered participants approximately two weeks before the course.
Event page can be found here.
Agenda The preliminary agenda will be added here.
Contents level | in hours | in % |
|---|---|---|
Beginner's contents: | 5.4 h | 30 % |
Intermediate contents: | 6 h | 50 % |
Advanced contents: | 0 h | 0 % |
Community-targeted contents: | 3.6 h | 20 % |
Voraussetzungen:
- Knowledge about Linux shell (usage of terminal commands)
- Experience in one of the following programming languages C/C++/Fortran/Python
- Knowledge in MPI parallelisation or have participated in Introduction to parallel programming with MPI and OpenMP
Zielgruppe:
Supercomputer users, developers of parallel applications
Sprache:
This course is given in English.
Dauer:
3 days
Zeit:
October, exact days tba
Ort:
Jülich Supercomputing Centre, building 16.3, room 213a (Ausbildungsraum 1)
Anzahl der Teilnehmende:
minimum 5, maximum 26
Referierende:
Ilya Zhukov, Jolanta Zjupa, Junxian Chew, Aravind Sankaran, Jan Ebert (JSC)
Kontakt:
- Institute for Advanced Simulation (IAS)
- Jülich Supercomputing Centre (JSC)
Raum 323
- Institute for Advanced Simulation (IAS)
- Jülich Supercomputing Centre (JSC)
Raum 324
- Institute for Advanced Simulation (IAS)
- Jülich Supercomputing Centre (JSC)
Raum 317
Anmeldung:
Das Anmeldeformular wird ab Juli zur Verfügung stehen.