Workshop, 18-19 September 2018, Jülich Supercomputing Centre, Forschungszentrum Jülich
Start
18th September 2018 07:00 AM
End
19th September 2018 11:00 AM
Location
Jülich Supercomputing Centre, GRS building 16.15, Lecture Hall, room 2009
Exascale computing will require exascale data handling. Earth system sciences and other application areas (e.g. astrophysics, genomics, photon science) are facing rapidly growing challenges due to the fact that observation systems and numerical models are producing data of unprecedented volumes and at unprecedented rates. Weather and climate models must be further developed to resolve the small scales that are relevant for extreme events and the assessment of their impacts. New telescopes, medical imagers, satellites, and other instruments produce data in finer resolutions, at higher frequencies, with increasing numbers of channels. Scientific progress and the development of services (e.g. environmental prediction) hinge on the ability of the next-generation compute and data infrastructures to cope with these data streams. Present workflows often decouple data generation, data processing and services, and data archiving and curation. The anticipated dimension of extreme data will require development of new hardware technology, new workflows and service architectures, and a better integration across various storage systems. The workshop aims at identifying common demands across research fields and at developing prospects how future extreme data systems may unfold.
The Extreme Data workshop is organized in three half-day sessions:
Extreme data demands
Extreme data technology
Extreme data services
Each session will consist of 2-3 invited and up to 4 contributed presentations taking stock of the currently anticipated developments and identifying the major challenges on the way to exascale data handling. Each block of presentations will be followed by a half-hour discussion session, and a final discussion will take place at the end of the workshop. A proceedings volume will be published after the workshop.
The workshop shall focus primarily on HPC-related extreme data. However, topics such as data integration and sharing between HPC and cloud systems will also be covered. Big data analytics concepts which can help managing exascale data, are also in scope. With regard to earth system data demands, technologies, and services, this event complements a workshop on extreme HPC to be held at ECMWF (Reading, UK) also in September 2018.
Proceedings
The proceedings of the workshop were issued as a volume in the IAS Series of Forschungszentrum Jülich.
Extreme Data Workshop 2018 - Proceedings Extreme Data: Demands, Technologies, and Services - A Community Workshop Martin Schultz, Dirk Pleiter, Peter Bauer (Editors) Extreme Data Workshop 2018, Forschungszentrum Jülich, 18–19 September 2018 ISBN 978-3-95806-392-1, https://hdl.handle.net/2128/22029 Schriften des Forschungszentrums Jülich, IAS Series 40, 2019, 64 pages Extreme Data Workshop 2018 - Proceedings (pdf, 10 MB)
Tuesday, 18 September 2018, Lecture Hall at building 16.15 (GRS building)
08:15
Shuttle from Jülich (bus stop“Neues Rathaus”, directly in front of the door to the town hall) to conference venue
08:30-09:00
Registration
09:00-09:30
Welcome address (Harald Bolt, member of the Board of Directors, FZ Jülich) Workshop objectives and logistics (Martin Schultz, FZ Jülich)
Session 1: Extreme Data Demands
09:30-09:50
Markus Reichstein (MPI BGC, DE): “Data-driven Earth System Science – Challenges and Perspectives”
09:50-10:10
Steve Aplin (DESY, DE): “Data Challenges in Serial Femtosecond Crystallography”
10:10-10:30
Giovanni Pizzi (EPFL, CH): “Extreme-Data Demands in Materials Science: Dealing with High-Throughput Calculations towards the Exascale”
10:30-11:00
Coffee break
11:00-11:20
Paolo Papale (INGV, IT): “Extreme data in volcano science: issues, demands, and challenges”
11:20-11:40
Dörthe Handorf (AWI, DE): “Analysis of the atmospheric circulation from big data in climate modeling – Current approaches and future challenges”
11:40-12:00
Jan Erik Sundermann (KIT, DE) “The Challenge of the Data Demands of the High Luminocity LHC Experiments for the GridKa WLCG Tier-1 Center at KIT”
12:00-13:30
Lunch break
Session 2: Extreme Data Technologies
13:30-13:50
Guido Juckeland (HZDR, DE): “Is It Here/There Yet? - Real Life Experiences of Generating/Evaluating Extreme Data Sets Around the World”
13:50-14:10
Sadaf Alam (CSCS, CH): “What is trending at large-scale experimental facilities for managing unprecedented data growth”
14:10-14:30
Stephan Kindermann (DKRZ, DE) “Towards exascale climate data handling: infrastructure, data management and data services”
14:30-14:50
Tiago Quintino (ECMWF, UK): “ECMWF's Extreme Data Challenges on the HPC and Cloud systems”
14:50-15:10
Bryan Lawrence (University of Reading, UK) “Two approaches to beating data bottlenecks in weather and climate science”
15:10-15:40
Coffee break
15:40-16:00
Dirk Pleiter (FZ Jülich, DE): “Future I/O Architectures and Infrastructures for Extreme Scale Data Analytics”
16:00-17:00
Vendors’ views on emerging extreme data technologies: - IBM (Oliver Oberst) - DDN (Jean-Thomas Acquaviva) - Cray (NN, tbc)
17:00
Adjourn of day 1 – Shuttle to Jülich (bus stop “Neues Rathaus”)
19:15
Shuttle from Jülich (bus stop“Neues Rathaus”, directly in front of the door to the town hall) to Conference Dinner at Burg Obbendorf
19:45-22:15
Conference Dinner at Burg Obbendorf
22:15
Shuttle to Jülich (bus stop “Neues Rathaus”)
Wednesday, 19 September 2018, Lecture Hall at building 16.15 (GRS building)
08:30
Shuttle from Jülich (bus stop“Neues Rathaus”, directly in front of the door to the town hall) to conference venue
Session 3: Extreme Data Services
09:10-09:30
Peter Bauer (ECMWF, UK): “Extreme data and computing in operational weather prediction”
09:30-09:50
Jeannot Trampert (University Utrecht, NL): “Data flow and assimilation in computational seismology”
09:50-10:10
Klaus Goergen (FZ Jülich, DE) “Towards big data-enabled terrestrial systems modelling at HPSC TerrSys”
10:10-10:30
Jens Bröder (FZ Jülich, DE) “Using the AiiDA framework for Data generation and processing in Materials Science”
10:30-11:00
Coffee break
11:00-11:20
Ugur Cayoglu (KIT, DE): “Flexible Toolkit Developments for Climate Data Applications: Compression and Tensor Frameworks”
11:20-11:40
Kai Krajsek (FZ Jülich, DE): “The Helmholtz Analytics Toolkit (HeAT) - A Scientific Big Data Library for HPC”
11:40-12:30
Concluding discussions: - Commonalities and differences in data demands across and within scientific disciplines - Will technologies on the horizon be able to meet the needs? - How quickly will data management evolve to data services? - Relevance of workshop conclusions for ExtremeEarth
12:30-13:00
Lunch Break
13:00
Shuttle departure to airports / train station
Invited Speakers
Peter Bauer (ECMWF, Shinfield Park, Reading, United Kingdom) Stephan Kindermann (DKRZ, Germany) Bryan Lawrence (NCAS, Reading, United Kingdom) Dirk Pleiter (JSC, Forschungszetnrum Jülich, Jülich, Germany) Paolo Papale (INGV, Pisa, Italy) Giovanni Pizzi (EPFL, Lausanne, Switzerland) Markus Reichstein (MPI Biogeochemistry, Jena, Germany) Sadaf Alam (CSCS, Lugano, Switzerland) Jeannot Trampert (Univ Utrecht, Netherlands)
The workshop was held at the Lecture Hall (room 2009) in building 16.15 (so-called GRS building) next to Jülich Supercomputing Centre at Forschungszentrum Jülich.