ESiWACE2 HPDA and VIS Course 2021
As the volumes of weather and climate data expand, it is of paramount importance for scientists to exploit techniques and solutions able to efficiently extract knowledge from these data.
This online training course aims to increase scientists’ expertise on data analysis and visualization applied to climate and weather domains, using high-performance data analytics (HPDA) and visualization tools available from the open source market (i.e., Ophidia and ParaView).
The training covers topics from simple analytics tasks to workflows and applications (e.g., Python-based) and provides best practices and guidelines on dealing with massive scientific datasets on HPC architectures.
Examples of real applications of the tools for data analytics and visualization (i.e., Ophidia and ParaView) in the climate and weather domain will be presented. The training will include demos and hands-on sessions concerning the different tools.
This course is organized in the context of the “Centre of Excellence in Simulation of Weather and Climate in Europe” (ESiWACE) phase 2 project.
Topics:
-
Introduction to big data, scientific data management and analytics at scale
-
The open-source High Performance Data Analytics (HPDA) tool Ophidia
-
Data Analytics workflows for eScience
-
Data Processing using CDO
-
Introduction to data visualization using ParaView
-
Discussion of visualization workflows, from post to in-situ
Audience: The training targets the audience in the field of weather and climate research with different backgrounds, from computer to Earth system scientists. This course is open to students, young scientists and also more experienced researchers/engineers who wish to improve their data analytics and visualisation skills. Basic knowledge of Python, Linux, NetCDF data format and general aspects concerning climate/weather data is required to fully take advantage of the training.
Preliminary Schedule: The training is organized as an 8-hour online course, divided into 4 sessions, with 2 hours of work per day required for the participants. The event is scheduled for September 13-16, 2021 according to the following calendar:
-
Session 1: Introduction to ParaView, 13th September 2021, 14.30-16.30
-
Session 2: Advanced ParaView use, 14th September 2021, 14.30-16.30
-
Session 3: Introduction to Ophidia, 15th September 2021, 14.30-16.30
-
Session 4: Ophidia advanced concepts, 16th September 2021, 14.30-16.30
Each session combines presentations about the various topics and practical tutorials/hands-on.
Participation: Registration is required for attending the online live training sessions. The talks will be recorded and made available after the training together with the training materials (e.g., slides, instructions, notebooks, scripts, etc.). Practical sessions will not be recorded. Instructions and materials for the practical sessions will be made available beforehand to registered users. Note that the registration closes on the 8th of September AoE.
We encourage registration and participation of attendees with diverse backgrounds and of all genders in order to foster diversity and inclusion.