Introduction to Deep Learning for Climate Scientists

Europe/Berlin
Room 034 (DKRZ Main Building)

Room 034

DKRZ Main Building

DKRZ Main Building, Bundesstraße 45a, 20146 Hamburg
Alexander Fischer (DKRZ), Caroline Arnold (HEREON), Etienne Plésiat (DKRZ), Johannes Meuer (DKRZ), Maximilian Witte, Paul Keil (HEREON)
Description

Target group: beginner in Deep Learning with some Python experience

Deadline for registration: July 24 18:00 CET

Machine learning, and more particularly deep learning, is gaining popularity among climate scientists. While many tutorials and courses are available, researchers often face challenges in applying the concepts to climate data and adapting them to address the specific needs of their research.

Therefore, we are offering an Introduction to Deep Learning for Climate Scientists at DKRZ. The course will be held in person, and the number of participants is limited to 25. 

The course will be held from September 22 10:30 to September 24 12:30 at DKRZ seminar room 034. Coffee breaks will be provided during the workshop.

Participants are required to have a working knowledge of Python. Some experience with Machine Learning or Deep Learning is welcome but not necessary.

 

Organised by

Caroline Arnold, Johannes Meuer, Étienne Plesiat

    • 10:30 17:30
      Day 1
      • 10:30
        Introduction to Machine Learning | Lecture 🎓 2h

        • A comprehensive overview of concepts & principles behind Machine Learning
        • Exploration of real-world applications of Machine Learning
        • Differentiating different ML types
        • Introducing popular Machine Learning tools and frameworks

        Speaker: Alexander Fischer (DKRZ)
      • 12:30
        Lunch Break 1h 30m
      • 14:00
        Architectures and Applications | Lecture 🎓 1h 45m

        • An overview of state of the art Deep Learning Methods
        • Examples from weather, climate and beyond
        • Explainable AI

        Speaker: Paul Keil (HEREON)
      • 15:45
        Coffee break 15m
      • 16:00
        Introduction to PyTorch: Core Concepts | Hands-on 💻 1h 30m

        • Preparation of the DKRZ accounts for the Pytorch tutorials
        • Brief theoretical introduction to PyTorch
        • Hands-on illustrating the core concepts

        Speaker: Etienne Plésiat (DKRZ)
    • 09:00 17:30
      Day 2
      • 09:00
        Introduction to PyTorch: Application to climate data | Hands-on 💻 1h 45m

        • Definition of the task
        • Creation of the training, validation and test datasets
        • Building the model
        • Training the model
        • Testing the model

        Speaker: Etienne Plésiat (DKRZ)
      • 10:45
        Coffee Break 15m
      • 11:00
        Introduction to PyTorch: Application to climate data | Hands-on 💻 1h

        • Improving the model

        Speaker: Etienne Plésiat (DKRZ)
      • 12:00
        Lunch break 1h 30m
      • 13:30
        Introduction to Pytorch Lightning | Hands-on 💻 1h
        • Learn the basics of the deep learning framework Pytorch Lightning
        • Write deep learning code that is flexible and performant
        Speaker: Caroline Arnold (HEREON)
      • 14:30
        Advanced Deep Learning use-case: Reconstructing missing climate data | Hands-on 💻 45m

        • Design and implement inpainting CNN for reconstructing climate data

        Speaker: Johannes Meuer (DKRZ)
      • 15:15
        Coffee break 15m
      • 15:30
        Advanced Deep Learning use-case: Reconstructing missing climate data | Hands-on 💻 1h

        • Train the model with different configurations
        • Validate the model on test data

        Speaker: Johannes Meuer (DKRZ)
      • 16:30
        Advanced Deep Learning Use Case: AI Weather Prediction | Lecture 🎓 1h

        • Learn about AI weather models that can take it up with numerical weather prediction

        Speakers: Caroline Arnold (Hereon), Paul Keil (DKRZ / HEREON)
    • 09:00 12:30
      Day 3
      • 09:00
        Beyond CNNs: Transformers & Attention | Lecture 🎓 45m Room 034

        Room 034

        DKRZ Main Building

        DKRZ Main Building, Bundesstraße 45a, 20146 Hamburg
        • Limitations of CNNs
        • Introduction of transformer architecture
        • Alternative approaches for predicting continuous data with ML
        Speaker: Alexander Fischer (DKRZ)
      • 09:45
        Probabilistic Deep Learning | Lecture 🎓 45m Room 034

        Room 034

        DKRZ Main Building

        DKRZ Main Building, Bundesstraße 45a, 20146 Hamburg
        • Overview of Probabilistic Deep Learning
        • Introduction to Diffusion Models
        • Examples from Weather and Climate Research
        Speaker: Paul Keil (HEREON)
      • 10:30
        Coffee break 15m Room 034 (DKRZ Main Building)

        Room 034

        DKRZ Main Building

        DKRZ Main Building, Bundesstraße 45a, 20146 Hamburg
      • 10:45
        Attention & Transformer | Hands-on 💻 1h 15m Room 034 / 023 / 120

        Room 034 / 023 / 120

        DKRZ Main Building

        DKRZ Main Building, Bundesstraße 45a, 20146 Hamburg

        • Hands-on downscaling of multiple variables using a transformer architecture on the HEALPix sphere.

        Speakers: Alexander Fischer (DKRZ – DA Group), Johannes Meuer (DKRZ), Maximilian Witte
      • 10:45
        Probabilistic Deep Learning | Hands-on 💻 1h 15m Room 034 / 023 / 120

        Room 034 / 023 / 120

        DKRZ Main Building

        DKRZ Main Building, Bundesstraße 45a, 20146 Hamburg
        • Extension of Reconstructing missing climate data exercise
        • Implementation of a simple Flow Matching Model
        • Evaluation of ensemble predictions and model uncertainty
        Speaker: Paul Keil (HEREON)
      • 10:45
        Q&A | Recap💬 1h 15m Room 034 / 023 / 120

        Room 034 / 023 / 120

        DKRZ Main Building

        DKRZ Main Building, Bundesstraße 45a, 20146 Hamburg
        • Recap session for deep learning basics covered in the course
        • Open Q&A
        Speaker: Caroline Arnold (Hereon)
      • 12:00
        Closing remarks | Discussion 💬 30m Room 034

        Room 034

        DKRZ Main Building

        DKRZ Main Building, Bundesstraße 45a, 20146 Hamburg
        Speaker: Paul Keil (HEREON)