Focus on:
All days
7 May 2024
8 May 2024
All sessions
Finalisation
Social Event
Hide Contributions
Indico style
Indico style - inline minutes
Indico style - numbered
Indico style - numbered + minutes
Indico Weeks View
Choose Timezone
Use the event/category timezone
Specify a timezone
Africa/Abidjan
Africa/Accra
Africa/Addis_Ababa
Africa/Algiers
Africa/Asmara
Africa/Bamako
Africa/Bangui
Africa/Banjul
Africa/Bissau
Africa/Blantyre
Africa/Brazzaville
Africa/Bujumbura
Africa/Cairo
Africa/Casablanca
Africa/Ceuta
Africa/Conakry
Africa/Dakar
Africa/Dar_es_Salaam
Africa/Djibouti
Africa/Douala
Africa/El_Aaiun
Africa/Freetown
Africa/Gaborone
Africa/Harare
Africa/Johannesburg
Africa/Juba
Africa/Kampala
Africa/Khartoum
Africa/Kigali
Africa/Kinshasa
Africa/Lagos
Africa/Libreville
Africa/Lome
Africa/Luanda
Africa/Lubumbashi
Africa/Lusaka
Africa/Malabo
Africa/Maputo
Africa/Maseru
Africa/Mbabane
Africa/Mogadishu
Africa/Monrovia
Africa/Nairobi
Africa/Ndjamena
Africa/Niamey
Africa/Nouakchott
Africa/Ouagadougou
Africa/Porto-Novo
Africa/Sao_Tome
Africa/Tripoli
Africa/Tunis
Africa/Windhoek
America/Adak
America/Anchorage
America/Anguilla
America/Antigua
America/Araguaina
America/Argentina/Buenos_Aires
America/Argentina/Catamarca
America/Argentina/Cordoba
America/Argentina/Jujuy
America/Argentina/La_Rioja
America/Argentina/Mendoza
America/Argentina/Rio_Gallegos
America/Argentina/Salta
America/Argentina/San_Juan
America/Argentina/San_Luis
America/Argentina/Tucuman
America/Argentina/Ushuaia
America/Aruba
America/Asuncion
America/Atikokan
America/Bahia
America/Bahia_Banderas
America/Barbados
America/Belem
America/Belize
America/Blanc-Sablon
America/Boa_Vista
America/Bogota
America/Boise
America/Cambridge_Bay
America/Campo_Grande
America/Cancun
America/Caracas
America/Cayenne
America/Cayman
America/Chicago
America/Chihuahua
America/Ciudad_Juarez
America/Costa_Rica
America/Creston
America/Cuiaba
America/Curacao
America/Danmarkshavn
America/Dawson
America/Dawson_Creek
America/Denver
America/Detroit
America/Dominica
America/Edmonton
America/Eirunepe
America/El_Salvador
America/Fort_Nelson
America/Fortaleza
America/Glace_Bay
America/Goose_Bay
America/Grand_Turk
America/Grenada
America/Guadeloupe
America/Guatemala
America/Guayaquil
America/Guyana
America/Halifax
America/Havana
America/Hermosillo
America/Indiana/Indianapolis
America/Indiana/Knox
America/Indiana/Marengo
America/Indiana/Petersburg
America/Indiana/Tell_City
America/Indiana/Vevay
America/Indiana/Vincennes
America/Indiana/Winamac
America/Inuvik
America/Iqaluit
America/Jamaica
America/Juneau
America/Kentucky/Louisville
America/Kentucky/Monticello
America/Kralendijk
America/La_Paz
America/Lima
America/Los_Angeles
America/Lower_Princes
America/Maceio
America/Managua
America/Manaus
America/Marigot
America/Martinique
America/Matamoros
America/Mazatlan
America/Menominee
America/Merida
America/Metlakatla
America/Mexico_City
America/Miquelon
America/Moncton
America/Monterrey
America/Montevideo
America/Montserrat
America/Nassau
America/New_York
America/Nome
America/Noronha
America/North_Dakota/Beulah
America/North_Dakota/Center
America/North_Dakota/New_Salem
America/Nuuk
America/Ojinaga
America/Panama
America/Paramaribo
America/Phoenix
America/Port-au-Prince
America/Port_of_Spain
America/Porto_Velho
America/Puerto_Rico
America/Punta_Arenas
America/Rankin_Inlet
America/Recife
America/Regina
America/Resolute
America/Rio_Branco
America/Santarem
America/Santiago
America/Santo_Domingo
America/Sao_Paulo
America/Scoresbysund
America/Sitka
America/St_Barthelemy
America/St_Johns
America/St_Kitts
America/St_Lucia
America/St_Thomas
America/St_Vincent
America/Swift_Current
America/Tegucigalpa
America/Thule
America/Tijuana
America/Toronto
America/Tortola
America/Vancouver
America/Whitehorse
America/Winnipeg
America/Yakutat
Antarctica/Casey
Antarctica/Davis
Antarctica/DumontDUrville
Antarctica/Macquarie
Antarctica/Mawson
Antarctica/McMurdo
Antarctica/Palmer
Antarctica/Rothera
Antarctica/Syowa
Antarctica/Troll
Antarctica/Vostok
Arctic/Longyearbyen
Asia/Aden
Asia/Almaty
Asia/Amman
Asia/Anadyr
Asia/Aqtau
Asia/Aqtobe
Asia/Ashgabat
Asia/Atyrau
Asia/Baghdad
Asia/Bahrain
Asia/Baku
Asia/Bangkok
Asia/Barnaul
Asia/Beirut
Asia/Bishkek
Asia/Brunei
Asia/Chita
Asia/Choibalsan
Asia/Colombo
Asia/Damascus
Asia/Dhaka
Asia/Dili
Asia/Dubai
Asia/Dushanbe
Asia/Famagusta
Asia/Gaza
Asia/Hebron
Asia/Ho_Chi_Minh
Asia/Hong_Kong
Asia/Hovd
Asia/Irkutsk
Asia/Jakarta
Asia/Jayapura
Asia/Jerusalem
Asia/Kabul
Asia/Kamchatka
Asia/Karachi
Asia/Kathmandu
Asia/Khandyga
Asia/Kolkata
Asia/Krasnoyarsk
Asia/Kuala_Lumpur
Asia/Kuching
Asia/Kuwait
Asia/Macau
Asia/Magadan
Asia/Makassar
Asia/Manila
Asia/Muscat
Asia/Nicosia
Asia/Novokuznetsk
Asia/Novosibirsk
Asia/Omsk
Asia/Oral
Asia/Phnom_Penh
Asia/Pontianak
Asia/Pyongyang
Asia/Qatar
Asia/Qostanay
Asia/Qyzylorda
Asia/Riyadh
Asia/Sakhalin
Asia/Samarkand
Asia/Seoul
Asia/Shanghai
Asia/Singapore
Asia/Srednekolymsk
Asia/Taipei
Asia/Tashkent
Asia/Tbilisi
Asia/Tehran
Asia/Thimphu
Asia/Tokyo
Asia/Tomsk
Asia/Ulaanbaatar
Asia/Urumqi
Asia/Ust-Nera
Asia/Vientiane
Asia/Vladivostok
Asia/Yakutsk
Asia/Yangon
Asia/Yekaterinburg
Asia/Yerevan
Atlantic/Azores
Atlantic/Bermuda
Atlantic/Canary
Atlantic/Cape_Verde
Atlantic/Faroe
Atlantic/Madeira
Atlantic/Reykjavik
Atlantic/South_Georgia
Atlantic/St_Helena
Atlantic/Stanley
Australia/Adelaide
Australia/Brisbane
Australia/Broken_Hill
Australia/Darwin
Australia/Eucla
Australia/Hobart
Australia/Lindeman
Australia/Lord_Howe
Australia/Melbourne
Australia/Perth
Australia/Sydney
Canada/Atlantic
Canada/Central
Canada/Eastern
Canada/Mountain
Canada/Newfoundland
Canada/Pacific
Europe/Amsterdam
Europe/Andorra
Europe/Astrakhan
Europe/Athens
Europe/Belgrade
Europe/Berlin
Europe/Bratislava
Europe/Brussels
Europe/Bucharest
Europe/Budapest
Europe/Busingen
Europe/Chisinau
Europe/Copenhagen
Europe/Dublin
Europe/Gibraltar
Europe/Guernsey
Europe/Helsinki
Europe/Isle_of_Man
Europe/Istanbul
Europe/Jersey
Europe/Kaliningrad
Europe/Kirov
Europe/Kyiv
Europe/Lisbon
Europe/Ljubljana
Europe/London
Europe/Luxembourg
Europe/Madrid
Europe/Malta
Europe/Mariehamn
Europe/Minsk
Europe/Monaco
Europe/Moscow
Europe/Oslo
Europe/Paris
Europe/Podgorica
Europe/Prague
Europe/Riga
Europe/Rome
Europe/Samara
Europe/San_Marino
Europe/Sarajevo
Europe/Saratov
Europe/Simferopol
Europe/Skopje
Europe/Sofia
Europe/Stockholm
Europe/Tallinn
Europe/Tirane
Europe/Ulyanovsk
Europe/Vaduz
Europe/Vatican
Europe/Vienna
Europe/Vilnius
Europe/Volgograd
Europe/Warsaw
Europe/Zagreb
Europe/Zurich
GMT
Indian/Antananarivo
Indian/Chagos
Indian/Christmas
Indian/Cocos
Indian/Comoro
Indian/Kerguelen
Indian/Mahe
Indian/Maldives
Indian/Mauritius
Indian/Mayotte
Indian/Reunion
Pacific/Apia
Pacific/Auckland
Pacific/Bougainville
Pacific/Chatham
Pacific/Chuuk
Pacific/Easter
Pacific/Efate
Pacific/Fakaofo
Pacific/Fiji
Pacific/Funafuti
Pacific/Galapagos
Pacific/Gambier
Pacific/Guadalcanal
Pacific/Guam
Pacific/Honolulu
Pacific/Kanton
Pacific/Kiritimati
Pacific/Kosrae
Pacific/Kwajalein
Pacific/Majuro
Pacific/Marquesas
Pacific/Midway
Pacific/Nauru
Pacific/Niue
Pacific/Norfolk
Pacific/Noumea
Pacific/Pago_Pago
Pacific/Palau
Pacific/Pitcairn
Pacific/Pohnpei
Pacific/Port_Moresby
Pacific/Rarotonga
Pacific/Saipan
Pacific/Tahiti
Pacific/Tarawa
Pacific/Tongatapu
Pacific/Wake
Pacific/Wallis
US/Alaska
US/Arizona
US/Central
US/Eastern
US/Hawaii
US/Mountain
US/Pacific
UTC
Save
Europe/Berlin
English (United Kingdom)
Deutsch (Deutschland)
English (United Kingdom)
English (United States)
Español (España)
Français (France)
Polski (Polska)
Português (Brasil)
Türkçe (Türkiye)
Монгол (Монгол)
Українська (Україна)
中文 (中国)
Login
Parallel IO NHR Workshop
from
Tuesday, 7 May 2024 (11:00)
to
Wednesday, 8 May 2024 (17:00)
Monday, 6 May 2024
¶
Tuesday, 7 May 2024
¶
11:00
Reception coffee
Reception coffee
11:00 - 12:00
Room: R034
12:00
I/O in Climate Modeling
-
Panos Adamidis
I/O in Climate Modeling
Panos Adamidis
12:00 - 12:40
Room: R034
Opening talk
12:40
Lustre at DKRZ: Stripping Strategies & Best Practices
-
Carsten Beyer
(
DKRZ
)
Lustre at DKRZ: Stripping Strategies & Best Practices
Carsten Beyer
(
DKRZ
)
12:40 - 13:20
Room: R034
TBD
13:20
Field notes from explorations on a big file system
-
Florian Ziemen
(
DKRZ
)
Field notes from explorations on a big file system
Florian Ziemen
(
DKRZ
)
13:20 - 14:00
Room: R034
In this talk I will present observations on various aspects of the use of DKRZ's 120 TB lustre file system, regarding throughput and usage patterns. They range from back-of-the-envelope calculations via aggregate statistics to the usage of an individual dataset, and may provide valuable insights into the users' needs and things to consider in the development of I/O solutions and the procurement of future storage systems.
14:00
Coffee Break
Coffee Break
14:00 - 14:15
Room: R034
14:15
IO Benchmarking in HPC Systems
-
Jannek Squar
Anna Fuchs
(
Universität Hamburg
)
IO Benchmarking in HPC Systems
Jannek Squar
Anna Fuchs
(
Universität Hamburg
)
14:15 - 14:55
Room: R034
Benchmarking for system tenders is a complex task. The I/O component is often neglected or filled with synthetic or artificial numbers. We explain what matters and demonstrate, through some measurements, how complex it is to define benchmarks that should measure asynchronous operations on shared resources.
14:55
I/O performance in CLAIX23 infrastructure
-
Radita Liem
(
RWTH Aachen
)
I/O performance in CLAIX23 infrastructure
Radita Liem
(
RWTH Aachen
)
14:55 - 15:35
Room: R034
In this topic, I would like to compare the I/O performance changes from the system that we benchmark using IO500. Additionally, we want to see the performance of ICON in the grand scheme of things within CLAIX since currently we are working with DKRZ in the Green HPC project
15:35
Coffee Break And Discussion
Coffee Break And Discussion
15:35 - 16:10
Room: R034
16:10
Parallel HDF5 25 years after
-
Elena Pourmal
Parallel HDF5 25 years after
Elena Pourmal
16:10 - 16:50
Room: R034
25 years have passed since the first release of parallel HDF5. The software is still under active development to address constantly evolving HPC requirements. In our talk we will give an overview of the current state of parallel HDF5 library and its new compression and sub-filing capabilities. We will also talk about HDF5 tuning knobs for the HPC applications that were developed over the years.
16:50
hiopy - Optimizing Model Output for Analysis
-
Tobias Kölling
hiopy - Optimizing Model Output for Analysis
Tobias Kölling
16:50 - 17:30
Room: R034
As climate models reach the kilometer scale, horizontal model grids outgrow the size of computer screens as well as the capacity of the human eye. In consequence, a model output analyst can't observe the full output at once, but will always use subsets or coarser versions of the data. The time to an analysis result can be reduced dramatically, if output datasets are optimized for the changed read workload. Hiopy is a new way of writing ICON model output, which utilizes YAC and the Zarr format to create such optimized datasets directly from the running model for immediate consumption.
17:30
Panel Discussion
Panel Discussion
17:30 - 18:00
Room: R034
19:00
https://www.rudolphs-hamburg.de/
https://www.rudolphs-hamburg.de/
19:00 - 22:00
Room: R034
Contributions
19:00
Dinner
Wednesday, 8 May 2024
¶
09:00
Receiption Coffee
Receiption Coffee
09:00 - 09:30
Room: R034
09:30
Enabling purposeful use of large-volume Earth System Modelling datasets: ideas and concepts explored at DKRZ
-
Karsten Peters-von Gehleт
Enabling purposeful use of large-volume Earth System Modelling datasets: ideas and concepts explored at DKRZ
Karsten Peters-von Gehleт
09:30 - 10:10
Room: R034
Current state-of-the-art and upcoming Earth System Model (ESM) simulations produce output on the order of single- to double digit petabytes per individual climatic timescale-spanning simulation. Creating an infrastructure environment enabling the purposeful analysis of such data amounts requires revamping data handling paradigms for ESM datasets. We present concepts, ideas and prototypes developed along the requirements of the ESM-community to enable efficient ESM output access and analysis across the storage hardware hierarchy at DKRZ
10:10
Databases for HPC and Parallel IO
-
Jay Lofstead
Databases for HPC and Parallel IO
Jay Lofstead
10:10 - 10:50
Room: R034
Early explorations into using an RDBMS as a data store for parallel IO workloads led to a conclusion that the technology was ill fitted for the task. The community has accepted this “wisdom” and been reluctant to support any new efforts into investigating databases. I think it is time to revisit.
10:50
Discussion
Discussion
10:50 - 11:30
Room: R034
11:30
Lunch
Lunch
11:30 - 12:30
Room: R034
12:30
Leveraging Flexible Storage System Components for HPC Research
-
Michael Kuhn
(
OVGU
)
Leveraging Flexible Storage System Components for HPC Research
Michael Kuhn
(
OVGU
)
12:30 - 13:10
Room: R034
Abstract: Research has become increasingly data-driven, putting additional pressure on the underlying storage systems. Gaining insights into the their behavior is critical understanding and optimizing I/O performance. However, existing storage systems often lack the necessary functionality and are difficult to modify and extend. Therefore, the Parallel Computing and I/O research group is developing several storage system components within the JULEA and Haura projects, making it possible to cover the entire storage stack from application I/O interfaces to block device access. This allows rapidly prototyping new approaches and optimizations.
13:10
Using the DAOS Storage APIs with Weather and Climate Applications
-
Michael Hennecke
Using the DAOS Storage APIs with Weather and Climate Applications
Michael Hennecke
13:10 - 13:50
Room: R034
The Distributed Asynchronous Object Storage (DAOS) is an open source scale-out storage system that is designed from the ground up to support Storage Class Memory (SCM) and NVMe storage in user space (https://docs.daos.io/). This presentation provides an overview of the DAOS architecture, and describes the various APIs that are available to the user to benefit from the performance advantages that DAOS offers in comparison to traditional parallel filesystems like GPFS or Lustre. We will also solicit feedback from the community to guide future development efforts.
13:50
Discussion
Discussion
13:50 - 14:30
Room: R034
14:30
Coffee Break
Coffee Break
14:30 - 14:50
Room: R034
14:50
Working Groups and Discussion
Working Groups and Discussion
14:50 - 16:00
Room: R034
16:00
Summary
Summary
16:00 - 16:30
Room: R034