November 5-7, 2025

2nd Workshop on Correctness and Reproducibility

for Earth System Software

in conjunction with

Tutorial: Rigor and Reasoning in Research Software

NCAR Logo BSSw Fellowship Logo

Workshop

We are excited to announce the second edition of the Workshop on Correctness and Reproducibility for Earth System Software, to be held on November 5-7, 2025 at the Mesa Laboratory of the NSF National Center for Atmospheric Research (NCAR) in Boulder, Colorado. We aim to provide a dedicated forum for earth system modelers, software engineers, and the broader scientific software community to discuss challenges, opportunities, and recent advances in ensuring software correctness and reproducibility. This workshop is a follow-up to the inaugural workshop held in November 2023, which brought together participants from academia, research labs, and industry to share their experiences and insights on software correctness and reproducibility.

Sponsored by the 2025 Better Scientific Software (BSSw) Fellowship program, this year’s workshop will feature a Tutorial on Rigor and Reasoning in Research Software, which will include sessions on practical techniques for improving software quality and reliability in scientific computing. The tutorial will cover core topics such as unit testing, continuous integration (CI), property-based testing, correctness in AI, and reasoning in research software. The workshop will also include invited talks, panel discussions, and contributed presentations on a wide range of topics related to software correctness and reproducibility.

Call for Abstracts: We invite contributions from researchers, software engineers, and practitioners in the Earth System Modeling (ESM) community, as well as the broader scientific computing community. Topics include:

  • Testing, debugging, QA, and CI tools
  • Statistical and ensemble-based validation
  • Software design for correctness and reproducibility
  • Automated reasoning, formal methods, and verification techniques
  • Validation of HPC, cloud, heterogeneous, and GPU-based applications
  • Other verification and validation approaches

Relevant applications include simulation codes, external libraries, AI techniques, diagnostics, packaging, and development practices.

Tutorial

To be held in conjunction with the workshop, the Tutorial on Rigor and Reasoning in Research Software will focus on practical and novel techniques for improving software quality and reliability in scientific computing. The tutorial will cover core topics such as unit testing, continuous integration (CI), property-based testing, correctness in AI, and reasoning in research software, with practical examples drawn from earth system modeling, data analysis, and similar applications. Participants will learn how to validate code, check software properties, and reason about high-level design in Python, with concepts broadly applicable to other scientific computing languages like Fortran and C++.

We will offer travel support to students and early-career researchers through an application process. More details will be provided soon.

This tutorial is led by Alper Altuntas with support from the 2025 Better Scientific Software (BSSw) Fellowship program.

Submissions

  • Submissions are closed.

Registration

  • Registration will open in August 2025.

Dates

  • Abstract submissions due: July 25, 2025.
  • Notification of acceptance: August 22, 2025.
  • Registration deadlines: TBD
  • Workshop and Tutorial dates: November 5-7, 2025.

Organizers

Co-chairs
Committee
  • John Baugh, Civil Engineering and Operations Research, North Carolina State University
  • Ilene Carpenter, Earth Sciences Segment Manager, Hewlett Packard Enterprise
  • Brian Dobbins, CGD, NSF National Center for Atmospheric Research
  • Michael Duda, Mesoscale & Microscale Meteorology Lab, NSF National Center for Atmospheric Research
  • Karsten Peters-von Gehlen, Department of Data Management, Deutsches Klimarechenzentrum GmbH (DKRZ)
  • Ganesh Gopalakrishnan, Kahlert School of Computing, University of Utah
  • Dorit Hammerling, Applied Mathematics and Statistics, Colorado School of Mines
  • Balwinder Singh, Atmospheric Sciences and Global Change, Pacific Northwest National Laboratory

Program

A tentative overview of the upcoming program is provided below (subject to change). Full program details will be announced in Summer 2025. You can find the program for the inaugural workshop held in 2023 here.

CW2025

Confirmed Invited Speakers:

  • Soonho Kong, Principal Applied Scientist, Amazon Web Services (AWS)
  • Antonios Mamalakis, Assistant Professor, University of Virginia (UVA)
  • David John Gagne, Machine Learning Scientist II, NSF National Center for Atmospheric Research (NCAR)

Venue

Both the workshop and tutorial will be held in person (with a virtual option) and at the Mesa Laboratory of the NSF National Center for Atmospheric Research. (Helpful things to know for your visit.)

  • Address: 1850 Table Mesa Dr, Boulder, CO 80305

  • Virtual Meeting details will be announced later.

    CW2025

    CW2025

Lodging

  • Details will be provided soon for lodging options.