Allison Baker (Apr 25 2022 at 15:49): Allison Baker (Apr 25 2022 at 15:49):I thought I'd share details about a talk on Thursday that may interest some of you:
###############################################################
National Science Data Fabric (NSDF) Webinar: Distinguished Speaker Ryan Abernathey (Columbia University)
###############################################################
Title: Pangeo Forge - Crowdsourcing Analysis Ready Data in the Cloud
Speaker: Ryan Abernathey, Columbia University, Department of Earth and Environmental Science
Date: April 28 2022 at 12:30 pm ET
Join Zoom Meeting: https://utah.zoom.us/j/99659937052
More about the webinar and NSDF: http://nationalsciencedatafabric.org/
Abstract: Analysis-ready, cloud optimized (ARCO) scientific data is essential for scalable big data analytics in the cloud. ARCO can massively accelerate statistical analysis, visualization, and machine learning workflows on large-scale scientific datasets. However, most scientific data is distributed in archival formats that are not optimized for large-scale analysis.
Pangeo Forge (https://pangeo-forge.org/) is an open source framework for data Extraction, Transformation, and Loading (ETL) of scientific data. The goal of Pangeo Forge is to make it easy to extract data from traditional data archives and deposit it in cloud object storage in ARCO format.
Pangeo Forge is made of two main components:
(i) Pangeo Forge Recipes: an open source Python package, which allows you to create and run ETL pipelines (“recipes”) and run them on your own computer.
(ii) Pangeo Forge Cloud: a cloud-based automation framework which executes these recipes in the cloud from code stored in GitHub and deposits the data into cloud object storage.
By storing data recipes in version-controlled GitHub repositories, we can maintain perfect provenance information from archival repository to ARCO copy. Using Pangeo Forge, we are collaboratively populating a petabyte-scale library of open ARCO climate data distributed across multiple cloud storage services, including Open Storage Network. Pangeo Forge is inspired directly by Conda Forge, a community-led collection of recipes for building conda packages. We hope that Pangeo Forge can eventually play the same role for datasets, encouraging open, interdisciplinary collaboration around data curation.
Negin Sobhani (Sep 05 2023 at 14:13):Hello Everyone,
Just a quick reminder that we have our monthly NCAR HPC User Group (NHUG) meeting scheduled for today from 9 to 10 a.m. MDT.
Topics for today's meeting are:
Please join our meeting using the link below:
Join Zoom Meeting
https://ucar-edu.zoom.us/j/99647019476
Meeting ID: 996 4701 9476
Passcode: NHUG22-23
Negin Sobhani (Nov 03 2023 at 01:06):Hey Everyone,
Just a quick reminder that our monthly NCAR High-Performance Computing User Group (NHUG) meeting is scheduled for Tuesday November 7th, 2023 from 9 to 10 a.m. MDT.
In this meeting, we will share outage updates and upcoming opportunities. Additionally, we will have short presentations on the following topics:
Please join our meeting using the link below:
Join Zoom Meeting
https://ucar-edu.zoom.us/j/99647019476
Meeting ID: 996 4701 9476
Passcode: NHUG22-23
If you wish to stay informed and receive calendar invites and monthly updates from NHUG, please join NHUG email list. :email:
Negin Sobhani (Dec 05 2023 at 05:02):Hello Everyone,
Just a quick reminder that our monthly NHUG meeting is scheduled for tomorrow Dec 5th, 2023 at 9 am. We will hear some updates regarding GLADE file system transitions and future NHUG directions. In this meeting, we will also hear from Dr. John Schreck, who will share their experience running distributed machine learning on Derecho GPUs.
If you wish to stay informed and receive calendar invites and monthly updates from NHUG, please join NHUG email list.
Negin Sobhani (Jan 16 2024 at 16:56):Hello Everyone,
This is a friendly reminder that our first NHUG meeting 2024 is scheduled for today, Tuesday, January 16th, 2024, from 1 to 2 p.m. MT. We hope to see you there!
Agenda Highlights:
Please use the following Zoom meeting details to join us:
Join Zoom Meeting
https://ucar-edu.zoom.us/j/99404339583
Meeting ID: 994 0433 9583
Passcode: NHUG2024
If you have any topics you'd like us to cover in future NHUG meetings or if you're interested in presenting, please feel free to submit your ideas using this form.
Hope to see you there!
Negin
Negin Sobhani (Feb 20 2024 at 18:14):Hello Everyone,
Please join us this afternoon for our monthly NHUG meeting at 1 pm MST.
Agenda Highlights:
Please use the following Zoom meeting details to join us:
Join Zoom Meeting
https://ucar-edu.zoom.us/j/99404339583
Meeting ID: 994 0433 9583
Passcode: NHUG2024
Please share with any colleagues you think might be interested.
We hope to see you there!
Negin
Negin Sobhani (Mar 19 2024 at 15:21):Hello Everyone,
Please join us this afternoon for our monthly NHUG meeting at 1 pm MDT.
Agenda Highlights:
Please use the following Zoom meeting details to join us:
Join Zoom Meeting
https://ucar-edu.zoom.us/j/99404339583
Meeting ID: 994 0433 9583
Passcode: NHUG2024
To add this meeting to your calendar, please use this link or the NHUG calendar.
To learn more about NHUG, please see the NHUG page.
Please share with any colleagues you think might be interested.
We hope to see you there!
Negin
Negin Sobhani (Apr 16 2024 at 14:01):Hello Everyone,
Please join us this afternoon for our monthly NHUG meeting at 1 pm MT.
Agenda:
Please use the following Zoom meeting details to join us:
https://ucar-edu.zoom.us/j/99404339583
Meeting ID: 994 0433 9583
Passcode: NHUG2024
To add this meeting to your calendar, please use the following link.
Learn more about NHUG and access an archive of past meetings on our new NHUG page: https://nhug.readthedocs.io/en/latest/
To join the NHUG Slack community, please use this link: https://ncar.pub/join_nhug_slack
Hope to see you there!
Negin
Negin Sobhani (Jun 18 2024 at 15:58):Hello Everyone,
Please join us this afternoon for our monthly NHUG meeting at 1 pm MDT.
Agenda Highlights:
Please use the following Zoom meeting details to join us:
https://ucar-edu.zoom.us/j/99404339583
Meeting ID: 994 0433 9583
Passcode: NHUG2024
Learn more about NHUG and access an archive of past meetings on the NHUG page: https://nhug.readthedocs.io/en/latest/
We hope to see you there!
Negin
Negin Sobhani (Sep 17 2024 at 14:10):Hello Everyone,
Please join us this afternoon for our monthly NHUG meeting at 1 pm MDT.
Agenda Highlights:
Please join us using the Zoom meeting details below:
https://ucar-edu.zoom.us/j/99404339583
Meeting ID: 994 0433 9583
Passcode: NHUG2024
Please share this invitation with any colleagues who may be interested.
We look forward to seeing you there!
Negin
Negin Sobhani (Jan 21 2025 at 17:22):Hello Everyone:wave:
This is a friendly reminder that our first NHUG meeting of this year is scheduled for today, Tuesday, January 21st, 2025, from 1 to 2 p.m. MT. We hope to see you there!
Agenda Highlights:
Please join us using the Zoom meeting details below:
https://ucar-edu.zoom.us/j/99404339583
Meeting ID: 994 0433 9583
Passcode: NHUG2024
Hope to see you there!
Negin
Negin Sobhani (Feb 19 2025 at 16:00):Goor morning everyone,
A quick reminder that this month’s NCAR HPC User Group (NHUG) meeting will be held today, Wednesday, February 19, 2025, at 11 am MT.
Agenda Highlights:
:small_blue_diamond: Upcoming opportunities & announcements
:small_blue_diamond: Upcoming software changes on Derecho & Casper – Brian Vanderwende
:small_blue_diamond: Scaling GPU-accelerated AI Models for Advanced Numerical Weather Prediction – John Schreck
Feel free to share this with any colleagues who may be interested (zoom details posted above). Looking forward to seeing you there!
Last updated: May 16 2025 at 17:14 UTC