Katie Dagon (Mar 21 2022 at 17:11): Katie Dagon (Mar 21 2022 at 17:11):Join the GeoCAT team today (Monday, March 21) at 2pm MDT for a team update. The team is excited to update the ESDS community on their on-going efforts. In the past 11 months since the last GeoCAT update, the GeoCAT team has continued their efforts in bringing NCL into the Python ecosystem, expanded the GeoCAT-examples plotting gallery to include interactive plotting notebooks, and began working on the recently funded Project Raijin, which aims to address the geoscience community need for tools that enable standard data analysis on unstructured grid data through the development of the Uxarray software package. During this presentation, the team will discuss improvements and future work to the existing GeoCAT software stack, new and upcoming developments to Uxarray, and announce the many different ways the ESDS community can get involved with our projects.
See more details on Sundog: https://sundog.ucar.edu/Interact/Pages/Content/Document.aspx?id=5520
Matt Long (Apr 04 2022 at 14:50):@all, our speaker had something come up and cannot make it today. We hope to reschedule, but we're canceling the ESDS Forum today. Note that you can add the ESDS calendar to your Google Calendar here
Katie Dagon (Apr 18 2022 at 14:04):Please consider joining the ESDS Forum today (Monday, April 18) at 2pm MT for a discussion led by @John Clyne on Establishing a Data Analysis Computing Resources User Group.
The Earth System Data Sciences (ESDS) community will hold an open discussion at their bi-weekly forum to help explore interest in establishing a user group focused on computing resources and support for data analysis. The aims of this user group include helping promote effective communication between CISL and the scientific community; sharing information about experiences with CISL computing and storage facilities; suggesting new research and technology directions to CISL; voicing concerns; and helping keep the scientific community informed about CISL plans. All are welcome to join the discussion and contribute ideas for the future of this data analysis focused user group.
See more details on Sundog: https://sundog.ucar.edu/Interact/Pages/Content/Document.aspx?id=5659
Deepak Cherian (Apr 28 2022 at 15:39):Join us on Monday May 2, 2022 for a talk on the Python API for VAPOR by "Stas" Jaroszynski.
Abstract: VAPOR is a desktop application that provides interactive visualization of geoscience data. Recently, a Python API has been added to VAPOR, allowing the visualization of 3D (and 2D) data from within the Python environment, including Jupyter Notebooks. In addition to many common earth science data formats, VAPOR’s Python API allows directly rendering Numpy arrays and Xarray DataArrays. This presentation will give an overview and demonstration of this exciting new capability.
Matt Long (May 10 2022 at 16:55):@all, consider joining us Monday, May 16 at 2pm MDT for the following discussion led by @Julia Kent .
Title: An Overview of Project Pythia
Julia will provide an overview of Project Pythia, which is a home for Python-centered learning resources that are open-source, community-owned, and geoscience-focused. These resources include:
Julia will help you navigate the site so that you are best equipped to use this resource to help improve your Python coding skills.
Join the Zoom Meeting here:
https://ucar-edu.zoom.us/j/97931903544
Passcode: HgNd92zi
Katie Dagon (Jun 23 2022 at 15:21):Please consider joining us on Monday, June 27 at 2pm MDT for the following discussions.
(1) Hauke Schulz (MPI) will present on xbitinfo (a data compression package) that illustrates how to call out to Julia libraries from Python analytics or post-processing code.
(2) Ken Cote and Nick Wehrheim (NCAR) will present and solicit feedback on CISL's ongoing JupyterHub development efforts.
Join Zoom Meeting
https://ucar-edu.zoom.us/j/97931903544
Meeting ID: 979 3190 3544
Passcode: HgNd92zi
Katie Dagon (Jul 05 2022 at 14:00):Please consider joining us on Monday July 11 at 2pm MDT for the following discussion.
CISL, in conjunction with ESDS, is establishing an Analysis Workflow Special Interest Group (AWSIG). The AWSIG will provide a communication forum for the exchange of ideas and experiences related to the operational aspects of CISL supported analysis resources and services (e.g. Casper, JupyterHub, GLADE, VirtualGL, etc.). This working group will complement the more modeling/simulation focused NCAR HPC User Group (NHUG).
We will kick off the first AWSIG meeting at the next ESDS Forum with a brief introduction to the SIG, and the following talk from CISL’s Consulting Group:
Supporting the Analysis Software Ecosystem
CISL began offering a Conda package manager module on our HPC systems last year. Simultaneously, we migrated our NCAR Python Library (NPL) environment to a Conda-based monthly release, with access both from JupyterHub and the command line. Moving forward, JupyterHub kernel curation and delivery will be an area of focus; we are planning to adopt a bi-yearly update cadence for most analysis software, with uniform access both in the Hub and command-line. In this presentation, we will describe these plans, solicit feedback and suggestions, and also explore mid- and long-term priorities for supporting analysis software libraries.
Join Zoom Meeting
https://ucar-edu.zoom.us/j/97931903544
Meeting ID: 979 3190 3544
Passcode: HgNd92zi
Heather Craker (Jul 08 2022 at 17:49):Hi all! Just another reminder before the weekend.
Please consider joining us for the first meeting of the new Analysis Workflow Special Interest Group (AWSIG) at 2 p.m. MDT this Monday, July 11 during the usual ESDS Forum! This group will provide a communication forum for the exchange of ideas and experiences related to the operational aspects of CISL-supported analysis resources and services, including Casper, JupyterHub, GLADE, VirtualGL, and others. The group will complement the more modeling- and simulation-focused NCAR HPC User Group.
Also during the upcoming ESDS forum, the CISL Consulting Group will be giving a talk on Supporting the Analysis Software Ecosystem to discuss and solicit feedback on plans for updating analysis software packages, providing uniform access via both JupyterHub and command line, and on mid- and long-term priorities for supporting analysis software libraries.
ESDS Forum, Monday, July 11th at 2pm MDT
Zoom link to attend: https://ucar-edu.zoom.us/j/97931903544
Meeting ID: 979 3190 3544
Passcode: HgNd92zi
Heather Craker (Jul 08 2022 at 17:52):Also, if you are interested in presenting a "Work In Progress" (WIP) talk at future ESDS Forums, be sure to sign up on this spreadsheet. A WIP talk is a great opportunity for discussing on going work, requesting feedback, practicing workflow demos, giving overviews of additions to packages, and more!
Matt Long (Jul 18 2022 at 21:21):All,
The ESDS Forum will be on pause for the remainder of the Summer. We'll resume with renewed force after Labor Day.
Katie Dagon (Sep 15 2022 at 19:41):Dear ESDS,
We're restarting the ESDS Forum for the Fall!
Please consider joining our first session on Monday, September 19 at 2p MDT for the following discussions led by CISL's Analysis Workflow Special Interest Group (AWSIG):
(1) Brian Vanderwende: Dask usage & pain points: request for information:
(2) Ben Kirk: Maximizing Casper Throughput: observations, tips, & trick
Join Zoom Meeting
https://ucar-edu.zoom.us/j/97931903544
Meeting ID: 979 3190 3544
Passcode: HgNd92zi
Stephen Yeager (Sep 22 2022 at 16:27):I'd like to request the following as a topic for a future ESDS forum (this isn't something I know how to do, but it's something I'm interested in learning how to do): converting a vetted dask-enabled notebook into a job script that uses dask-mpi.
Heather Craker (Sep 22 2022 at 16:31):I'll make sure that gets in the discussion notes for the next forum. Thanks for the suggestion!
Heather Craker (Sep 30 2022 at 17:37):Hi all,
This Monday at 2pm will be the first hybrid ESDS forum! As a reminder, it will be held in the Chapman Room at the Mesa Lab and online. There has been a change to the virtual component. It will be on Google Meet, not Zoom, and the link is below.
This forum will be a little different, as we will start by having impromptu stand-up talks. If you have something you want to share that doesn't need a full presentation, this is the perfect format for it! It can be a quick update about a prior presentation, sharing a software package you've found, or posing a question that may make a good future full-length presentation.
Here are the links to this week's agenda and the Google meet.
Hope to see you there!
Thomas Martin (Oct 03 2022 at 19:31):What room number is the Chapman Room?
Lev Romashkov (Oct 03 2022 at 19:32):Thomas Martin said:
What room number is the Chapman Room?
ML-245
Thomas Martin (Oct 03 2022 at 19:33):Thanks!
Heather Craker (Oct 11 2022 at 15:19):Good morning everyone! Next Monday, October 17th is the next ESDS Forum, and we are looking for one or two people to present. The presentations do not need to be about finished work nor do they need to be polished. We actually encourage presentations about current data science challenges that you may be facing, about new packages and tools you've found, or presentations showing a demo of something you've been working on.
If you or someone you know is interested in presenting, here is the sign up sheet!
Heather Craker (Dec 06 2022 at 18:59):Hi all! We have one more forum this year this coming Monday, Dec 12th. With AMS coming up, we highly encourage community members to use this forum to practice their presentations. We still have slots available. Please sign up if you are interested in presenting!
Heather Craker (Dec 12 2022 at 18:03):Hi all! Today is the last forum of the year. Janine Aquino will be practicing her AMS presentation "An Updated Python Based Software Suite to Control and Monitor the NCAR Microwave Temperature Profiler as a roadmap for software development best practices in support of FAIR Open Data and Software". Come check it out today at 2pm MT in either the Chapman room or online at meet.google.com/uya-vqhi-twg
Brian Rose (Feb 15 2023 at 14:15):Hi all, are the forums continuing this spring? I am visiting NCAR 2/17 through 3/3 and would enjoy talking with folks about what we're doing with Pythia Cookbooks.
Heather Craker (Feb 15 2023 at 14:45):Yes the forums are still happening! I'm not sure if we have an open slot while you'll be at NCAR, but the forum is hybrid so you can present from home another time if you'd like. Here's the sign up sheet. @Elena Romashkova and I run the forum, so let us know if you have any questions
Brian Rose (Feb 17 2023 at 18:20):Thanks @Heather Craker and @Elena Romashkova, I couldn't access the sign up sheet but I met with John Clyne this morning and got signed up for an open date April 17.
Heather Craker (Feb 17 2023 at 18:22):Hi Brian. Sorry you couldn't access the sign up sheet. I can add you to the list of editors for the sheet. I'm looking forward to your presentation! Let us know if you have any questions
Deepak Cherian (Feb 17 2023 at 18:40):I think it would be nice to have Brian present off-schedule (like we did with Hauke) so that follow-on in-person meetings will be possible. This is a nice opportunity
Heather Craker (Feb 17 2023 at 18:43):I think that would be possible. @Elena Romashkova and I will chat about it and see if we can get a room. No guarantees, but we can do our best!
Deepak Cherian (Feb 17 2023 at 18:45):Thank you!
Brian Rose (Feb 18 2023 at 18:55):That would be great if it works out!
Lev Romashkov (Mar 02 2023 at 19:45):One more reminder that we've got an extra ESDS forum talk happening this afternoon at 2 with visiting scientist @Brian Rose on Project Pythia cookbooks ! It'll be in person in the Mesa Lab Director's Conference Room, and online at meet.google.com/ubj-irpf-evd.
Lev Romashkov (Mar 06 2023 at 20:40):Another ESDS forum talk today by @Daniel Adriaansen: Using Python's Multiprocessing module to speed up calculations in a non-HPC workflow! This will be at 2 PM, in the Mesa Lab Chapman room and at meet.google.com/uya-vqhi-twg. (The presentation will be virtual, but the room will be set up to watch + discuss)
Katie Dagon (Mar 30 2023 at 20:29):AWSIG Forum on Monday for cloud computing and Casper discussions
CISL staff will seek user input on two initiatives of interest to the NCAR community during the ESDS forum from 2 to 3 p.m. MDT on Monday, April 3. The forum agenda includes:
An overview of a prototype on/off-premises, cloud-computing project that seeks to complement and extend the capabilities of NCAR’s existing JupyterHub and Casper resources.
Community input on plans for a Casper augmentation. CISL would like to hear from users about what they see as the strengths and limitations of the current Casper resources and what should be preserved or changed going forward. Community input will be used in the procurement process for the next generation of Casper hardware.
All users with an interest in the future of NCAR’s data analysis resources are welcome to participate remotely or in the Mesa Lab Chapman Room.
Katie Dagon (May 15 2023 at 16:49):Hi @all, reminder about the next ESDS Forum this afternoon: Josh Boyle and his team will be giving a talk on Faster Computing on GPUs with ArrayFire. If you're in person please head over to the Mesa Lab Chapman Room at 2pm MT, or join virtually at meet.google.com/uya-vqhi-twg.
The meeting will start with community updates, which can be super quick/informal and a great way to stay up to date on what others are working on or interested in. See you soon!
Katelyn FitzGerald (Jun 26 2023 at 17:58):Hi @all ,
A quick reminder that we have an ESDS Forum this afternoon at 2pm (mountain time)! It will be all virtual at meet.google.com/uya-vqhi-twg. Julia Kent will be giving an update about the Project Pythia Cookoff, a hackathon-style event that was held at the Mesa Lab last week with the goal of producing more Pythia Cookbooks, which are crowd-sourced collections of workflows for the geosciences.
See you there!
Lev Romashkov (Aug 07 2023 at 16:30):@all, reminder that there's an ESDS forum this afternoon! @Brian Vanderwende will be giving a tutorial on Using conda to access and manage analysis environments specific to NCAR HPC systems, which should be of interest to many. This will be at 2 PM MDT, fully virtual at https://meet.google.com/uya-vqhi-tw! See you there :)
Lev Romashkov (Aug 07 2023 at 21:38):Elena Romashkova said:
all, reminder that there's an ESDS forum this afternoon! Brian Vanderwende will be giving a tutorial on Using conda to access and manage analysis environments specific to NCAR HPC systems, which should be of interest to many. This will be at 2 PM MDT, fully virtual at https://meet.google.com/uya-vqhi-tw! See you there :)
Here's the link to the recording of the conda + AWSIG announcements portion of the forum if anyone wasn't able to make it! https://drive.google.com/file/d/1wENX4ipRwhXQ5coFOSbtXCAMXkl_UF1P/view?usp=sharing
Katelyn FitzGerald (Aug 21 2023 at 15:02):Hi @all,
A quick reminder that Elena Romashkova and I will be giving a SciPy 2023 Recap presentation at our Earth System Data Science (ESDS) Forum today at 2pm MDT. As usual we'll have time from some quick announcements and stand-ups at the beginning and discussion at the end.
You can find the Google Meet link here or on the ESDS calendar. Please share with any colleagues you think might be interested.
We hope to see you there!
Drew Camron (Aug 24 2023 at 21:25):Related: SciPy 2023 talk videos are finally uploaded
Katelyn FitzGerald (Sep 18 2023 at 17:05):Hi @all !
A quick reminder that we have our Earth System Data Science (ESDS) Forum today at 2pm MDT. Keith Lindsay will be presenting on “Using catalogs for model diagnostics.”
As usual, we'll have time for some quick announcements and updates at the beginning and discussion at the end.
You can find the Google Meet link here or on the ESDS calendar. Please share with any colleagues you think might be interested.
We hope to see you there!
Katelyn FitzGerald (Oct 02 2023 at 14:19):Hi @all !
A quick reminder that we have our Earth System Data Science (ESDS) Forum today at 2pm MDT. Philip Chmielowiec will be presenting on “Unstructured Grid Visualization with UXarray.”
As usual, we'll have time for some quick announcements and updates at the beginning and discussion at the end.
You can find the Google Meet link here or on the ESDS calendar. Please share with any colleagues you think might be interested.
We hope to see you there!
Lev Romashkov (Oct 13 2023 at 20:16):There's an ESDS forum this upcoming Monday, with Joseph Gum presenting on "Caring for the data in 'Data Science.'" I'll send out another reminder then, but in the meantime be thinking about any announcements or updates you might have to share at the beginning of the forum! Link to add topics to the agenda here, but spur of the moment additions are always welcome too :)
Lev Romashkov (Oct 16 2023 at 19:45):Elena Romashkova said:
There's an ESDS forum this upcoming Monday, with Joseph Gum presenting on "Caring for the data in 'Data Science.'" I'll send out another reminder then, but in the meantime be thinking about any announcements or updates you might have to share at the beginning of the forum! Link to add topics to the agenda here, but spur of the moment additions are always welcome too :)
Happening in 15 minutes here! meet.google.com/uya-vqhi-twg
Negin Sobhani (Oct 24 2023 at 23:22):Hello Everyone,
In preparation for our upcoming ESDS/ASWIG Dask discussions, we're interested to better understand user experiences and challenges related to adopting Dask to your workflows. Please take ~2 minutes to fill out this short survey.
Thank you!
Negin
Katelyn FitzGerald (Oct 30 2023 at 15:17):Hi all,
A quick reminder about the ESDS Forum / AWSIG Discussion on Dask this afternoon from 2-3 pm MDT!
Pre-event survey
Google Meet link
Katelyn FitzGerald (Oct 30 2023 at 18:43):One more reminder to think about any quick updates you might like to share with ESDS as well! Think resources, upcoming events, work you'd like to share, challenges, etc.
Please add them to the meeting notes in the "community updates" section whenever you have a moment.
Lev Romashkov (Nov 10 2023 at 23:14):A heads up that we have our next ESDS forum coming up this Monday 11/13 at 2 PM! The title is NCAR GIS Program - Advancing actionable and convergent Earth System Science with geographic information science and technology, geospatial analytics, and geovisualizations, and it'll be presented by Olga Wilhelmi, Jennifer Boehnert, Kevin Sampson, and Matt Casali. This talk will also be recorded in case you can't make it!
Lev Romashkov (Nov 13 2023 at 18:49):Elena Romashkova said:
A heads up that we have our next ESDS forum coming up this Monday 11/13 at 2 PM! The title is NCAR GIS Program - Advancing actionable and convergent Earth System Science with geographic information science and technology, geospatial analytics, and geovisualizations, and it'll be presented by Olga Wilhelmi, Jennifer Boehnert, Kevin Sampson, and Matt Casali. This talk will also be recorded in case you can't make it!
This is today! Link here: meet.google.com/uya-vqhi-twg
David Ahijevych (Nov 16 2023 at 16:09):Is Olga's recorded talk (NCAR GIS) online yet?
Katelyn FitzGerald (Nov 16 2023 at 16:15):David Ahijevych said:
Is Olga's recorded talk (NCAR GIS) online yet?
Here's the link: https://drive.google.com/file/d/1XpdkFzF7GIMP9a5f1NuQo4eiw7Mezs9s/view?usp=sharing
It should be in the meeting notes as well as attached to the calendar event.
Katelyn FitzGerald (Dec 04 2023 at 16:08):Hi @all ,
Please join us for a special hybrid ESDS Forum this morning at 11am MST on Google Meet and in ML-245 (Chapman Room)! Caroline Bain, an Enterprise Architect at the UK Met Office, will be sharing a bit about her role and work at the Met Office.
A quick reminder to add any updates (resources, upcoming events, work you'd like to share, challenges, etc.) you might like to share with ESDS to the community updates section of the meeting notes as well!
Hope to see you there!
Lev Romashkov (Jan 05 2024 at 18:20):ESDS forums are back for the new year! This Monday 1/8 at 2 PM MST, @Doug Schuster will be presenting on Data Commons and @Nick Cote will be presenting on the NSF NCAR Cloud Pilot Project. Here's the Google Meet link (note it's a new one for 2024!).
As always, if you have anything to share with the ESDS community, please add items to the community updates section of the meeting notes, or just speak up during that part of the forum!
Katelyn FitzGerald (Jan 08 2024 at 17:54):A quick reminder to join us this afternoon for the ESDS Forum at 2pm MT! Details above.
Lev Romashkov (Feb 05 2024 at 18:12):Hi everyone, we've got another ESDS forum this afternoon! It'll be at 2 PM MST at the usual link. I'll share some resources of interest to the ESDS community from AGU this past December, as well as a quick recap of the ESDS annual event a few weeks ago, and @Anissa Zacharias will present on Benchmarking your Scientific Python Packages using ASV and GitHub Actions. Hope to see you all there!
Katelyn FitzGerald (Feb 05 2024 at 18:22):Additionally, if you have any short updates (e.g. resources, upcoming events, etc.) you would like to share, please add them to the “community updates” section of the meeting notes.
This would be a great spot for any additional interesting or exciting takeaways from AGU/AMS!
Drew Camron (Feb 06 2024 at 16:03):Was this forum recorded? I was on PTO but am severely interested in hearing about other folks' library benchmarking experience!
Katelyn FitzGerald (Feb 06 2024 at 16:09):Drew Camron said:
Was this forum recorded?
It wasn't, but the slides are linked in the notes (or here) and there are a few links in the meeting notes.
If there's interest in some follow on discussion, we could create a topic in here as well.
Drew Camron (Feb 06 2024 at 16:14):Perfect, thank you! :tada:
Anissa Zacharias (Feb 06 2024 at 16:27):@Drew Camron also feel free to email/DM me if you want to chat more! I'm absolutely down to hear any suggestions and/or talk your ear off about our experience so far with benchmarking
Katelyn FitzGerald (Mar 14 2024 at 18:27):Hi everyone!
Join us this coming Monday, March 18th at 2 PM MT on Google Meet for the next ESDS Forum! Drew Camron and Ryan May will be presenting on MetPy giving a brief intro, some updates, and leaving plenty of time for community discussion and feedback.
As always, if you have anything to share with the ESDS community, please add items to the community updates section of the meeting notes, and/or speak up during that part of the forum!
See you there!
Katelyn FitzGerald (Mar 18 2024 at 16:26):A quick reminder that we have an ESDS Forum this afternoon at 2PM MT on MetPy (details above)!
If you have any updates you'd like to share with the ESDS community please jot them down in the meeting notes.
Katelyn FitzGerald (Mar 27 2024 at 22:00):Hi everyone!
Join us this coming Monday, April 1st at 2 PM MT on Google Meet for the next ESDS Forum! Adrianna Foster and Sam Rabin will be presenting on VS Code and giving a brief demo. We'll follow up with some Q&A and discussion.
As always, if you have anything to share with the ESDS community, please add items to the community updates section of the meeting notes, and/or speak up during that part of the forum!
See you there!
Katelyn and Lev
Katelyn FitzGerald (Apr 01 2024 at 17:22):A quick reminder that we have an ESDS Forum this afternoon at 2PM MT on VS Code (details above)!
If you have any updates you'd like to share with the ESDS community please jot them down in the meeting notes..
Negin Sobhani (Apr 05 2024 at 18:12):Hello @Daniel Adriaansen, Thanks so much for your message. What time is the ESDS Committee Meeting on April 08? I would be happy to attend this to discuss some ideas. I have a training on Monday afternoon, but I should be able to get out of the training for 10-15 minutes to discuss this at the ESDS meeting. Thanks again, @John Clyne and @Daniel Adriaansen, for coordinating this.
Lev Romashkov (Apr 12 2024 at 20:00):Heads up about our next ESDS forum this coming Monday, April 15th at 2 PM MT on Google Meet! @Thomas Martin will be giving a talk on the following two topics:
Short discussion on JAX drop in for numpy : https://jax.readthedocs.io/en/latest/jax-101/01-jax-basics.html
Xarray to ML package of choice. We all love xarray datasets for rich metadata, attributes, and units. What are some of the best practices and workflows to reattach these after doing ML analysis? This will be an open discussion about the gaps, current best practices, and where future development needs to be.
Be thinking about any announcements or updates you might have for the community updates portion, and add them to the meeting notes if you think of them ahead of time!
Katelyn FitzGerald (Apr 15 2024 at 17:06):A quick reminder about the ESDS Forum this afternoon at 2pm on arrays and metadata in ML workflows (see the detailed description above). Join us on Google Meet!
And a reminder to add any resources, events, suggestions, etc. you'd like to share to the community updates section of the meeting notes.
Katelyn FitzGerald (Apr 26 2024 at 18:51):Hi everyone!
Join us this coming Monday, April 29th at 2 PM MT on Google Meet for the next ESDS Forum! Julius J.M. Busecke from Columbia University will be presenting on ARCO Data with Pangeo-Forge (see below for the full title and description).
As always, if you have anything to share with the ESDS community, please add items to the community updates section of the meeting notes.
See you there!
Title: Analysis-Ready Cloud-Optimized Data for your community and the entire world with Pangeo-Forge
Description: Open Data is the bedrock of open, collaborative, and reproducible science. In this seminar I will show two different use cases to ingest climate data into analysis-ready cloud-optimized formats -- The LEAP community Pangeo-Forge Bakery and the Pangeo/ESGF Zarr Bakery. I will present challenges and successes, and invite a broader discussion about how to serve both your community and the broader public with open data.
Katelyn FitzGerald (Apr 29 2024 at 17:22):A quick reminder about the ESDS Forum this afternoon at 2pm from Julius Busecke of Columbia University on Analysis-Ready Cloud-Optimized Data with Pangeo-Forge (see the detailed description above). Join us on Google Meet!
And a reminder to add any resources, events, suggestions, etc. you'd like to share to the community updates section of the meeting notes.
Lev Romashkov (May 10 2024 at 20:31):We have another ESDS forum coming up this Monday at 2 PM MT on Google Meet! Matt Mayernik and Bob Dattore will be presenting on FAIR Data, Data Repositories, and Data Citation.
Description:
This talk will overview NSF NCAR support for enabling data to be "FAIR" - Findable, Accessible, Interoperable, and Reusable. We will also outline work within NSF NCAR to trace the impact of data, software, and other resources through compiling citations from several external services.
Remember to add community updates, which can include things like resources, updates on projects, events to share, etc. to the meeting notes, or just speak up at the forum!
Lev Romashkov (May 13 2024 at 17:32):Lev Romashkov said:
We have another ESDS forum coming up this Monday at 2 PM MT on Google Meet! Matt Mayernik and Bob Dattore will be presenting on FAIR Data, Data Repositories, and Data Citation.
Description:
This talk will overview NSF NCAR support for enabling data to be "FAIR" - Findable, Accessible, Interoperable, and Reusable. We will also outline work within NSF NCAR to trace the impact of data, software, and other resources through compiling citations from several external services.Remember to add community updates, which can include things like resources, updates on projects, events to share, etc. to the meeting notes, or just speak up at the forum!
Reminder that this is today - see you there!
Lev Romashkov (Jun 21 2024 at 15:54):There's another ESDS forum this Monday, June 24th at 2 PM MT on Google Meet! DJ Gagne will be talking to us about the MILES group's work on machine learning software.
As usual, there will be time for community updates at the beginning. Please think about anything you might have to share and add items to the meeting notes, or just speak up at the forum!
Lev Romashkov (Jun 24 2024 at 17:31):Lev Romashkov said:
There's another ESDS forum this Monday, June 24th at 2 PM MT on Google Meet! DJ Gagne will be talking to us about the MILES group's work on machine learning software.
As usual, there will be time for community updates at the beginning. Please think about anything you might have to share and add items to the meeting notes, or just speak up at the forum!
This is today - see you all in a few hours!
Lev Romashkov (Jul 18 2024 at 20:49):Next ESDS forum this Monday, July 22nd at 2 PM MT on Google Meet! Ben Kirk will be giving an AWSIG (Analysis Workflow Special Interest Group) update focused on the Casper augmentation project.
Description:
Over the past year CISL has begun adding additional resources to the Casper data analysis and visualization cluster across all node classes. We will overview the resources that have already been added - H100-equipped GPGPUs, visualization resources with L40 graphics cards, and additional high-memory nodes. We will also outline the process and timeline for the additional high-throughput computing nodes planned for later this calendar year.
There will be time for community updates at the beginning. As a reminder, this is a very open-ended category - ideas include sharing a coding resource or event, asking the room for advice on a data science problem you're having, or sharing something cool from a project you're working on. Visiting students, interns, etc. would be especially welcome to share! To give a community update, add items to the meeting notes or just speak up at the forum.
Katelyn FitzGerald (Aug 19 2024 at 15:54):Hi all,
No ESDS Forum today. We'll resume September 16th. See you then!
Katelyn FitzGerald (Sep 16 2024 at 16:02):Hi all ,
We'll be kicking off the fall season of the ESDS Forum today at 2pm MDT with Joseph Gum sharing about archiving on Zenodo for NSF NCAR.
As usual we'll have time for some announcements and community updates at the beginning and discussion at the end. Please think about anything you might have to share and add items to the meeting notes, or just speak up at the forum!
You can find the Google Meet link here or on the ESDS calendar.
Please share with any colleagues you think might be interested.
Hope to see you there!
Katelyn FitzGerald (Sep 26 2024 at 21:50):Hi all,
Next Monday we’ll have Wai Allen presenting “Indigenous Perspectives on Data Management: Rising Voices Changing Coasts Geosciences Hub” during the ESDS Forum at 2pm MDT (full description below).
As usual we'll have time for some announcements and community updates at the beginning and discussion at the end. Please think about anything you might have to share and add items to the meeting notes, or just speak up at the forum!
You can find the Google Meet link here or on the ESDS calendar.
Please share with any colleagues you think might be interested.
Hope to see you there!
Katelyn
Indigenous Perspectives on Data Management: Rising Voices Changing Coasts Geosciences Hub
Wai Allen
Convergence research settings are critical areas for Indigenous communities to address pressing societal needs by engaging with an intellectually diverse cohort of researchers. Inclusion of Indigenous knowledge systems into these settings are critical for engagement of Indigenous communities, however, challenges often exist in the process and method of engagement between Indigenous communities and physical and social scientists from academic and federal institutions.
Katelyn FitzGerald (Sep 30 2024 at 18:17):Katelyn FitzGerald said:
Hi all,
Next Monday we’ll have Wai Allen presenting “Indigenous Perspectives on Data Management: Rising Voices Changing Coasts Geosciences Hub” during the ESDS Forum at 2pm MDT (full description below).
As usual we'll have time for some announcements and community updates at the beginning and discussion at the end. Please think about anything you might have to share and add items to the meeting notes, or just speak up at the forum!
You can find the Google Meet link here or on the ESDS calendar.
Please share with any colleagues you think might be interested.
Hope to see you there!
Katelyn
Indigenous Perspectives on Data Management: Rising Voices Changing Coasts Geosciences Hub
Wai AllenConvergence research settings are critical areas for Indigenous communities to address pressing societal needs by engaging with an intellectually diverse cohort of researchers. Inclusion of Indigenous knowledge systems into these settings are critical for engagement of Indigenous communities, however, challenges often exist in the process and method of engagement between Indigenous communities and physical and social scientists from academic and federal institutions.
A quick reminder about the ESDS Forum this afternoon (see details above).
Katelyn FitzGerald (Oct 24 2024 at 17:20):Hi all,
Next Monday we’ll have Anissa Zacharias sharing about a new GeoCAT resource (description below) and Nick Cote giving a short update on the CISL On-Prem Cloud project during the ESDS Forum at 2pm MDT.
As usual we'll have time for some announcements and community updates at the beginning and discussion at the end. Please think about anything you might have to share and add items to the meeting notes, or just speak up at the forum!
You can find the Google Meet link here or on the ESDS calendar.
Please share with any colleagues you think might be interested.
Hope to see you there!
Katelyn
GeoCAT Applications
Anissa Zacharias
This talk will overview a new GeoCAT project, GeoCAT Applications, and provide a space for early feedback into its development. GeoCAT Applications is a community resource inspired by the NCL Applications page that aims to connect existing tools in the python ecosystem with geoscience applications.
Katelyn FitzGerald (Oct 28 2024 at 17:03):Katelyn FitzGerald said:
Hi all,
Next Monday we’ll have Anissa Zacharias sharing about a new GeoCAT resource (description below) and Nick Cote giving a short update on the CISL On-Prem Cloud project during the ESDS Forum at 2pm MDT.
As usual we'll have time for some announcements and community updates at the beginning and discussion at the end. Please think about anything you might have to share and add items to the meeting notes, or just speak up at the forum!
You can find the Google Meet link here or on the ESDS calendar.
Please share with any colleagues you think might be interested.
Hope to see you there!
Katelyn
GeoCAT Applications
Anissa ZachariasThis talk will overview a new GeoCAT project, GeoCAT Applications, and provide a space for early feedback into its development. GeoCAT Applications is a community resource inspired by the NCL Applications page that aims to connect existing tools in the python ecosystem with geoscience applications.
A quick reminder about this afternoon's ESDS Forum. Details :point_up: .
Katelyn FitzGerald (Nov 08 2024 at 17:58):Hi all,
There will be no ESDS Forum Monday, November 11th.
Hope to see you later this month!
Katelyn FitzGerald (Nov 21 2024 at 21:05):Hi all,
There will be no ESDS Forum Monday, November 25th over the holiday week.
However, you can look forward to a special seminar "Data Access for km-Scale Resolution Models" from Florian Ziemen of DKRZ on Tuesday December 3rd from 9-10am MT. More information and a link to the calendar event below.
Title: Data Access for km-scale Resolution Models
Presenter: Florian Ziemen (DKRZ)
Abstract:
With the transition to global, km-scale simulations, model outputs have grown in size, and efficient ways of accessing data have become more important than ever. This implies that the data storage has to be optimized for efficient read access to small sub-sets of the data, and multiple resolutions of the same data need to be provided for efficient analysis on coarse as well as fine-grained scales.
I will present the approach currently taken by DKRZ and the Max-Planck-Institute for Meteorology in the context of km-scale resolution projects like nextGEMS and the upcoming WCRP Digital Earths global hackathon. We minimize the data users need to load to perform their analyses by remapping the data to the healpix grid, and creating a hierarchy of resolutions in space and time. Listing these datasets in catalogs provides convenient access for users and allows to move data between storage media without bothering the users. Using zarr via https as standard access protocol even enables remote users to easily analyze data stored at DKRZ or any other center.
Katelyn FitzGerald (Dec 19 2024 at 17:33):A belated update on the ESDS Forum:
I'll get the calendar and sign up sheet updated soon, but you can plan on the ESDS Forum picking back up in February of the new year. If you're have any folks you'd like to hear from, things you'd like to share, or particular topics of interest, please reach out to me at katelynw@ucar.edu.
In the meantime, I hope everyone has a lovely winter holiday and conference season. See you in the new year!
Katelyn FitzGerald (Jan 07 2025 at 18:25):Happy New Year!
The ESDS Forum sign up sheet is now updated for spring 2025. Feel free to grab a time slot if you have something you'd like to share and please reach out with any questions or suggestions!
Katelyn FitzGerald (Feb 03 2025 at 18:18):Hi all,
No presentation for today, but we will plan to hold an abbreviated ESDS Forum. I know a few folks have updates on events, resources, etc. they'd like to share. Meeting notes here. Please drop a note in the community updates section if you have anything you'd like to share (e.g. interesting projects you heard about at AMS / AGU, new resources / tutorials, upcoming events, etc.).
Also, @Harsha Hampapura (our new ESDS Forum co-organizer!) and I are working on spring 2025 schedule if you have any suggestions for presenters and/or might like to share your work this spring. Go ahead and sign up here and/or reach out to us with any questions.
Katelyn FitzGerald (Mar 03 2025 at 18:04):Hi @all ,
Please join us for the ESDS Forum this afternoon from 2-3p! Doug Schuster and Harsha Hampapura will be presenting updates on the NSF NCAR Data Commons.
As usual, if you have any updates you'd like to share (resources, events, tips, etc.) please add them to the community updates section of the meeting notes.
Hope to see you there!
Katelyn FitzGerald (Mar 17 2025 at 15:10):Hi @all ,
Please join us for the ESDS Forum this afternoon from 2-3p! Valerio Pascucci and Aashish Panta from the University of Utah will be presenting on OpenViSUS for scientific visualization (full abstract below).
As usual, if you have any updates you'd like to share (resources, events, tips, etc.) please add them to the community updates section of the meeting notes.
Hope to see you there!
OpenVISUS for Petascale scientific visualization
Scientists generate petabytes of data to help uncover environmental trends or behaviors that are hard to predict. For example, understanding climate simulations based on the long-term average of temperature, precipitation, and other environmental variables is essential to predicting and establishing root causes of future undesirable scenarios and assessing possible mitigation strategies. While supercomputer centers provide a powerful infrastructure for generating petabytes of simulation output, accessing and analyzing these datasets interactively remains challenging on multiple fronts. We present an approach to managing, visualizing, and analyzing petabytes of data within a browser on equipment ranging from the top NASA supercomputer to commodity hardware like a laptop. We provide customizable dashboards that can visualize petabytes of data and can be accessed from any device with any internet connection, enabling interactive analysis of vast amounts of data to a wide range of users - from top scientists with access to leadership-class computing environments to undergraduate students of disadvantaged backgrounds from minority-serving institutions. We focus on NASA's use of petascale climate datasets as an example of particular societal impact and, therefore, a case where achieving broader science participation is critical.
Katelyn FitzGerald (Mar 27 2025 at 18:01):Hi all ,
Please join us for the ESDS Forum next Monday from 2-3p! We'll have Eric Neinhouse presenting on Enabling a Science Gateway at NCAR and Pablo Lichtig presenting on MELODIES-MONET.
As usual, if you have any updates you'd like to share (resources, events, tips, etc.) please add them to the community updates section of the meeting notes.
Hope to see you there!
Katelyn FitzGerald (Mar 31 2025 at 16:07):A quick reminder about the ESDS Forum this afternoon (see above for details).
Hope to see you there!
Katelyn FitzGerald (Apr 11 2025 at 21:17):Hi all ,
Please join us for the ESDS Forum next Monday from 2-3p! We'll have Brian Bockelman from the Morgridge Institute for Research presenting on the Open Science Data Federation (OSDF) - Connecting the Nation's Datasets.
As usual, if you have any updates you'd like to share (resources, events, tips, etc.) please add them to the community updates section of the meeting notes.
Hope to see you there!
Katelyn FitzGerald (Apr 14 2025 at 16:34):A quick reminder about this afternoon's ESDS Forum. Details and links above and here's a brief description of the presentation:
The Open Science Data Federation (OSDF) is an NSF-funded service that connects the nation's disparate scientific dataset repositories into a single fabric. The OSDF aims to cover a broad swath of science content, including NCAR's Research Data Archive, providing high throughput access for workflows with high levels of reuse.
In this talk, we'll go cover the basics goals of the OSDF, how the technologies work "under the hood", the targeted user experiences, and where the project is headed to next.
Katelyn FitzGerald (Apr 25 2025 at 17:31):Hi all ,
Please join us for the ESDS Forum next Monday from 2-3p! We'll have Max Grover from Argonne National Laboratory presenting on intake-esm vs intake-esgf and Nick Cote from CISL presenting the new CIRRUS Cloud. Full descriptions below.
As usual, if you have any updates you'd like to share (resources, events, tips, etc.) please add them to the community updates section of the meeting notes.
Hope to see you there!
Intake-ESM vs Intake-ESGF
Max Grover works as an Atmospheric Data Scientist at Argonne National Laboratory, where he works with the U.S. Department of Energy supported Earth System Grid Federation project. During this presentation, he will give an overview of two different Python tools for working with petabyte-scale earth system model data collections: intake-esm and intake-esgf. Key differences between the two will be highlighted, with examples of what should be used when in addition to the general philosophies of the toolkits, and roadmaps moving forward.
CIRRUS Cloud
An introduction to the new Cloud Infrastructure for Remote Research, Universities, and Scientists platform named CIRRUS. The presentation will cover how CIRRUS can be utilized to complement existing HPC resources at NSF NCAR and includes information on how custom applications are deployed as well as the ready to use tools that are available to consume.
Katelyn FitzGerald (Apr 28 2025 at 19:55):Happening in a few :point_up:
Last updated: May 16 2025 at 17:14 UTC