Stream: ESDS

Topic: netCDF in tensorflow


view this post on Zulip Deepak Cherian (Mar 21 2022 at 05:50):

https://www.noahbrenowitz.com/post/loading_netcdfs/

In this post, I benchmark several ways of loading a dataset from NetCDF. The goal is not to demonstrate a feature-complete solution, but to introduce a range of methods and rigorously compare their performance. Perhaps surprisingly, I show that NetCDF is a perfectly acceptable format for training ML models and may outperform some “native” TensorFlow formats.


Last updated: May 16 2025 at 17:14 UTC