Stream: machine-learning

Topic: Datasets and Dataloaders

Maria Molina (Jul 12 2021 at 20:43):

Here is a pytorch intro to datasets and dataloaders, which really help with some data preprocessing during training, but still doesn't resolve my main issue on how to normalize data based on varying data distributions https://pytorch.org/tutorials/beginner/basics/data_tutorial.html

Maria Molina (Jul 12 2021 at 20:47):

Currently, I compute the min/max, mean, standard deviation, etc of each respective variable for each of the training sets prior to training, then use those values as input into the dataset/dataloader preprocessing

Last updated: May 16 2025 at 17:14 UTC