Possible memory leak?

[gngdb]

The system memory slowly rises over the 75 hour training routine in the benchmark experiment: https://wandb.ai/gngdb/trial-imagenet/reports/Training-Resnet18-with-sequential-imagenet-dataloader--Vmlldzo3MTI3MzY

It looks like there might be some tiny memory leak in that experiment. I'm not sure if it's to do with this dataloader but it could be worth investigating. Although, it doesn't cause problems even after 75 hours of training.