You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
If we try to run a simulation for the first time with mpiexec, I think we can end up redundantly downloading the same data from different MPI processes.
I'm not sure the best way to handle this --- we could only download from rank 0, or we can somehow distribute the downloading amongst processes (even cooler).
A related issue is that we don't have a simple way to download data in isolation before running a script (the data is all downloaded automatically by trying to run a simulation, which is very nice of course). But probably there are situations where a user may want to get the downloading out of the way in advance before launching a job and it would be nice to make that simple.
The text was updated successfully, but these errors were encountered:
If we try to run a simulation for the first time with
mpiexec
, I think we can end up redundantly downloading the same data from different MPI processes.I'm not sure the best way to handle this --- we could only download from rank 0, or we can somehow distribute the downloading amongst processes (even cooler).
A related issue is that we don't have a simple way to download data in isolation before running a script (the data is all downloaded automatically by trying to run a simulation, which is very nice of course). But probably there are situations where a user may want to get the downloading out of the way in advance before launching a job and it would be nice to make that simple.
The text was updated successfully, but these errors were encountered: