Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Download ECCO files using Downloads and .netrc files #281

Merged
merged 33 commits into from
Dec 10, 2024
Merged
Changes from 1 commit
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
81d93cc
this should work
simone-silvestri Nov 28, 2024
867da9c
better naming
simone-silvestri Nov 28, 2024
71f2b19
only one download
simone-silvestri Nov 28, 2024
b36f60f
add download test
simone-silvestri Nov 28, 2024
31fb896
joinpath does not work on windows
simone-silvestri Nov 28, 2024
5b229db
test also downloading the bathymetry
simone-silvestri Nov 28, 2024
3ee4eaa
test dowloading bathymetry
simone-silvestri Nov 28, 2024
cba1991
restore tests
simone-silvestri Nov 28, 2024
51aff06
gracefull downloading
simone-silvestri Nov 28, 2024
d22edc9
try it now
simone-silvestri Nov 28, 2024
ebaa07d
fix typo
simone-silvestri Nov 28, 2024
879d611
make sure we delete the previous data before testing the download
simone-silvestri Nov 28, 2024
cd54cdb
Merge branch 'main' into ss/download-everywhere
simone-silvestri Nov 28, 2024
0c38ce1
should work
simone-silvestri Dec 2, 2024
25216bc
Merge branch 'ss/download-everywhere' of github.com:CliMA/ClimaOcean.…
simone-silvestri Dec 2, 2024
c0892b9
test distributed downloading
simone-silvestri Dec 2, 2024
6d73e98
Update test_distributed_utils.jl
simone-silvestri Dec 2, 2024
3fc3bd5
fix the download
simone-silvestri Dec 2, 2024
f3dec5c
generalize the downloader
simone-silvestri Dec 2, 2024
3525b76
generalize more
simone-silvestri Dec 2, 2024
6a3fa7d
generalize filename
simone-silvestri Dec 2, 2024
91be188
download_progress is part of the downloading utilities
simone-silvestri Dec 2, 2024
ab2563d
better docstring
simone-silvestri Dec 2, 2024
25b42cd
better docstring
simone-silvestri Dec 2, 2024
a77cebb
change docstring
simone-silvestri Dec 2, 2024
28f597c
Merge branch 'main' into ss/download-everywhere
simone-silvestri Dec 3, 2024
c8b6e97
fix tests
simone-silvestri Dec 4, 2024
42da589
Merge branch 'ss/download-everywhere' of github.com:CliMA/ClimaOcean.…
simone-silvestri Dec 4, 2024
ad64272
distribute among tasks
simone-silvestri Dec 5, 2024
5c38029
whoops added wrong file
simone-silvestri Dec 5, 2024
926394f
correct looping
simone-silvestri Dec 9, 2024
a3254de
bugfix
simone-silvestri Dec 10, 2024
5b65403
Merge branch 'main' into ss/download-everywhere
simone-silvestri Dec 10, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
change docstring
  • Loading branch information
simone-silvestri committed Dec 2, 2024
commit a77cebb5c5a40fb6c66cb9498f988d524d295e2a
6 changes: 4 additions & 2 deletions src/DataWrangling/DataWrangling.jl
Original file line number Diff line number Diff line change
Expand Up @@ -58,8 +58,10 @@ end

Create a downloader that uses a netrc file to authenticate with the given machine.
This downlader writes the username and password in a file named `auth.netrc` (for Unix) and
`auth_netrc` (for Windows), located in the directory `dir`. To avoid storing passwords in plain text,
it is recommended to initialize the downloader in a temporary directory.
`auth_netrc` (for Windows), located in the directory `dir`.
To avoid leaving the password on disk after the downloader has been used,
it is recommended to initialize the downloader in a temporary directory, which will be removed
after the download is complete.

For example:

Expand Down
Loading