Skip to content
This repository has been archived by the owner on Dec 11, 2020. It is now read-only.

WIP: enable dask-gateway #144

Open
wants to merge 225 commits into
base: master
Choose a base branch
from
Open
Changes from 1 commit
Commits
Show all changes
225 commits
Select commit Hold shift + click to select a range
bfd0aed
start fresh from master, but unpin spatial packages from 3cef1a0
delgadom Jan 5, 2020
594e67e
pin spatial libraries except gdal
delgadom Jan 6, 2020
bd2c37e
test vdatum download
dallen5 Jun 4, 2020
81cd68c
ians changes
dallen5 Jun 4, 2020
6512390
add egm96 to vdatum
dallen5 Jun 4, 2020
02c5d16
use conda dask-kub name
dallen5 Jun 4, 2020
a7d53a0
unpin all version numbers
dallen5 Jun 4, 2020
2317167
fix typo
dallen5 Jun 4, 2020
6893ff0
install unzip before unzipping
dallen5 Jun 4, 2020
210d276
drop unnecessary packages
dallen5 Jun 4, 2020
26ed42f
use minor versions from resolved conda travis output
dallen5 Jun 5, 2020
01916c1
drop some packages
dallen5 Jun 5, 2020
86584df
drop fusepy
dallen5 Jun 5, 2020
5f673d9
more drops
dallen5 Jun 5, 2020
8f46c89
add climada
dallen5 Jun 9, 2020
e59162b
fix paths
dallen5 Jun 9, 2020
31128a5
try separate env instead
dallen5 Jun 9, 2020
07a3624
Revert "try separate env instead"
dallen5 Jun 12, 2020
a13aae3
Revert "fix paths"
dallen5 Jun 12, 2020
f1a2f4b
Revert "add climada"
dallen5 Jun 12, 2020
c698d57
unpin everything
dallen5 Jun 12, 2020
4664ead
tabs to match earlier commit
dallen5 Jun 12, 2020
46585fa
remove packages added since last commit where solver worked
dallen5 Jun 12, 2020
29067da
Revert "drop unnecessary packages"
dallen5 Jun 12, 2020
95b7928
undo revert
dallen5 Jun 12, 2020
44f72fe
Revert "drop unnecessary packages"
dallen5 Jun 12, 2020
c429a4f
Revert "Revert "drop unnecessary packages""
dallen5 Jun 12, 2020
25f2706
Revert "undo revert"
dallen5 Jun 12, 2020
fecb487
Revert "Revert "drop unnecessary packages""
dallen5 Jun 12, 2020
3b6f4d2
Revert "remove packages added since last commit where solver worked"
dallen5 Jun 12, 2020
125d288
Revert "tabs to match earlier commit"
dallen5 Jun 12, 2020
5bf4ebd
Revert "unpin everything"
dallen5 Jun 12, 2020
6b0e7d8
Revert "Revert "add climada""
dallen5 Jun 12, 2020
49b5384
Revert "Revert "fix paths""
dallen5 Jun 12, 2020
3012762
Revert "Revert "try separate env instead""
dallen5 Jun 12, 2020
26bb5c4
Revert "try separate env instead"
dallen5 Jun 12, 2020
aa2ba39
Revert "fix paths"
dallen5 Jun 12, 2020
3edd55d
Revert "add climada"
dallen5 Jun 12, 2020
50b4b83
Revert "more drops"
dallen5 Jun 12, 2020
2696670
Revert "drop fusepy"
dallen5 Jun 12, 2020
a135f99
Revert "drop some packages"
dallen5 Jun 12, 2020
363600f
Revert "use minor versions from resolved conda travis output"
dallen5 Jun 12, 2020
5964465
replace bumpversion
dallen5 Jun 12, 2020
a6ba44a
drop some packages
dallen5 Jun 12, 2020
295fa5f
drop fusepy
dallen5 Jun 12, 2020
07b03b1
drop more packages
dallen5 Jun 12, 2020
3c57f4e
use blas
dallen5 Jun 12, 2020
7079d07
use blas
dallen5 Jun 12, 2020
cce78d0
add fusepy
dallen5 Jun 12, 2020
ba31bdd
update os, jupyter, miniconda
dallen5 Jun 15, 2020
a1785a8
remove dev conda channels
dallen5 Jun 15, 2020
c27a0ef
pin full build
dallen5 Jun 16, 2020
ec1c76d
drop compiler_compat hack
bolliger32 Jun 16, 2020
3acda1c
unpin notebook env
bolliger32 Jun 16, 2020
7fb1e7b
add strict channel priority
bolliger32 Jun 16, 2020
2a15893
drop r_env
bolliger32 Jun 16, 2020
be715ee
unpin
bolliger32 Jun 16, 2020
e16aa2a
add pip back into notebook env to avoid warning
bolliger32 Jun 16, 2020
b5c24bc
pin all
bolliger32 Jun 16, 2020
63811b4
update travis yml
bolliger32 Jun 16, 2020
919317b
fix travis condition syntax
bolliger32 Jun 16, 2020
32ec9f3
remove labextension files already installed
bolliger32 Jun 16, 2020
7aa52b3
Download vdatum to appropriate path (#127)
dallen5 Jun 17, 2020
6d9fccb
add notebook linenums and ruler
bolliger32 Jul 3, 2020
c5eb26c
ignore vscode settings
bolliger32 Jul 3, 2020
f89bcc4
make travis.yml more readable
bolliger32 Jul 3, 2020
b74d5b8
update pins with xarray=0.14
bolliger32 Jul 3, 2020
f20a51c
pass debian_frontend to sudo in dockerfiles
bolliger32 Jul 3, 2020
0e1fffc
enable code formatter system wide so no overwrite
bolliger32 Jul 3, 2020
1996de1
sudo the serverextension in notebook
bolliger32 Jul 3, 2020
85597c8
try triggering clawpack build
bolliger32 Jul 5, 2020
6084e2c
only build clawpack from notebook
bolliger32 Jul 5, 2020
f1aa2af
should build after worker deployed not notbook
bolliger32 Jul 5, 2020
f940b2b
include clawpack in build
bolliger32 Jul 6, 2020
ceca954
forgot to include new packages
bolliger32 Jul 6, 2020
78990f3
change to https so travis works w/ clawpack
bolliger32 Jul 6, 2020
82c6c74
can't do --no-cache-dir
bolliger32 Jul 6, 2020
7420d69
copy correct clawpack folder in dockerfile
bolliger32 Jul 6, 2020
1117e8f
update submods
bolliger32 Jul 6, 2020
3121d8d
no worker/clawpack
bolliger32 Jul 6, 2020
8c2b668
rm gitmodules
bolliger32 Jul 6, 2020
8b6c869
update submod
bolliger32 Jul 6, 2020
d11d700
rm clawpack submod
bolliger32 Jul 6, 2020
d1cd3e3
simplify clawpack install
bolliger32 Jul 6, 2020
7097c2d
undo cp clawpack
bolliger32 Jul 6, 2020
f890e3d
try again w/ better pip install
bolliger32 Jul 6, 2020
3cfcb07
specify egg in install
bolliger32 Jul 6, 2020
b97a2b8
assign central clawpack commit
bolliger32 Jul 6, 2020
fe86e5d
fix build_arg in travis
bolliger32 Jul 6, 2020
80c0995
test the build as well
bolliger32 Jul 6, 2020
8a5ff04
set ulimit in prepare
bolliger32 Jul 6, 2020
347a859
update to new clawpack
bolliger32 Jul 7, 2020
9a21067
increase stack size for clawpack test
bolliger32 Jul 7, 2020
9054f74
fix docker run_tests in travis
bolliger32 Jul 7, 2020
58f5591
update clawpack commit
bolliger32 Jul 7, 2020
28f8f5f
set lib_paths for clawpack
bolliger32 Jul 7, 2020
a15451c
bump clawpack commit
bolliger32 Jul 7, 2020
8b4df77
build xgeoclaw in base image
bolliger32 Jul 7, 2020
5eb3e63
sudo pip install clawpack
bolliger32 Jul 7, 2020
291a434
try root user for pip install
bolliger32 Jul 7, 2020
91ea8df
no sudo for root pip install
bolliger32 Jul 7, 2020
3b1ee82
pin notebook sha and add fix-permissions
bolliger32 Jul 7, 2020
bb05dd6
added executable permissions
bolliger32 Jul 7, 2020
32ecc9e
unsudo pip install
bolliger32 Jul 7, 2020
4d9ab7e
danced around permission issues for /clawpack
bolliger32 Jul 7, 2020
a16dbb5
try newer start command from jupyter/base-notebook
bolliger32 Jul 7, 2020
e2d91d5
add python-snappy for parquet compression
bolliger32 Jul 7, 2020
dbbfedb
fix perm for /opt/conda to allow user installs
bolliger32 Jul 8, 2020
0b5d1f5
update claw fflags
bolliger32 Jul 9, 2020
1527749
add octave-optim
bolliger32 Jul 9, 2020
bf0e81e
fix regex for octave-worker
bolliger32 Jul 9, 2020
a6a4f72
drop delayed-branch flag b/c not supported
bolliger32 Jul 9, 2020
d3b5337
fix make line in nb dockerfile
bolliger32 Jul 9, 2020
b9cf0b2
no sudo in octave-worker
bolliger32 Jul 9, 2020
5556786
update jlab code formatter
bolliger32 Jul 9, 2020
30feda5
unpin notebook packages
bolliger32 Jul 9, 2020
6507e92
pin jlab code formatter to match extension to pkg
bolliger32 Jul 9, 2020
45e9174
pin isort as well for jlab code formatter
bolliger32 Jul 9, 2020
9c0e59a
add sphinx_rtd_theme
bolliger32 Jul 10, 2020
aef3b5a
add ipypublish
bolliger32 Jul 10, 2020
c2cd5b5
add nbdime and vim bindings
bolliger32 Jul 11, 2020
24d837a
separate out extension disable
bolliger32 Jul 11, 2020
7bc1672
try another disable
bolliger32 Jul 11, 2020
c9ff0dc
install matio
bolliger32 Jul 11, 2020
654876f
sudo disable extension
bolliger32 Jul 11, 2020
493cb1e
add papermill to nb
bolliger32 Jul 11, 2020
782feb9
black_nbconvert -> blackbook
bolliger32 Jul 11, 2020
127d948
skip vim bindings
bolliger32 Jul 11, 2020
c534a1f
keep shared_resources back
bolliger32 Jul 11, 2020
daef781
undo last change
bolliger32 Jul 11, 2020
4118c59
try again
bolliger32 Jul 11, 2020
513efe0
trying some diff travis things
bolliger32 Jul 11, 2020
142d6f8
pin rhg_compute_tools and pytides
bolliger32 Jul 11, 2020
4ba1167
add fuzzywuzzy
bolliger32 Jul 12, 2020
8675a5c
back to black_nbconvert
bolliger32 Jul 12, 2020
c865d27
make gitpython base package
bolliger32 Jul 13, 2020
2d959e4
add pygeos
bolliger32 Jul 13, 2020
7c650e7
install jupyterlab-flake8
bolliger32 Jul 13, 2020
2206913
add flake8 settings and toggle on
bolliger32 Jul 13, 2020
f4bb897
rm buggy jupyterlab-flake8
bolliger32 Jul 13, 2020
1e5bac9
add variable insepctor
bolliger32 Jul 13, 2020
b337cc9
bump xarray to 0.16
bolliger32 Jul 14, 2020
6da704a
bump several packages
bolliger32 Jul 14, 2020
d55edd0
pin jupyterhub
bolliger32 Jul 14, 2020
86ed862
update base images
bolliger32 Jul 15, 2020
3be4b66
include descartes for gpd plotting
bolliger32 Jul 18, 2020
0fbb0a9
add hvplot
bolliger32 Jul 22, 2020
f79ae4d
add JRE
bolliger32 Jul 22, 2020
745fea6
add toc to notebook
bolliger32 Jul 25, 2020
2e56216
Merge branch 'master' of github.com:RhodiumGroup/docker_images into d…
bolliger32 Jul 31, 2020
f7e3ff4
fix pin.py for new base env loc
bolliger32 Jul 31, 2020
b01e906
update to new jupyter image
bolliger32 Jul 31, 2020
1c6282e
bump to py38
bolliger32 Jul 31, 2020
6888623
add locales to match jupyter base-notebook
bolliger32 Jul 31, 2020
917fbc3
bump clawpack commit
bolliger32 Jul 31, 2020
0c103fa
fix dockerfile typo
bolliger32 Jul 31, 2020
103421c
bump geoclaw commit
bolliger32 Aug 1, 2020
7e1999b
fix worker workdir
bolliger32 Aug 3, 2020
8a8ae42
set default worker image to pytc-image
bolliger32 Aug 5, 2020
f695977
try sed for worker templte update
bolliger32 Aug 6, 2020
a200f01
bump clawpack commit
bolliger32 Aug 8, 2020
d2a0675
fix travis typo
bolliger32 Aug 8, 2020
88f8183
bump clawpack again
bolliger32 Aug 8, 2020
58e4787
unpin notebook packages
bolliger32 Aug 9, 2020
f54e71b
bump blas, oct2py, scikit-learn, dask, others
bolliger32 Aug 9, 2020
3b659a2
bump clawpack commit
bolliger32 Aug 9, 2020
7ee6e61
configure nbdime
bolliger32 Aug 9, 2020
5aa7842
bump vdatum to 4.1
bolliger32 Aug 9, 2020
c77d864
fix auto worker template
bolliger32 Aug 10, 2020
0828fd6
add us package
bolliger32 Aug 10, 2020
2370cba
install openpyxl and lxml
bolliger32 Aug 11, 2020
f941670
try out elyra
bolliger32 Aug 14, 2020
6f9d40f
bump notebook image
bolliger32 Aug 14, 2020
67197ca
add travis_wait
bolliger32 Aug 14, 2020
70f8ec0
try w/o travis_wait again
bolliger32 Aug 14, 2020
74ade4e
try longer travis_wait
bolliger32 Aug 14, 2020
0767979
try 90 min travis wait
bolliger32 Aug 15, 2020
84d336a
add mypy to nb
Aug 19, 2020
334ed84
bump clawpack commit
Aug 20, 2020
b7050d6
update pin to rm r_env
bolliger32 Aug 23, 2020
0cd3618
add gnuplot for octave and bump packages
bolliger32 Aug 23, 2020
e9c8263
bump blas, dask, and pandas
bolliger32 Aug 26, 2020
c45059d
add jupyterlab spec so that it updates
bolliger32 Aug 26, 2020
bc2eff8
add xarray-extras and esmpy w/ mpi to enable xesmf
bolliger32 Aug 28, 2020
0077149
bump dask, numba, statsmodels, gcs, python build
bolliger32 Aug 29, 2020
b086206
bump clawpack commit
bolliger32 Sep 1, 2020
07fbaaf
bump clawpack commit
bolliger32 Sep 7, 2020
6fab428
rm r env from pin.py
bolliger32 Sep 7, 2020
a853a89
fix elyra tmp setup.py bug
bolliger32 Sep 7, 2020
81b7441
drop elyra for now
bolliger32 Sep 9, 2020
b00f117
try dask-gateway
bolliger32 Sep 8, 2020
0d5f993
drop elyra for now
bolliger32 Sep 8, 2020
37d1511
add lightweight scheduler image for d-g
bolliger32 Sep 9, 2020
518c8e8
set scheduler image too
bolliger32 Sep 9, 2020
5344191
move tini to scheduler image
bolliger32 Sep 9, 2020
9211165
get build args in there
bolliger32 Sep 9, 2020
f189a4b
add dask-kube back for compatibility
bolliger32 Sep 9, 2020
0ec9d67
add worker template back for compat
bolliger32 Sep 9, 2020
e791686
fix gcsfuse auth and drop worker-template
bolliger32 Sep 9, 2020
2c0df18
fix setting of gateway opts
bolliger32 Sep 9, 2020
f75156d
fix copy in notebook/dockerfile
bolliger32 Sep 9, 2020
9d232ef
move lz4 to scheduler
bolliger32 Sep 9, 2020
f5898c6
update rhg_compute_tools to gateway branch
bolliger32 Sep 9, 2020
74a3e5c
1st attempt at dask-gateway version of master
bolliger32 Sep 10, 2020
4a9b012
fix upstream images
bolliger32 Sep 10, 2020
88ca8ad
update rhg_compute_tools w/ dask-gateway
bolliger32 Sep 10, 2020
cfa0dbd
add r env back
bolliger32 Sep 10, 2020
3b89416
drop matio
bolliger32 Sep 10, 2020
4f36bcc
revert octave version
bolliger32 Sep 10, 2020
70d51d4
add tabular data editor
bolliger32 Sep 10, 2020
5e8c8b8
drop clawpack makefile
bolliger32 Sep 10, 2020
86b4d63
drop dask-kubernetes
bolliger32 Sep 10, 2020
d09de67
drop vdatum
bolliger32 Sep 10, 2020
f751bbb
drop ulimit change needed for clawpack
bolliger32 Sep 10, 2020
969b0f1
fix conda to py 3.7
bolliger32 Sep 10, 2020
6d1e121
make scheduler lighter weight w/o common installs
bolliger32 Sep 10, 2020
9204936
fix apt-get in new scheduler dockerfile
bolliger32 Sep 10, 2020
28b2bb7
add ca-certificates back
bolliger32 Sep 10, 2020
c2ffce3
fix scheduler
bolliger32 Sep 10, 2020
4c82d47
drop gcc pin and update compilers package
bolliger32 Sep 10, 2020
929a2b2
add missing r_env file
bolliger32 Sep 10, 2020
687f977
set shell to bash in notebook dockerfile
bolliger32 Sep 10, 2020
3081702
bump gitpython b/c nbdime needs gitdb
bolliger32 Sep 10, 2020
1b99b28
bump jupyterhub
bolliger32 Nov 10, 2020
abc3f97
bump pgks needed for scheduler
bolliger32 Dec 9, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
sudo the serverextension in notebook
  • Loading branch information
bolliger32 committed Jul 14, 2020
commit 1996de1cb7ffbaeaf8320de713853202de33294b
2 changes: 1 addition & 1 deletion notebook/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -71,7 +71,7 @@ RUN jupyter labextension update --all && \
dask-labextension \
jupyterlab-plotly \
plotlywidget && \
jupyter serverextension enable --py jupyterlab_code_formatter --system
sudo jupyter serverextension enable --py jupyterlab_code_formatter --system


## clean up
Expand Down