Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Development Branch #193

Open
wants to merge 65 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
65 commits
Select commit Hold shift + click to select a range
303d9e7
adding workbench test
mwang87 May 14, 2022
dccf8b8
adding more parsing
mwang87 Jul 25, 2022
6f5762e
formatting
mwang87 Jul 25, 2022
3e2e0bd
fixing the port
mwang87 Oct 23, 2022
bf8d8a4
adding automated builds
mwang87 Nov 11, 2022
f134587
upgrading base
mwang87 Nov 11, 2022
e070ba4
Merge pull request #189 from mwang87/nginx-migrate
mwang87 Nov 11, 2022
eaf2238
Merge pull request #191 from mwang87/upgrade
mwang87 Nov 14, 2022
d8cbd08
updating versions of packages
mwang87 Nov 14, 2022
ac1fec8
updating building
mwang87 Nov 14, 2022
7400d5f
using mambda
mwang87 Nov 14, 2022
b32683b
pinning version of spectrum_utils
mwang87 Nov 15, 2022
0e51802
limiting dns
mwang87 Nov 15, 2022
9bf43bb
Merge pull request #192 from mwang87/upgrade
mwang87 Dec 14, 2022
92c0298
fixing build
mwang87 Dec 14, 2022
c0a15f3
adding a todo
mwang87 Dec 14, 2022
0964a57
updating affiliation
mwang87 Dec 14, 2022
3bdeb98
adding more links
mwang87 Dec 22, 2022
43a52ba
updating
mwang87 Dec 22, 2022
dd4e205
small comments
mwang87 Dec 22, 2022
5a2b592
Merge pull request #195 from mwang87/gnps2
mwang87 Dec 22, 2022
1641d12
cleanup
mwang87 Dec 22, 2022
0821706
updating parsing
mwang87 Feb 8, 2023
96830cd
Merge pull request #196 from mwang87/tinymass-support
mwang87 Feb 8, 2023
f5e1968
fixing parsing for gnps2
mwang87 Mar 1, 2023
112585f
Merge pull request #197 from mwang87/tinymass-support
mwang87 Mar 1, 2023
f64d223
adding analytics
mwang87 Aug 9, 2023
6a4119e
udpating links
mwang87 Aug 9, 2023
1c37556
increasing scaling for workers
mwang87 Aug 23, 2023
4d7d1cd
increasing scaling for workers
mwang87 Aug 23, 2023
bed45ea
adding another dependency
mwang87 Sep 18, 2023
a30e82c
updating restart policy
mwang87 Sep 19, 2023
1074825
bug fix
mwang87 Sep 19, 2023
b8850d5
using a cache layer for gnps library spectrum
mwang87 Oct 20, 2023
cf15c16
adding robot
mwang87 Apr 9, 2024
3107702
adding a template for the domain name resolution
mwang87 Apr 16, 2024
dfc8755
updating parsing
mwang87 May 30, 2024
390096f
Merge pull request #200 from mwang87/fix-px-resolution
mwang87 May 30, 2024
e1c1948
limiting logging
mwang87 Jul 17, 2024
700b88a
support for metabolights
mwang87 Sep 14, 2024
4374cf9
bug fix for parsing
mwang87 Sep 16, 2024
807d13b
updating examples
mwang87 Sep 16, 2024
9cfe35e
cleanup
mwang87 Sep 17, 2024
b1a1606
Merge pull request #201 from mwang87/metabolomics-repos
mwang87 Sep 17, 2024
a809c5c
using valkey
mwang87 Sep 26, 2024
7956e23
multiple gnps2 servers
mwang87 Oct 9, 2024
3e771d3
using redis
mwang87 Oct 9, 2024
a3bf504
Recreate.
Michael-C-Strobel Dec 2, 2024
01fcd6e
Merge pull request #203 from Michael-C-Strobel/dev
mwang87 Dec 2, 2024
6b278cf
Update parsing.py
mwang87 Dec 3, 2024
154fcb6
Try that again.
Michael-C-Strobel Jan 23, 2025
4bd7be5
Try that again.
Michael-C-Strobel Jan 23, 2025
42dfead
Merge pull request #206 from Michael-C-Strobel/Unicode-Fix
mwang87 Jan 27, 2025
0860f6f
massbankEU/MONA
YasinEl Jan 31, 2025
7ea9269
Commenting and refactoring.
Michael-C-Strobel Jan 31, 2025
752777c
Implement MassBank decision point.
Michael-C-Strobel Jan 31, 2025
d3f7ae6
Strip whitespace.
Michael-C-Strobel Jan 31, 2025
d9f1bab
Remove todos.
Michael-C-Strobel Jan 31, 2025
f4b1e78
Update linkout for MoNA.
Michael-C-Strobel Jan 31, 2025
3d0695e
Update linkout.
Michael-C-Strobel Jan 31, 2025
c5bbe35
Merge pull request #207 from YasinEl/dev
mwang87 Feb 1, 2025
f25c3e2
Update parsing.py
meier-rene Feb 10, 2025
d267e5f
Merge pull request #208 from meier-rene/patch-1
mwang87 Feb 11, 2025
ac90007
udpating parsing
mwang87 Mar 5, 2025
2d09480
Merge pull request #209 from mwang87/fallback-massive
mwang87 Mar 6, 2025
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions .env_template
Original file line number Diff line number Diff line change
@@ -0,0 +1 @@
HOSTNAME=de.metabolomics-usi.gnps2.org
29 changes: 29 additions & 0 deletions .github/workflows/build.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,29 @@
name: Docker Build Test

on:
push:
branches:
master
pull_request:
branches:
master
schedule:
- cron: '0 0 * * 1'

jobs:
build-test:
runs-on: ubuntu-latest
strategy:
max-parallel: 4
matrix:
python-version: [3.8]
# TODO: We probably should switch to using the Docker version.
steps:
- uses: actions/checkout@v2
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v2
with:
python-version: ${{ matrix.python-version }}
- name: Build Docker
run: |
docker build .
16 changes: 11 additions & 5 deletions Dockerfile
Original file line number Diff line number Diff line change
@@ -1,14 +1,20 @@
FROM continuumio/miniconda3:4.8.2
FROM continuumio/miniconda3:4.10.3
MAINTAINER Mingxun Wang "[email protected]"

WORKDIR /app
RUN apt-get update -y && \
apt-get install -y libxrender-dev && \
apt-get install -y git-core
RUN conda create -y -n usi -c conda-forge -c bioconda -c defaults celery \
apt-get install -y git-core libarchive-dev
RUN conda install -c conda-forge mamba
RUN mamba create -y -n usi -c conda-forge -c bioconda -c defaults celery==5.3.6 \
dash=1.20.0 dash-bootstrap-components=0.9.2 flask gunicorn \
joblib matplotlib numba numpy openssl qrcode rdkit requests \
requests-cache scipy spectrum_utils werkzeug
joblib matplotlib==3.6.3 numba numpy openssl qrcode rdkit requests \
requests-cache scipy spectrum_utils==0.3.5 werkzeug==2.0.0

# install redis with pypi
RUN /bin/bash -c 'source activate usi && pip install redis'

# installing hash
RUN /bin/bash -c 'source activate usi && pip install "git+https://github.com/berlinguyinca/spectra-hash.git#subdirectory=python" && pip install celery-once'

RUN echo "source activate usi" > ~/.bashrc
Expand Down
12 changes: 6 additions & 6 deletions Makefile
Original file line number Diff line number Diff line change
Expand Up @@ -23,19 +23,19 @@ clear-cache:

#Docker Compose
server-compose-interactive:
docker-compose build
docker-compose up
docker-compose --compatibility build
docker-compose --compatibility up

server-compose:
docker-compose build
docker-compose up -d
docker-compose --compatibility build
docker-compose --compatibility up -d

server-compose-production-interactive:
docker-compose build
docker-compose --compatibility build
docker-compose -f docker-compose.yml -f docker-compose-production.yml --compatibility up

server-compose-production:
docker-compose build
docker-compose --compatibility build
docker-compose -f docker-compose.yml -f docker-compose-production.yml --compatibility up -d

attach:
Expand Down
23 changes: 19 additions & 4 deletions docker-compose-production.yml
Original file line number Diff line number Diff line change
Expand Up @@ -5,29 +5,44 @@ services:
- default
- nginx-net
environment:
VIRTUAL_HOST: metabolomics-usi.ucsd.edu,metabolomics-usi.gnps2.org
VIRTUAL_PORT: 5087
LETSENCRYPT_HOST: metabolomics-usi.ucsd.edu,metabolomics-usi.gnps2.org
VIRTUAL_HOST: ${HOSTNAME:-metabolomics-usi.gnps2.org}
VIRTUAL_PORT: 5000
LETSENCRYPT_HOST: ${HOSTNAME:-metabolomics-usi.gnps2.org}
LETSENCRYPT_EMAIL: [email protected]
command: /app/run_server.sh
deploy:
resources:
limits:
memory: 16000M
logging:
driver: "json-file"
options:
max-size: "10m"
max-file: "3"

metabolomicsusi-worker:
deploy:
resources:
limits:
memory: 16000M
logging:
driver: "json-file"
options:
max-size: "10m"
max-file: "3"

metabolomicsusi-redis:
deploy:
resources:
limits:
memory: 4000M
logging:
driver: "json-file"
options:
max-size: "10m"
max-file: "3"

networks:
nginx-net:
external:
name: nginx-net
name: nginx-net
9 changes: 5 additions & 4 deletions docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ services:
- ./logs/:/app/logs:rw
networks:
- default
restart: on-failure
restart: always
command: /app/run_dev_server.sh

metabolomicsusi-worker:
Expand All @@ -24,7 +24,7 @@ services:
- ./tmp:/app/tmp:rw
- ./logs:/app/logs:rw
command: /app/run_worker.sh
restart: on-failure
restart: always
depends_on:
- metabolomicsusi-redis
networks:
Expand All @@ -33,10 +33,11 @@ services:

metabolomicsusi-redis:
container_name: metabolomicsusi-redis
image: redis
#image: valkey/valkey:alpine3.20
image: redis:alpine
networks:
- default
restart: on-failure
restart: always

networks:
nginx-net:
Expand Down
8 changes: 5 additions & 3 deletions metabolomics_spectrum_resolver/dashinterface.py
Original file line number Diff line number Diff line change
Expand Up @@ -39,6 +39,8 @@

gtag('config', 'UA-8412213-8');
</script>

<script async defer data-website-id="ce3d7d73-8edf-480d-83f6-5c3eab60deac" src="https://analytics.gnps2.org/umami.js"></script>

{%metas%}
<title>{%title%}</title>
Expand All @@ -59,10 +61,10 @@
children=[
dbc.NavbarBrand(
html.Img(
src="https://gnps-cytoscape.ucsd.edu/static/img/GNPS_logo.png",
src="https://gnps2.org/static/img/logo.png",
width="120px",
),
href="https://gnps.ucsd.edu",
href="https://gnps2.org",
),
dbc.Nav(
[
Expand Down Expand Up @@ -426,7 +428,7 @@
dbc.CardHeader(html.H5("Contributors")),
dbc.CardBody(
[
"Mingxun Wang, PhD – UC San Diego",
"Mingxun Wang, PhD – UC Riverside",
html.Br(),
"Wout Bittremieux, PhD – UC San Diego",
html.Br(),
Expand Down
Loading
Loading