Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove curv, curvrank2, finfindr #277

Merged
merged 33 commits into from
May 30, 2024
Merged
Show file tree
Hide file tree
Changes from 28 commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
5720915
Update docker-publish.yaml
tsubramanian May 16, 2024
9f7a4c7
Update Dockerfile
tsubramanian May 16, 2024
9307ce0
Update install.ubuntu.sh
tsubramanian May 17, 2024
cc78342
Update Dockerfile
tsubramanian May 17, 2024
cf1f133
Update Dockerfile
tsubramanian May 17, 2024
5edc0fc
Update build.txt
tsubramanian May 18, 2024
98e4de2
Update deprecated.sh
tsubramanian May 18, 2024
fef56e0
Update deprecated.sh
tsubramanian May 18, 2024
5360508
Update build.txt
tsubramanian May 18, 2024
32e7861
Update build.txt
tsubramanian May 18, 2024
26be544
Update Dockerfile
tsubramanian May 18, 2024
b1c3953
Update build.txt
tsubramanian May 18, 2024
6b2e740
Update build.txt
tsubramanian May 18, 2024
c9ffb3d
Update build.txt
tsubramanian May 18, 2024
4eaea17
Update install.ubuntu.sh
tsubramanian May 18, 2024
bf24f8e
Update deprecated.sh
tsubramanian May 18, 2024
f3ac067
Update Dockerfile
tsubramanian May 18, 2024
db24d08
Update Dockerfile
tsubramanian May 18, 2024
af3e8bf
Update Dockerfile
tsubramanian May 18, 2024
8a42490
Update Dockerfile
tsubramanian May 18, 2024
93dc400
Update build.txt
tsubramanian May 20, 2024
f2c4d65
Update install.ubuntu.sh
tsubramanian May 20, 2024
00bb5fd
Update build.txt
tsubramanian May 20, 2024
9ff3bf5
Update install.ubuntu.sh
tsubramanian May 20, 2024
9359b35
Update _sql_helpers.py
tsubramanian May 20, 2024
a89b6ba
Update _sql_helpers.py
tsubramanian May 20, 2024
74ddf69
Update docker-publish.yaml
tsubramanian May 20, 2024
4418761
Merge branch 'main' into Remove_CurvRank2_FinFindr
tsubramanian May 22, 2024
568ad92
Update Dockerfile
tsubramanian May 28, 2024
db73f67
Update install.ubuntu.sh
tsubramanian May 28, 2024
b3b183d
Update Dockerfile
tsubramanian May 28, 2024
a01567f
Update docker-publish.yaml
tsubramanian May 28, 2024
bd6a271
Update docker-publish.yaml
tsubramanian May 28, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
16 changes: 10 additions & 6 deletions devops/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -3,16 +3,17 @@ ARG WBIA_BASE_IMAGE=wildme/wbia-base:latest
ARG WBIA_PROVISION_IMAGE=wildme/wbia-provision:latest

FROM ${WBIA_PROVISION_IMAGE} as org.wildme.wbia.latest
# && cd /wbia/wbia-plugin-curvrank/wbia_curvrank_v2 \
# && git reset --hard origin/main \
# && git pull \

# Grab latest code
RUN set -ex \
&& git config --global user.email "[email protected]" \
&& git config --global user.name "Wild Me" \
&& find /wbia/wbia* -name '.git' -type d -print0 | xargs -0 -i /bin/bash -c \
'cd {} && cd .. && echo $(pwd) && git reset --hard origin/main && git pull' \
&& cd /wbia/wbia-plugin-curvrank/wbia_curvrank_v2 \
&& git reset --hard origin/main \
&& git pull \

&& cd /wbia/wbia-plugin-kaggle7/wbia_kaggle7 \
&& git reset --hard origin/main \
&& git pull \
Expand Down Expand Up @@ -138,6 +139,11 @@ RUN set -ex \
# && /virtualenv/env3/bin/python -c "import wbia; from wbia.__main__ import smoke_test; smoke_test()" \
# && /virtualenv/env3/bin/python -c "import wbia_flukematch; from wbia_flukematch.plugin import *" \ -- commented out due to Lasagne package dependency issues
# && /virtualenv/env3/bin/python -c "import wbia_finfindr; from wbia_finfindr.__main__ import main; main()" \
# && /virtualenv/env3/bin/python -c "import wbia_curvrank_v2; from wbia_curvrank_v2._plugin import *" \
#&& /virtualenv/env3/bin/python -c "import wbia_finfindr; from wbia_finfindr._plugin import *" \
# && /virtualenv/env3/bin/python -c "import wbia_whaleridgefindr; from wbia_whaleridgefindr._plugin import *" \


RUN set -ex \
&& mkdir -p /data \
&& /virtualenv/env3/bin/python -m wbia.dev --set-workdir /data --preload-exit \
Expand All @@ -146,9 +152,7 @@ RUN set -ex \
&& /virtualenv/env3/bin/python -c "import wbia_pie_v2; from wbia_pie_v2.__main__ import main; main()" \
&& /virtualenv/env3/bin/python -c "import wbia_blend; from wbia_blend._plugin import *" \
&& /virtualenv/env3/bin/python -c "import wbia_orientation; from wbia_orientation.__main__ import main; main()" \
&& /virtualenv/env3/bin/python -c "import wbia_curvrank_v2; from wbia_curvrank_v2._plugin import *" \
&& /virtualenv/env3/bin/python -c "import wbia_finfindr; from wbia_finfindr._plugin import *" \
&& /virtualenv/env3/bin/python -c "import wbia_whaleridgefindr; from wbia_whaleridgefindr._plugin import *" \

&& /virtualenv/env3/bin/python -c "import wbia_kaggle7; from wbia_kaggle7._plugin import *" \
&& /virtualenv/env3/bin/python -c "import wbia_lca; from wbia_lca._plugin import *" \
&& /virtualenv/env3/bin/python -c "import wbia_deepsense; from wbia_deepsense._plugin import *" \
Expand Down
7 changes: 4 additions & 3 deletions devops/base/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -123,12 +123,13 @@ RUN set -ex \
RUN set -ex \
&& /virtualenv/env3/bin/pip install --upgrade \
pip \
&& /virtualenv/env3/bin/pip install --upgrade \
&& /virtualenv/env3/bin/pip install setuptools==59.5.0 \
&& /virtualenv/env3/bin/pip install --upgrade \
# Install build requirements
cmake \
ninja \
scikit-build \
setuptools \
setuptools==59.5.0 \
scikit-build \
setuptools_scm[toml] \
cython \
# Install handy developer tools
Expand Down
1 change: 1 addition & 0 deletions devops/develop/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@ RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
&& pip uninstall -y wildbook-ia \
&& cd /wbia/wildbook-ia \
&& /bin/bash run_developer_setup.sh \
&& pip install --upgrade pip setuptools-scm \
&& pip install --no-cache-dir -r /wbia/wildbook-ia/requirements/tests.txt \
&& pip install --no-cache-dir -r /wbia/wildbook-ia/requirements/runtime.txt \
&& pip install --no-cache-dir -r /wbia/wildbook-ia/requirements/postgres.txt \
Expand Down
36 changes: 18 additions & 18 deletions devops/install.ubuntu.sh
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@ pip install --no-cache-dir --upgrade \
'cmake!=3.18.2' \
ninja \
scikit-build \
'setuptools>=42' \
'setuptools==59.5.0' \
'setuptools_scm[toml]>=3.4' \
cython==3.0.0 \
numpy \
Expand Down Expand Up @@ -192,17 +192,17 @@ git clone --branch develop https://github.com/WildMeOrg/wbia-deprecate-tpl-bramb
git clone --branch develop https://github.com/WildMeOrg/wbia-deprecate-tpl-lightnet
git clone --recursive --branch develop https://github.com/WildMeOrg/wbia-plugin-cnn.git
git clone --branch develop https://github.com/WildMeOrg/wbia-plugin-flukematch.git
git clone --branch develop https://github.com/WildMeOrg/wbia-plugin-finfindr.git
#git clone --branch develop https://github.com/WildMeOrg/wbia-plugin-finfindr.git
git clone --branch develop https://github.com/WildMeOrg/wbia-plugin-deepsense.git
git clone --branch develop https://github.com/WildMeOrg/wbia-plugin-whaleridgefindr.git
#git clone --branch develop https://github.com/WildMeOrg/wbia-plugin-whaleridgefindr.git
git clone --branch develop https://github.com/WildMeOrg/wbia-plugin-pie.git
git clone https://github.com/WildMeOrg/wbia-plugin-blend.git

cd ${CODE}
git clone --recursive --branch develop https://github.com/WildMeOrg/wbia-plugin-curvrank.git
cd wbia-plugin-curvrank/wbia_curvrank
git fetch origin
git checkout develop
#cd ${CODE}
#git clone --recursive --branch develop https://github.com/WildMeOrg/wbia-plugin-curvrank.git
#cd wbia-plugin-curvrank/wbia_curvrank
#git fetch origin
#git checkout develop

cd ${CODE}
git clone --recursive --branch develop https://github.com/WildMeOrg/wbia-plugin-kaggle7.git
Expand Down Expand Up @@ -250,11 +250,11 @@ cd ${CODE}/wbia-plugin-pie
cd ${CODE}/wbia-plugin-blend
pip install --no-cache-dir -e .

cd ${CODE}/wbia-plugin-finfindr
pip install --no-cache-dir -e .
#cd ${CODE}/wbia-plugin-finfindr
#pip install --no-cache-dir -e .

cd ${CODE}/wbia-plugin-whaleridgefindr
pip install --no-cache-dir -e .
#cd ${CODE}/wbia-plugin-whaleridgefindr
#pip install --no-cache-dir -e .

cd ${CODE}/wbia-plugin-deepsense
pip install --no-cache-dir -e .
Expand All @@ -269,9 +269,9 @@ cd ${CODE}/wbia-plugin-flukematch
./unix_build.sh
pip install --no-cache-dir -e .

cd ${CODE}/wbia-plugin-curvrank
./unix_build.sh
pip install --no-cache-dir -e .
#cd ${CODE}/wbia-plugin-curvrank
#./unix_build.sh
#pip install --no-cache-dir -e .

pip uninstall -y \
opencv-python \
Expand Down Expand Up @@ -316,9 +316,9 @@ python -c "import wbia_cnn; from wbia_cnn.__main__ import main; main()"
python -c "import wbia_pie; from wbia_pie.__main__ import main; main()"
python -c "import wbia_blend; from wbia_blend._plugin import *"
python -c "import wbia_flukematch; from wbia_flukematch.plugin import *"
python -c "import wbia_curvrank; from wbia_curvrank._plugin import *"
python -c "import wbia_finfindr; from wbia_finfindr._plugin import *"
python -c "import wbia_whaleridgefindr; from wbia_whaleridgefindr._plugin import *"
#python -c "import wbia_curvrank; from wbia_curvrank._plugin import *"
#python -c "import wbia_finfindr; from wbia_finfindr._plugin import *"
#python -c "import wbia_whaleridgefindr; from wbia_whaleridgefindr._plugin import *"
python -c "import wbia_kaggle7; from wbia_kaggle7._plugin import *"
python -c "import wbia_deepsense; from wbia_deepsense._plugin import *"

Expand Down
38 changes: 19 additions & 19 deletions devops/provision/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -37,11 +37,11 @@ RUN set -ex \
&& cd /wbia \
&& git clone https://github.com/WildMeOrg/wbia-plugin-orientation.git \
&& git clone https://github.com/WildMeOrg/wbia-plugin-flukematch.git \
&& git clone https://github.com/WildMeOrg/wbia-plugin-finfindr.git \
#&& git clone https://github.com/WildMeOrg/wbia-plugin-finfindr.git \
&& git clone https://github.com/WildMeOrg/wbia-plugin-deepsense.git \
&& git clone https://github.com/WildMeOrg/wbia-plugin-pie-v2.git \
&& git clone https://github.com/WildMeOrg/wbia-plugin-miew-id.git \
&& git clone https://github.com/WildMeOrg/wbia-plugin-whaleridgefindr.git
&& git clone https://github.com/WildMeOrg/wbia-plugin-miew-id.git
#&& git clone https://github.com/WildMeOrg/wbia-plugin-whaleridgefindr.git

RUN set -ex \
&& cd /wbia \
Expand All @@ -51,12 +51,12 @@ RUN set -ex \
&& git checkout main

# Clone third-party WBIA plug-in repositories
RUN set -ex \
&& cd /wbia \
&& git clone --recursive https://github.com/WildMeOrg/wbia-plugin-curvrank.git \
&& cd /wbia/wbia-plugin-curvrank/wbia_curvrank_v2 \
&& git fetch origin \
&& git checkout main
#RUN set -ex \
# && cd /wbia \
# && git clone --recursive https://github.com/WildMeOrg/wbia-plugin-curvrank.git \
# && cd /wbia/wbia-plugin-curvrank/wbia_curvrank_v2 \
# && git fetch origin \
# && git checkout main

RUN set -ex \
&& cd /wbia \
Expand Down Expand Up @@ -128,13 +128,13 @@ RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
&& cd /wbia/wbia-plugin-blend \
&& pip install --no-cache-dir -e .'

RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
&& cd /wbia/wbia-plugin-finfindr \
&& pip install --no-cache-dir -e .'
#RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
# && cd /wbia/wbia-plugin-finfindr \
# && pip install --no-cache-dir -e .'

RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
&& cd /wbia/wbia-plugin-whaleridgefindr \
&& pip install --no-cache-dir -e .'
#RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
#&& cd /wbia/wbia-plugin-whaleridgefindr \
#&& pip install --no-cache-dir -e .'

RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
&& cd /wbia/wbia-plugin-deepsense \
Expand All @@ -157,10 +157,10 @@ RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
&& ./unix_build.sh \
&& pip install --no-cache-dir -e .'

RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
&& cd /wbia/wbia-plugin-curvrank \
&& ./unix_build.sh \
&& pip install --no-cache-dir -e .'
#RUN /bin/bash -xc '. /virtualenv/env3/bin/activate \
# && cd /wbia/wbia-plugin-curvrank \
# && ./unix_build.sh \
# && pip install --no-cache-dir -e .'

# Ensure no previous or deprecated repositories are installed
# Ensure that opencv-python is un-installed since we want to use our built version
Expand Down
1 change: 0 additions & 1 deletion requirements/build.txt
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,5 @@ cmake==3.25.2
ninja==1.11.1
fairseq==0.12.2
setuptools==59.5.0
setuptools_scm[toml]==6.3.2
wheel==0.38.4
pyhesaff==2.1.1
5 changes: 4 additions & 1 deletion wbia/control/_sql_helpers.py
Original file line number Diff line number Diff line change
Expand Up @@ -18,7 +18,10 @@ def version_check():
r"""
duct tape function to avoid the setup tools version issues
"""
print("setuptools version:", setuptools.__version__)
try:
print("setuptools version:", setuptools.__version__)
except Exception as ex:
print("setuptools version - no able to fetch version", ex.message, ex.args)


def compare_string_versions(a, b):
Expand Down
Loading