how to install dependencies when build docker image

[jiangxiaoqiang]

I am using pdm install when build docker image, this is the project docker file look like:

FROM python:3.10

MAINTAINER jiangxiaoqiang ([email protected])

ENV LANG=en_US.UTF-8 \
    LC_ALL=en_US.UTF-8 \
    TZ=Asia/Shanghai

RUN ln -snf /usr/share/zoneinfo/$TZ /etc/localtime \
    && echo $TZ > /etc/timezone \
    && mkdir -p /root/visa \
    && apt-get update -y \
    && apt-get install wget curl -y

RUN pip install pdm
ADD . /root/visa/
WORKDIR /root/visa/
RUN pdm install
ENTRYPOINT exec /root/visa/scripts/startup-app.sh

but it seems did not install the dependencies, when I run the python3.10 main_api.py, shows did not found the dependencies.

ModuleNotFoundError: No module named 'apscheduler'

this is the startup-app.sh look like:

#!/usr/bin/env bash
set -u
set -e
set -x

nohup python3.10 /root/visa/main_api.py > /root/visa/starup.log &

tail -f /root/visa/starup.log

this is the package list:

root@visa-service-5ffdf7697b-gmjq2:~/visa# pdm list
╭────────────────────────────┬──────────────┬──────────╮
│ name                       │ version      │ location │
├────────────────────────────┼──────────────┼──────────┤
│ nh3                        │ 0.2.14       │          │
│ sniffio                    │ 1.3.0        │          │
│ APScheduler                │ 3.10.4       │          │
│ PyExecJS                   │ 1.5.1        │          │
│ beautifulsoup4             │ 4.12.2       │          │
│ frozenlist                 │ 1.3.3        │          │
│ invoke                     │ 2.1.2        │          │
│ idna                       │ 3.4          │          │
│ sbvirtualdisplay           │ 1.3.0        │          │
│ pkginfo                    │ 1.9.6        │          │
│ selenium                   │ 4.15.2       │          │
│ docutils                   │ 0.20.1       │          │
│ websockets                 │ 12.0         │          │
│ Faker                      │ 19.13.0      │          │
│ asynctest                  │ 0.13.0       │          │
│ tls-client                 │ 0.2.1        │          │
│ rd-undetected-chromedriver │ 3.5.6        │          │
│ jeepney                    │ 0.8.0        │          │
│ importlib-metadata         │ 4.13.0       │          │
│ pyparsing                  │ 3.0.9        │          │
│ rfc3986                    │ 2.0.0        │          │
│ bcrypt                     │ 4.0.1        │          │
│ brotlipy                   │ 0.7.0        │          │
│ more-itertools             │ 10.1.0       │          │
│ parse-type                 │ 0.6.2        │          │
│ certifi                    │ 2023.7.22    │          │
│ jaraco.classes             │ 3.3.0        │          │
│ cffi                       │ 1.16.0       │          │
│ fasteners                  │ 0.19         │          │
│ Pygments                   │ 2.16.1       │          │
│ PyMySQL                    │ 1.0.3        │          │
│ paramiko                   │ 3.1.0        │          │
│ markdown-it-py             │ 3.0.0        │          │
│ aiosignal                  │ 1.3.1        │          │
│ behave                     │ 1.2.6        │          │
│ pynose                     │ 1.4.8        │          │
│ httpcore                   │ 0.17.1       │          │
│ fabric                     │ 3.0.1        │          │
│ requests                   │ 2.31.0       │          │
│ trio-websocket             │ 0.11.1       │          │
│ anyio                      │ 3.6.2        │          │
│ jwt                        │ 1.3.1        │          │
│ rdpywheel                  │ 0.1.29       │          │
│ urllib3                    │ 2.1.0        │          │
│ platformdirs               │ 4.0.0        │          │
│ openpyxl                   │ 3.1.2        │          │
│ twine                      │ 4.0.2        │          │
│ redis                      │ 4.5.5        │          │
│ iniconfig                  │ 2.0.0        │          │
│ pytest-ordering            │ 0.6          │          │
│ sortedcontainers           │ 2.4.0        │          │
│ pycurl                     │ 7.45.2       │          │
│ mdurl                      │ 0.1.2        │          │
│ curl-cffi                  │ 0.5.9        │          │
│ tzlocal                    │ 2.1          │          │
│ ndg-httpsclient            │ 0.5.1        │          │
│ webdriver-manager          │ 4.0.1        │          │
│ aiohttp                    │ 3.8.4        │          │
│ pycryptodome               │ 3.19.0       │          │
│ python-dotenv              │ 1.0.0        │          │
│ et-xmlfile                 │ 1.1.0        │          │
│ colorama                   │ 0.4.6        │          │
│ tabcompleter               │ 1.3.0        │          │
│ soupsieve                  │ 2.5          │          │
│ setuptools                 │ 68.2.2       │          │
│ pluggy                     │ 1.3.0        │          │
│ cryptography               │ 40.0.2       │          │
│ parse                      │ 1.19.1       │          │
│ parameterized              │ 0.9.0        │          │
│ outcome                    │ 1.3.0.post0  │          │
│ pyOpenSSL                  │ 23.2.0       │          │
│ multidict                  │ 6.0.4        │          │
│ six                        │ 1.16.0       │          │
│ DBUtils                    │ 3.0.3        │          │
│ pyasn1                     │ 0.5.0        │          │
│ chromedriver-autoinstaller │ 0.6.2        │          │
│ importlib-resources        │ 5.12.0       │          │
│ requests-toolbelt          │ 1.0.0        │          │
│ py                         │ 1.11.0       │          │
│ SecretStorage              │ 3.3.3        │          │
│ fake-useragent             │ 1.3.0        │          │
│ pyotp                      │ 2.9.0        │          │
│ fake                       │ 0.8          │          │
│ hpack                      │ 4.0.0        │          │
│ trio                       │ 0.23.1       │          │
│ rich                       │ 13.7.0       │          │
│ cssselect                  │ 1.2.0        │          │
│ pycparser                  │ 2.21         │          │
│ pytest                     │ 7.4.3        │          │
│ execnet                    │ 2.0.2        │          │
│ Brotli                     │ 1.0.9        │          │
│ exceptiongroup             │ 1.1.3        │          │
│ zipp                       │ 3.17.0       │          │
│ rsa                        │ 4.8          │          │
│ PyNaCl                     │ 1.5.0        │          │
│ python-dateutil            │ 2.8.2        │          │
│ numpy                      │ 1.26.1       │          │
│ filelock                   │ 3.13.1       │          │
│ attrs                      │ 23.1.0       │          │
│ h11                        │ 0.14.0       │          │
│ chardet                    │ 5.2.0        │          │
│ pytest-rerunfailures       │ 12.0         │          │
│ keyring                    │ 24.3.0       │          │
│ pytest-html                │ 2.0.1        │          │
│ packaging                  │ 23.2         │          │
│ async-timeout              │ 4.0.2        │          │
│ typing_extensions          │ 4.5.0        │          │
│ yarl                       │ 1.9.2        │          │
│ pytest-metadata            │ 3.0.0        │          │
│ wheel                      │ 0.41.3       │          │
│ smsactivate                │ 1.5          │          │
│ pytz                       │ 2023.3.post1 │          │
│ cached-property            │ 1.5.2        │          │
│ readme-renderer            │ 42.0         │          │
│ httpx                      │ 0.24.0       │          │
│ pytest-xdist               │ 3.4.0        │          │
│ charset-normalizer         │ 3.3.2        │          │
│ haralyzer                  │ 2.2.0        │          │
│ pip                        │ 23.3.1       │          │
│ wsproto                    │ 1.2.0        │          │
│ pdbp                       │ 1.5.0        │          │
│ PySocks                    │ 1.7.1        │          │
│ seleniumbase               │ 4.21.4       │          │
│ tomli                      │ 2.0.1        │          │
│ xlrd                       │ 2.0.1        │          │
│ PyJWT                      │ 2.8.0        │          │
╰────────────────────────────┴──────────────┴──────────╯

[pawamoy]

Try:

nohup pdm run python3.10 /root/visa/main_api.py > /root/visa/starup.log &

[jiangxiaoqiang]

seems fixed the package did not found issue, but why the process exit automatically? the main_api.py should run in the loop and never exists. Am I missing something? when I tried to run in local machine like this python3.10 main_api.py it shows log:

~/source/visa on  develop! ⌚ 1:54:35
$ python3.10 main_api.py                                                                                                                             ‹ruby-2.7.2›
select * from account_info where token_exp < 1700416480005 and cf_captcha_update_time > 1700416420005 and blocked = 0 limit 1
select * from account_info where token_exp < 1700416485001 and cf_captcha_update_time > 1700416425001 and blocked = 0 limit 1

when I run in server, shows:

root@visa-service-5ffdf7697b-gmjq2:~/visa# nohup pdm run python3.10 /root/visa/main_api.py > /root/visa/starup.log &
[1] 81
root@visa-service-5ffdf7697b-gmjq2:~/visa# nohup: ignoring input and redirecting stderr to stdout

root@visa-service-5ffdf7697b-gmjq2:~/visa#
root@visa-service-5ffdf7697b-gmjq2:~/visa# ps
  PID TTY          TIME CMD
    8 pts/0    00:00:00 bash
   92 pts/0    00:00:00 ps
[1]+  Exit 247                nohup pdm run python3.10 /root/visa/main_api.py > /root/visa/starup.log
root@visa-service-5ffdf7697b-gmjq2:~/visa# pdm run python3.10 /root/visa/main_api.py
root@visa-service-5ffdf7697b-gmjq2:~/visa#

[pawamoy]

Without seeing your code, we cannot guess why the behavior differs :/

If you don't want to use pdm run python instead of python directly, you must make sure your dependencies are available in the current environment. You can either:

• activate PDM's venv
• add __pypackages__/3.10/lib to PYTHONPATH
• use a multi stage build as described in the docs

[jiangxiaoqiang]

I finally found why the action difference becuase I am run the process in kubernetes pod, the resource limit is to small that make the operation system killled the process automatically. the OOM killer. your answer is correct and works.