Enabling multi engine manager in Docker #545
Conversation
| @@ -28,6 +31,10 @@ RUN <<EOR | |||
| mkdir ${ALLTALK_DIR}/pip_cache | |||
| pip install --no-cache-dir --cache-dir=${ALLTALK_DIR}/pip_cache -r system/requirements/requirements_standalone.txt | |||
| pip install --no-cache-dir --cache-dir=${ALLTALK_DIR}/pip_cache --upgrade gradio==4.32.2 | |||
|
|
|||
| # By default, version 1.9.10 is used causing this warning on startup: 'FutureWarning: `torch.cuda.amp.autocast(args...)` is deprecated' | |||
| pip install --no-cache-dir --cache-dir=${ALLTALK_DIR}/pip_cache local-attention==1.11.1 | |||
There was a problem hiding this comment.
I did not want to add this dependency to requirements_standalone.txt since I was not sure whether it has a negative impact on the non-Docker setup.
| __this_dir = Path(__file__).parent.resolve() | ||
|
|
||
| def __init__(self, config_path: Path | str = os.path.join(__this_dir, "mem_config.json")): | ||
| super().__init__(config_path, 0) |
There was a problem hiding this comment.
2nd argument is zero, which means that the config file is not watched for modifications for now.
| RVC_VOICES="$2" | ||
| shift | ||
| ;; | ||
| --no_ui) | ||
| --no-ui) |
There was a problem hiding this comment.
I allowed myself to change the arguments, hoping that the script is not yet very much in use. v2 is still beta, so I hope this is fine.
| @@ -0,0 +1,18 @@ | |||
| { | |||
There was a problem hiding this comment.
I added the JSON for MEM to the repo like it is done for confignew.json.
| @@ -1,5 +1,7 @@ | |||
| coqui-tts==0.24.3 | |||
| filelock>=3.13.4 | |||
| flask[async]==3.1.0 | |||
| flask-cors==5.0.1 | |||
There was a problem hiding this comment.
MEM dynamically installed flask dependencies. I assumed it is fine to add those dependencies to requirements_standalone.txt. Let me know if this is a problem for you.
| @@ -115,52 +76,14 @@ def ensure_flask_dependencies(): | |||
| # Global variable to hold the monitor thread | |||
| stop_monitor = threading.Event() | |||
| monitor = None | |||
| WITH_UI = os.getenv("WITH_UI", True).lower() == 'true' | |||
There was a problem hiding this comment.
Reading from an env variable whether the UI is needed. Defaults to true.
Adding multi engine manager (MEM) to Docker.
Please check the comments to be sure this PR is in-line with what you are aiming for.