Possible to alter dependencies of git sources?

[in03]

Hi all,

I've got a project I'm working on that depends on Open AI's Whisper. Currently it's only installable as a git source. It depends on PyTorch, but to run it with cuda I need to install the cuda version of PyTorch.

When I add whisper, it correctly resolves torch as a dependency.

pdm add git+https://github.com/openai/whisper.git

...

  ✔ Install whisper 1.0 successful
  ✔ Install torch 1.12.1 successful

but they're not officially listed in the pyproject.toml file:

dependencies = [
    "whisper @ git+https://github.com/openai/whisper.git",
    "typer[all]>=0.6.1",
    "deepdiff>=6.2.1",
    "ruamel.yaml>=0.17.21",
    "yaspin>=2.2.0",
    "schema>=0.7.5",
    "tqdm>=4.64.1",
    "pydavinci @ git+https://github.com/in03/pydavinci",
    "pyfiglet>=0.8.post1",
    "requests>=2.28.1",
    "numpy>=1.23.4",
    "transformers>=4.23.1",
    "more-itertools>=9.0.0",
    "setuptools>=65.5.0",
    "notify-py>=0.3.2",
    "commonregex>=1.5.4",
]

If I try to remove torch so I can install the cuda version,
it tells me that it does not exist.

(.venv) PS C:\Users\Caleb\test> pdm remove torch
Removing packages from default dependencies: torch
[ProjectError]: torch does not exist in default dependencies.

Any suggestions? I'd like this to be easily installed by others without having to do the requirements.txt dance. I was thinking of doing a runtime check for cuda support and then using the virtualenv's pip to handle installing it, but it looks like PDM generated virtualenvs don't ship with pip?

(.venv) PS C:\Users\Caleb\test> py -m pip remove torch
C:\Users\Caleb\Documents\Programming\local\squawk\.venv\Scripts\python.exe: No module named pip

[frostming]

Using overrides should do the trick:

[tool.pdm.overrides]
torch = "https://download.pytorch.org/whl/cu102/torch-1.12.1%2Bcu102-cp39-cp39-linux_x86_64.whl"

Or, if you want PDM to resolve corresponding wheels for different python versions or platforms, you can do this:

[[tool.pdm.source]]
url = "https://download.pytorch.org/whl/cu116"
verify_ssl = true
name = "pytorch"

[tool.pdm.overrides]
torch = "1.12.1+cu116"

[in03]

Thanks @frostming! That second one is what I was after.
It took an awful long time to resolve about 20 mins at 90mbps. but I guess it's having to download multiple variants of PyTorch?

Also another question if you don't mind:
Is it possible to make the override conditional by making it an optional dependency? Like pip's extras?
That way I can support users who desire CUDA support and leave the installation as is for those who don't need it.

Something to allow this for end user:

pipx install my-application # CPU version

or

pipx install my-application[cuda] # CUDA version