0.10.5

Lambda

The Lambda Cloud integration has significantly improved with this release. We've added the possibility to create Lambda Cloud projects via the user interface.

All you need to do is provide your Lambda Cloud API key and specify an S3 bucket and AWS credentials for storing state and artifacts.
Check the docs for more details.

Custom Docker images

By default, dstack uses its own base Docker images to run dev environments and tasks. These base images come pre-configured with Python, Conda, and essential CUDA drivers. However, there may be times when you need additional dependencies that you don't want to install every time you run your dev environment or task.

To address this, dstack now allows specifying custom Docker images. Here's an example:

type: task

image: ghcr.io/huggingface/text-generation-inference:0.9

env:
  - MODEL_ID=tiiuae/falcon-7b

ports:
 - 3000

commands: 
  - text-generation-launcher --hostname 0.0.0.0 --port 3000 --trust-remote-code

Note
Dev environments require the Docker image to have openssh-server pre-installed.

What's Changed

• Refactor providers, add custom docker images support by @Egor-S in #544
• Use nvidia docker runtime for build if available by @Egor-S in #552
• Allow env variables interpolation by @Egor-S in #553
• Display docker pull progress by @Egor-S in #554
• Handle backend creds becoming invalid by @r4victor in #556
• Add PATH to .profile by @Egor-S in #557
• Close #529 Supported lambda backend type in UI by @olgenn in #558
• #529 Fixed labels by @olgenn in #560
• 529 fixes after review by @olgenn in #562

Changelog: 0.10.4...0.10.5