From 1bbfef60dcd3e1905167a74c2c76f991a4a95319 Mon Sep 17 00:00:00 2001 From: Benedikt Rollik Date: Mon, 10 Feb 2025 17:38:12 +0100 Subject: [PATCH 1/4] feat(ai): byom --- menu/navigation.json | 4 ++ .../how-to/import-custom-model.mdx | 44 +++++++++++++++++++ 2 files changed, 48 insertions(+) create mode 100644 pages/managed-inference/how-to/import-custom-model.mdx diff --git a/menu/navigation.json b/menu/navigation.json index f4f4a68a1d..d922e6bfd6 100644 --- a/menu/navigation.json +++ b/menu/navigation.json @@ -745,6 +745,10 @@ "label": "Deploy a model", "slug": "create-deployment" }, + { + "label": "Import a custom model", + "slug": "import-custom-model" + }, { "label": "Monitor a deployment", "slug": "monitor-deployment" diff --git a/pages/managed-inference/how-to/import-custom-model.mdx b/pages/managed-inference/how-to/import-custom-model.mdx new file mode 100644 index 0000000000..dccc5e5e1a --- /dev/null +++ b/pages/managed-inference/how-to/import-custom-model.mdx @@ -0,0 +1,44 @@ +meta: + title: How to import custom models into Managed Inference + description: Learn how to import your custom models into Scaleway's Managed Inference platform. +content: + h1: How to import custom models into Managed Inference + paragraph: Learn how to import your custom models into Scaleway's Managed Inference platform. +tags: managed-inference ai-data import custom model +dates: + validation: 2025-01-10 + posted: 2025-01-10 +categories: + - ai-data + +--- + +Scaleway provides a selection of common models for deployment from the Scaleway console. If you need a specific model, you can import it into Managed Inference directly from Hugging Face or a Scaleway Object Storage bucket. + + +- A Scaleway account logged into the [console](https://console.scaleway.com). +- [Owner](/identity-and-access-management/iam/concepts/#owner) status or [IAM permissions](/identity-and-access-management/iam/concepts/#permission) to perform actions in your Organization. + +1. Click **Managed Inference** in the **AI & Data** section of the side menu in the [Scaleway console](https://console.scaleway.com/) to access the dashboard. +2. Click **Deploy a model** to launch the model deployment wizard. +3. In the **Choose a model** section, select **Custom model**. If you have no model yet, click **Import a model** to start the model import wizard. +4. Choose an upload source: + - **Hugging Face**: Pull the model from Hugging Face. + - **Object Storage**: This feature is coming soon. +5. Enter your Hugging Face access token, which must have READ access to the repository. + + Learn how to generate a Hugging Face access token [here](https://huggingface.co/docs/hub/security-tokens). + +6. Enter the name of the Hugging Face repository to pull the model from. + + Ensure you have access to gated models if applicable. Refer to the [Hugging Face documentation](https://huggingface.co/docs/hub/en/models-gated) for details. + +7. Choose a name for your model. The name must be unique within your Organization and Project and cannot be changed later. +8. Click **Verify import** to check your Hugging Face credentials and ensure model compatibility. +9. Review the summary of your import, which includes: + - Context size by node type. + - Quantization options. + - Estimated cost. + Once checked, click **Begin import** to finalize the process. + +Your imported model will now appear in the model library. You can proceed to [deploy your model on Managed Inference](/ai-data/managed-inference/how-to/create-deployment/). \ No newline at end of file From 45034b4067280466ba72ab77a015185c19f11ea9 Mon Sep 17 00:00:00 2001 From: Benedikt Rollik Date: Thu, 27 Mar 2025 16:14:31 +0100 Subject: [PATCH 2/4] feat(ai): add note --- pages/managed-inference/how-to/import-custom-model.mdx | 8 ++++++-- 1 file changed, 6 insertions(+), 2 deletions(-) diff --git a/pages/managed-inference/how-to/import-custom-model.mdx b/pages/managed-inference/how-to/import-custom-model.mdx index dccc5e5e1a..c8d581687b 100644 --- a/pages/managed-inference/how-to/import-custom-model.mdx +++ b/pages/managed-inference/how-to/import-custom-model.mdx @@ -6,8 +6,8 @@ content: paragraph: Learn how to import your custom models into Scaleway's Managed Inference platform. tags: managed-inference ai-data import custom model dates: - validation: 2025-01-10 - posted: 2025-01-10 + validation: 2025-03-27 + posted: 2025-03-27 categories: - ai-data @@ -15,6 +15,10 @@ categories: Scaleway provides a selection of common models for deployment from the Scaleway console. If you need a specific model, you can import it into Managed Inference directly from Hugging Face or a Scaleway Object Storage bucket. + + This feature is currently in **beta stage** and will evolve in the future. + + - A Scaleway account logged into the [console](https://console.scaleway.com). - [Owner](/identity-and-access-management/iam/concepts/#owner) status or [IAM permissions](/identity-and-access-management/iam/concepts/#permission) to perform actions in your Organization. From c809df5f8183b11fc2065bd8d31eee3c2dd02873 Mon Sep 17 00:00:00 2001 From: Benedikt Rollik Date: Thu, 27 Mar 2025 16:40:57 +0100 Subject: [PATCH 3/4] feat(ai): fix doc --- pages/managed-inference/how-to/import-custom-model.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pages/managed-inference/how-to/import-custom-model.mdx b/pages/managed-inference/how-to/import-custom-model.mdx index c8d581687b..2f3bdfbb5a 100644 --- a/pages/managed-inference/how-to/import-custom-model.mdx +++ b/pages/managed-inference/how-to/import-custom-model.mdx @@ -1,3 +1,4 @@ +--- meta: title: How to import custom models into Managed Inference description: Learn how to import your custom models into Scaleway's Managed Inference platform. @@ -10,7 +11,6 @@ dates: posted: 2025-03-27 categories: - ai-data - --- Scaleway provides a selection of common models for deployment from the Scaleway console. If you need a specific model, you can import it into Managed Inference directly from Hugging Face or a Scaleway Object Storage bucket. From 8625e070e57a6bf236127a104a6ace2933cdc451 Mon Sep 17 00:00:00 2001 From: Benedikt Rollik Date: Thu, 27 Mar 2025 17:12:23 +0100 Subject: [PATCH 4/4] Update pages/managed-inference/how-to/import-custom-model.mdx Co-authored-by: Jessica <113192637+jcirinosclwy@users.noreply.github.com> --- pages/managed-inference/how-to/import-custom-model.mdx | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/pages/managed-inference/how-to/import-custom-model.mdx b/pages/managed-inference/how-to/import-custom-model.mdx index 2f3bdfbb5a..3b8441d2ca 100644 --- a/pages/managed-inference/how-to/import-custom-model.mdx +++ b/pages/managed-inference/how-to/import-custom-model.mdx @@ -31,7 +31,7 @@ Scaleway provides a selection of common models for deployment from the Scaleway - **Object Storage**: This feature is coming soon. 5. Enter your Hugging Face access token, which must have READ access to the repository. - Learn how to generate a Hugging Face access token [here](https://huggingface.co/docs/hub/security-tokens). + [Learn how to generate a Hugging Face access token](https://huggingface.co/docs/hub/security-tokens). 6. Enter the name of the Hugging Face repository to pull the model from.