Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add more detailed docs for ZenML Pro #3065

Merged
merged 120 commits into from
Oct 21, 2024
Merged

Add more detailed docs for ZenML Pro #3065

merged 120 commits into from
Oct 21, 2024

Conversation

wjayesh
Copy link
Contributor

@wjayesh wjayesh commented Oct 9, 2024

Describe changes

I added some docs for ZenML Pro concepts like organizations, tenants, roles and the hierarchy of these concepts.

Pre-requisites

Please ensure you have done the following:

  • I have read the CONTRIBUTING.md document.
  • If my change requires a change to docs, I have updated the documentation accordingly.
  • I have added tests to cover my changes.
  • I have based my new branch on develop and the open PR is targeting develop. If your branch wasn't based on develop read Contribution guide on rebasing branch to develop.
  • If my changes require changes to the dashboard, these changes are communicated/requested.

Types of changes

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds functionality)
  • Breaking change (fix or feature that would cause existing functionality to change)
  • Other (add details above)

@github-actions github-actions bot added internal To filter out internal PRs and issues documentation Improvements or additions to documentation labels Oct 9, 2024
Copy link
Contributor

github-actions bot commented Oct 9, 2024

Images automagically compressed by Calibre's image-actions

Compression reduced images by 20.9%, saving 762.76 KB.

Filename Before After Improvement Visual comparison
docs/book/.gitbook/assets/add_org_members.png 221.65 KB 191.07 KB -13.8% View diff
docs/book/.gitbook/assets/admin_role.png 208.41 KB 165.04 KB -20.8% View diff
docs/book/.gitbook/assets/assign_permissions.png 248.91 KB 197.16 KB -20.8% View diff
docs/book/.gitbook/assets/cloudapi_swagger.png 250.96 KB 181.27 KB -27.8% View diff
docs/book/.gitbook/assets/create_role_modal.png 197.79 KB 174.40 KB -11.8% View diff
docs/book/.gitbook/assets/custom_role_settings_page.png 435.34 KB 322.07 KB -26.0% View diff
docs/book/.gitbook/assets/new_tenant_modal.png 122.79 KB 101.19 KB -17.6% View diff
docs/book/.gitbook/assets/new_tenant.png 276.07 KB 195.66 KB -29.1% View diff
docs/book/.gitbook/assets/org_hierarchy_pro.png 96.24 KB 86.57 KB -10.0% View diff
docs/book/.gitbook/assets/org_members.png 230.89 KB 196.06 KB -15.1% View diff
docs/book/.gitbook/assets/org_settings.png 137.85 KB 120.95 KB -12.3% View diff
docs/book/.gitbook/assets/rbac_admin_permissions.png 202.40 KB 168.90 KB -16.6% View diff
docs/book/.gitbook/assets/role_page.png 220.97 KB 171.40 KB -22.4% View diff
docs/book/.gitbook/assets/swagger_docs_zenml.png 135.84 KB 102.25 KB -24.7% View diff
docs/book/.gitbook/assets/tenant_onboarding.png 314.42 KB 232.76 KB -26.0% View diff
docs/book/.gitbook/assets/tenant_roles_page.png 208.52 KB 160.15 KB -23.2% View diff
docs/book/.gitbook/assets/zenml_pro_c1_c2.png 70.68 KB 61.42 KB -13.1% View diff
docs/book/.gitbook/assets/zenml_pro_tenants_teams1.png 77.58 KB 66.22 KB -14.7% View diff

319 images did not require optimisation.

Update required: Update image-actions configuration to the latest version before 1/1/21. See README for instructions.


## Create a Tenant in your organization

A tenant is a crucial part of your Organization and holds all of your pipelines, experiments and models, among other things. You need to have a tenant to fully utilize the benefits that ZenML Pro brings. The following is how you can create a tenant yourself:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Maybe it's worth adding that people can think of a tenant as a single VM / deployment of the ZenML server?

docs/book/getting-started/zenml-pro/organization.md Outdated Show resolved Hide resolved
- Give your tenant a name and click on the "Create Tenant" button
![Image showing the create tenant modal](../../.gitbook/assets/new_tenant_modal.png)

The tenant will be created in some time and added to your organization. In the meantime, you can already get started with setting up your environment for the onboarding experience.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
The tenant will be created in some time and added to your organization. In the meantime, you can already get started with setting up your environment for the onboarding experience.
The tenant will then be created and added to your organization. In the meantime, you can already get started with setting up your environment for the onboarding experience.

docs/book/getting-started/zenml-pro/organization.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/roles.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/roles.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/roles.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/tenants.md Outdated Show resolved Hide resolved
Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 30.4%, saving 58.13 KB.

Filename Before After Improvement Visual comparison
docs/book/.gitbook/assets/cloud_architecture_scenario_1.png 99.71 KB 69.76 KB -30.0% View diff
docs/book/.gitbook/assets/cloud_architecture_scenario_2.png 91.70 KB 63.53 KB -30.7% View diff

332 images did not require optimisation.

Update required: Update image-actions configuration to the latest version before 1/1/21. See README for instructions.

Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 40.4%, saving 307.15 KB.

Filename Before After Improvement Visual comparison
docs/book/.gitbook/assets/cloud_architecture_scenario_1_1.png 254.79 KB 154.12 KB -39.5% View diff
docs/book/.gitbook/assets/cloud_architecture_scenario_1.png 258.79 KB 156.98 KB -39.3% View diff
docs/book/.gitbook/assets/cloud_architecture_scenario_2.png 247.61 KB 142.93 KB -42.3% View diff

359 images did not require optimisation.

Update required: Update image-actions configuration to the latest version before 1/1/21. See README for instructions.

Copy link
Contributor Author

@wjayesh wjayesh left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks beautiful to me, save for a small image modification!

You can also create a tenant through the Cloud API by navigating to https://cloudapi.zenml.io/ and using the `POST /organizations` endpoint to create a tenant.
{% endhint %}

## Organizing your tenants
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

really like this section

Copy link
Contributor

@strickvl strickvl left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some small things I came across... Overall looks good. Will give it a more thorough read. Only structural thing is that I wonder whether system architecture shouldn't come directly after core concepts in the left menubar / structure?

read [this guide](../getting-started/deploying-zenml/README.md).
{% endhint %}

A ZenML OSS deployment (AKA a tenant) consists of the following moving pieces:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
A ZenML OSS deployment (AKA a tenant) consists of the following moving pieces:
A ZenML OSS deployment consists of the following moving pieces:

you make the distinction a few lines down

ZenML OSS is free with Apache 2.0 license. Learn how to deploy it [here](./deploying-zenml/README.md).

{% hint style="info" %}
To learn more about the core concepts for ZenML OSS, go [here](../getting-started/core-concepts.md)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
To learn more about the core concepts for ZenML OSS, go [here](../getting-started/core-concepts.md)
To learn more about the core concepts for ZenML OSS, go [here](../getting-started/core-concepts.md).

## ZenML Pro (SaaS or Self-hosted)

{% hint style="info" %}
If you're interested in assessing ZenML Pro SaaSs, you can create
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
If you're interested in assessing ZenML Pro SaaSs, you can create
If you're interested in assessing ZenML Pro SaaS, you can create


## Other operations involving organizations

There are a lot of other operations involving Organizations that you can perform directly through the API. You can find more information about the API by visiting https://cloudapi.zenml.io/.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
There are a lot of other operations involving Organizations that you can perform directly through the API. You can find more information about the API by visiting https://cloudapi.zenml.io/.
There are a lot of other operations involving Organizations that you can perform directly through the API. You can find more information about the API by visiting [https://cloudapi.zenml.io/](https://cloudapi.zenml.io/).

Comment on lines 23 to 35
## Deployment scenarios: SaaS vs Self-hosted

ZenML Pro enables you to [create and run templates](../../how-to/trigger-pipelines/README.md#run-templates).
This way, you can use the dashboard or our Client/REST API to run a pipeline with updated configuration
which allows you to iterate quickly with minimal friction.
One of the most straightforward paths to start with a deployed ZenML server is
to use [the SaaS version of ZenML Pro](https://zenml.io/pro). The ZenML Pro offering eliminates the need
for you to dedicate time and resources to deploy and manage a ZenML server,
allowing you to focus primarily on your MLOps workflows.

### Triggers, CI/CD, Reports and more
However, ZenML Pro can also be deployed fully self-hosted. Please [book a demo](https://www.zenml.io/book-your-demo)
to learn more.

Additionally, ZenML Pro users get exclusive access to an array of
cloud-specific features, such as triggers, integrating with your code
repository CI/CD system, generating usage reports and more.
Click [here](../system-architectures.md) to understand about the various deployment scenarios with ZenML Pro.

Learn more about ZenML Pro on the [ZenML Website](https://zenml.io/pro).
<table data-card-size="large" data-view="cards"><thead><tr><th></th><th></th><th data-hidden></th><th data-hidden data-type="content-ref"></th><th data-hidden data-card-target data-type="content-ref"></th></tr></thead><tbody><tr><td><mark style="color:purple;"><strong>Tenants</strong></mark></td><td>Tenants in ZenML Pro</td><td></td><td></td><td><a href="./tenants.md">tenants.md</a></td></tr><tr><td><mark style="color:purple;"><strong>Organizations</strong></mark></td><td>Organizations in ZenML Pro</td><td></td><td></td><td><a href="./organization.md">organization.md</a></td></tr><tr><td><mark style="color:purple;"><strong>Teams</strong></mark></td><td>Teams in ZenML Pro</td><td></td><td></td><td><a href="./teams.md">teams.md</a></td></tr><tr><td><mark style="color:purple;"><strong>Roles</strong></mark></td><td>Roles in ZenML Pro</td><td></td><td></td><td><a href="./roles.md">roles.md</a></td></tr></tbody></table>
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Feels like there is too much redirection here. The table should stay I guess, but then the paragraph itself seems to send you in lots of directions.

docs/book/getting-started/zenml-pro/README.md Outdated Show resolved Hide resolved

## Using your tenant

As said already, a tenant is a supercharged ZenML server that you can use to run your pipelines, carry out experiments and perform all the other actions you expect out of your ZenML server.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
As said already, a tenant is a supercharged ZenML server that you can use to run your pipelines, carry out experiments and perform all the other actions you expect out of your ZenML server.
As previously mentioned, a tenant is a supercharged ZenML server that you can use to run your pipelines, carry out experiments and perform all the other actions you expect out of your ZenML server.


ZenML Pro offers a powerful API that allows you to interact with your ZenML resources. Whether you're using the [SaaS version](https://cloud.zenml.io) or a self-hosted ZenML Pro instance, you can leverage this API to manage tenants, organizations, users, roles, and more.

Note, the SaaS version of ZenML Pro API is hosted [here](https://cloudapi.zenml.io)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
Note, the SaaS version of ZenML Pro API is hosted [here](https://cloudapi.zenml.io)
The SaaS version of ZenML Pro API is hosted [here](https://cloudapi.zenml.io).

![ZenML Pro self-hosted deployment](../.gitbook/assets/cloud_architecture_scenario_2.png)

In this scenario, all services, data, and secrets are deployed on the customer
cloud. This is the opposite of Scenario 1, and is meant for customers who
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We haven't mentioned scenarios in the document yet, so it feels a bit out of place...

</details>

Are you interested in ZenML Pro? [Sign up](https://cloud.zenml.io/?utm\_source=docs\&utm\_medium=referral\_link\&utm\_campaign=cloud\_promotion\&utm\_content=signup\_link)
and get access to Scenario 1. with a free 14 day trial now!
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

same here with the scenario....

Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 38.2%, saving 688.78 KB.

Filename Before After Improvement Visual comparison
docs/book/.gitbook/assets/cloud_architecture_scenario_1_1.png 254.76 KB 154.12 KB -39.5% View diff
docs/book/.gitbook/assets/cloud_architecture_scenario_1.png 258.79 KB 156.98 KB -39.3% View diff
docs/book/.gitbook/assets/cloud_architecture_scenario_2.png 246.40 KB 142.21 KB -42.3% View diff
docs/book/.gitbook/assets/oss_simple_deployment.png 136.92 KB 86.96 KB -36.5% View diff
docs/book/.gitbook/assets/pro_deployment_simple.png 345.93 KB 215.23 KB -37.8% View diff
docs/book/.gitbook/assets/Scenario1.png 121.55 KB 76.65 KB -36.9% View diff
docs/book/.gitbook/assets/Scenario2.png 159.85 KB 101.53 KB -36.5% View diff
docs/book/.gitbook/assets/Scenario3.2.png 278.42 KB 180.18 KB -35.3% View diff

354 images did not require optimisation.

Update required: Update image-actions configuration to the latest version before 1/1/21. See README for instructions.

Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 32.7%, saving 158.30 KB.

Filename Before After Improvement Visual comparison
docs/book/.gitbook/assets/org_hierarchy_pro.png 484.60 KB 326.29 KB -32.7% View diff

361 images did not require optimisation.

Update required: Update image-actions configuration to the latest version before 1/1/21. See README for instructions.

Copy link
Contributor

Images automagically compressed by Calibre's image-actions

Compression reduced images by 43.6%, saving 135.29 KB.

Filename Before After Improvement Visual comparison
docs/book/.gitbook/assets/business-logic-tenants.png 197.55 KB 111.77 KB -43.4% View diff
docs/book/.gitbook/assets/staging-production-tenants.png 112.94 KB 63.43 KB -43.8% View diff

362 images did not require optimisation.

Update required: Update image-actions configuration to the latest version before 1/1/21. See README for instructions.

docs/book/getting-started/deploying-zenml/README.md Outdated Show resolved Hide resolved
docs/book/getting-started/deploying-zenml/README.md Outdated Show resolved Hide resolved
docs/book/getting-started/system-architectures.md Outdated Show resolved Hide resolved
docs/book/getting-started/system-architectures.md Outdated Show resolved Hide resolved
docs/book/getting-started/system-architectures.md Outdated Show resolved Hide resolved
docs/book/getting-started/system-architectures.md Outdated Show resolved Hide resolved
docs/book/getting-started/system-architectures.md Outdated Show resolved Hide resolved
docs/book/getting-started/system-architectures.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/README.md Outdated Show resolved Hide resolved
docs/book/.gitbook/assets/zenml_cloud.png:Zone.Identifier Outdated Show resolved Hide resolved

There are a lot of other operations involving Organizations that you can perform directly through the API. You can find more information about the API by visiting [https://cloudapi.zenml.io/](https://cloudapi.zenml.io/).

![Image showing the swagger docs](../../.gitbook/assets/cloudapi_swagger.png)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
![Image showing the swagger docs](../../.gitbook/assets/cloudapi_swagger.png)
![Image showing the Swagger docs](../../.gitbook/assets/cloudapi_swagger.png)

docs/book/getting-started/zenml-pro/organization.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/pro-api.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/pro-api.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/roles.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/teams.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/tenants.md Outdated Show resolved Hide resolved
docs/book/getting-started/zenml-pro/tenants.md Outdated Show resolved Hide resolved
@htahir1
Copy link
Contributor

htahir1 commented Oct 18, 2024

@strickvl addressed all comments

@htahir1 htahir1 requested a review from strickvl October 18, 2024 21:16
@wjayesh
Copy link
Contributor Author

wjayesh commented Oct 21, 2024

good to go from my side too

@htahir1 htahir1 merged commit 62305dc into develop Oct 21, 2024
10 of 11 checks passed
@htahir1 htahir1 deleted the docs/zenml-pro-user-mgmt branch October 21, 2024 07:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation internal To filter out internal PRs and issues
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants