MLOPS - Definitive Guides for DevOps Engineers

A curated list of publicly available and community-contributed resources to learn MLOPS.

This repository is focused on people who want to start with MLOPS from a DevOps background.

What is MLOPS?

MLOPS is a practice followed to develop and deploy machine learning applications.

MLOPS = DevOps + Machine Learning

If you follow DevOps culture and practices for ML projects, you can call it as MLOPS.

Here is the high-level workflow of an MLOps pipeline.

How is MLOPS is different from DevOps?

MLOPS is different from DevOps in the same areas how a Machine learning development is different from a traditional software development process.

As Devops engineers, we understand the complete life cycle of an application from development to production. It includes CI/CD, logging, monitoring, alerting, etc.

In the same way, for MLOPS, a DevOps engineer should understand the ML application lifecycle and core concepts around it. It enables the DevOps engineer to collaborate when multiple ML teams are involved.

Following are the key teams involved in MLOPS

1. Data Scientists: These are the experts who develop and train the machine learning models. They understand the business problem and translate it into a modeling approach. They're the brains behind the algorithms!
2. Data Engineers: They build the infrastructure to collect, store, and process the data used to train and deploy the models. They are the plumbers who ensure the data flows smoothly.
3. Software Engineers: They develop the web applications or APIs that will use the machine learning models. They ensure the models can be easily integrated into existing systems.
4. ML Engineers: These folks combine the skills of data scientists and software engineers. They take the models from development to production, building pipelines to automate the training, deployment, and monitoring processes. They bridge the gap between creating and implementing the models.
5. DevOps engineers: They automate the process of deploying and managing the machine learning models in production. They ensure the models are reliable and scalable.
6. Business Stakeholders: These are the people who represent the business needs and goals for the machine learning project. They define the success metrics and ensure that the models are aligned with the overall business strategy.

Role of DevOps in MLOPS

DevOps brings automation and collaboration to MLOps, making machine learning model development and deployment smoother.

Here are some guide to get started.

1. Why is DevOps for Machine Learning so Different?
2. Need for DevOps for ML Data
3. MLOps and DevOps: Why Data Makes It Different

ML Basics

1. How Does Machine Learning Work?
2. Machine Learning Visual Explanation
3. Understanding ML Algorithm & Model

Data Engineering Basics

1. 150 Data Engineering Concepts

Free MLOPS Tools & Services

1. AWS Sagemaker Studio
2. Kubeflow
3. MLFlow

MLOPS Courses

1. MLOps Concepts (Datacamp)

MLOPS Roadmap

<--Comming Soon-->

MLOPS Real World Use Cases

1/ Saving 10s of Thousands of Dollars Deploying Low Cost Open Source AI Technologies At Scale with Kubernetes

MLOPS Practical Labs for Beginners

<--Comming Soon-->

MLOPS Advanced Labs

<--Comming Soon-->

Datasets

1. https://www.kaggle.com/datasets