Red Hat Composer AI Infrastructure GitOps

Welcome to the Red Hat Composer AI Infrastructure GitOps project! This project is a fork of the upstream AI Accelerator project and is designed to deploy all of the required cluster components for Composer AI to an OpenShift cluster.

Installation

Prerequisites

• Openshift 4.16+ cluster

Important

There is a known issue with using Kubernetes version 4.17 in relation to the Node Feature Discovery Operator, which causes issues allocating nodes that use GPUs. It is recommended to avoid this version for now.

Quick Start

Installation can be done using ./bootstrap.sh script.

Tip

First time installs it is recommended to allow the script to walk through options, but future runs can be automated using cli flags, run ./bootstrap --help for more information.

Additional Documentation and Info

• Overview - what's inside this repository?
• Installation Guide - containing step by step instructions for executing this installation sequence on your cluster

Operators

• Authorino Operator
• NVIDIA GPU Operator
• Node Feature Discovery Operator
• OpenShift AI
• OpenShift Pipelines
• OpenShift Serverless
• OpenShift ServiceMesh

Applications

• OpenShift GitOps: ArgoCD
• S3 compatible storage: MinIO

Configuration

• Bootstrap Overlays
• Cluster Configuration Sets

Tenants

• Tenant Examples