Name		Name	Last commit message	Last commit date
parent directory ..
custom_kernels		custom_kernels
tests		tests
text_generation_server		text_generation_server
transformers_patch		transformers_patch
.gitignore		.gitignore
Makefile		Makefile
README.md		README.md
poetry.lock		poetry.lock
pyproject.toml		pyproject.toml

README.md

BLOOM Inference Python gRPC Server

A Python gRPC server for BLOOM Inference

Install

make install

Run

make run-dev