Melba-Mini

A smaller alternative to Melba-Toast-AI

Requirements

• llama-cpp-python 0.2.11
• ChromaDB 0.4.14
• openhermes-2-mistral-7b.Q6_K.gguf

Usage

Place the system prompt in generic_prompt.txt.

Launch client.py to use it with melba-backend or launch cli.py for manual input.

• NRCLex 3.0.0