Gen-ED: A Visual Storytelling Chatbot for Education

Overview

We envisioned the future of holistic learning experiences. With Gen-ED, we're bringing reading, listening, and visual engagement together to revolutionize understanding for children.

Features

• Story-telling: AI-driven visual stories based on a child's selected topic and character.
• Interactive Q&A Chat: Dynamic responses to questions, supported by visually rich content.
• Quizzes: Gentle and engaging evaluations on chosen topics.

Built With

• Text Generation: GPT-4
• Image Generation: Stable-Diffusion XL
• Speech Generation: Google Cloud TTS
• Frameworks: Node.js, NextJS, React
• Other tools: clip-drop, openai

Getting Started

Prerequisites

Ensure you have Node.js and npm installed.

Setup

1. Environment Configuration

   mkdir backend/src/config
   touch backend/src/config/dev.env

   Populate dev.env:

   PORT=
   OPENAI_API_KEY=sk-....
   MONGO_URI=....

2. Installing Dependencies

   For backend:

   cd backend
   npm install pnpm
   pnpm i

   For frontend (kid directory):

   cd kid
   npm install

Usage

Be creative!

What we've tried before: The Hulk explaining Roman Empire, Elsa explaining gravity, and so much more!

Type in the character name or choose from our suggestions

Type in the topic or choose from our suggestions

Listen, watch, and read, as our storyteller expains the topic! Chat with it after it finishes the story for clarifications.

Test yourself with potentially unlimited questions on the topic

Contributing

If you'd like to contribute, please fork the repository and use a feature branch. Pull requests are welcome.