Use this repo as a template to create Make Real style apps like https://makereal.tldraw.com. To get started:
- Use the template and clone your new repo to your computer
- Run
npm install
to install dependencies - Get an OpenAI API key from https://platform.openai.com/api-keys. Make sure you are at least a Tier 1 API user, which means you have access to GPT-4 Vision. You can check your tier on the OpenAI API Limits.
- Create a
.env.local
file that containsOPENAI_API_KEY=your api key here
- Run
npm run dev
- Open http://localhost:3000 and make some stuff real!
Make Real is built with tldraw, a very good React library for creating whiteboards and other infinite canvas experiences.
To use it, first draw a mockup for a piece of UI. When you're ready, select the drawing, and press the Make Real button. We'll capture an image of your selection, and send it to OpenAI's GPT-4V along with instructions to turn it into a HTML file.
We take the HTML response and add it to a tldraw custom shape. The custom shape shows the response in an iframe so that you can interact with it on the canvas. If you want to iterate on the response, annotate the iframe, select it all, and press 'Make Real' again.
To change how Make Real works, start from the makeReal()
function. From there, you can change the prompt that gets sent to gpt-4.
If you'd like Make Real to create something other than HTML, you'll need to
either update the ResponseShape
to
display something different, or use one of tldraw's built-in shapes like image
or text.