RNN Bot Writer App (deployed on Google Cloud Platform)

See live action here.

What does this repo do?

This repo serves a pre-trained character-level RNN model that synthesizes text given a user-prompt.

The model is running on CPU can be deployed with a custom flex instance on Google Cloud Compute (GCP). Model serving and backend functions are accomplished with async python ASGI framework called Starlette along with ASGI server uvicorn.

To set up GCP:

• Github Demo
• Python3 GCP App Engine

To test webapp locally:

1. navigate to the app root directory
2. activate the conda environment with Python3
3. build docker image:

   docker build -t rnnbot . && docker run --rm -it -p 8080:8080 rnnbot
   

4. go to http://localhost:8080

(Note: make sure to use port 8080 on GCP Flex Runtime)

To deploy the app on GCP:

1. navigate to the app root directory
2. set the gcloud configuration and deploy the app:

   gcloud config set project YOUR-PROJECT-ID
   gcloud app deploy
   

3. once it's deployed, you can open the webapp by running this in the terminal:

   gcloud app browse
   

   or on https://[YOUR-PROJECT-NAME].appspot.com

Other good resources:

• FastAI Python Live Example/ Github (deployed on Render)