README.md

Welcome to the leaderboard-cloud repository. Here, users can find all the resources, steps and information about the infraestructure used by the CARLA Leaderboard's cloud. The aim is to have a clear open source, easy to understand pipeline that can be used to deploy either future versions of the official CARLA Leaderboard, or possible variations done by the users. While a minimum of cloud infraestructure is expected from the users, the docs are created so that a deep understanding of it isn't really needed.

As for the repositories structure, aws, evalai and leaderboard are the different sections of the cloud's implementation. While the first two are the same for any of the two Leaderboard version, the leaderboard folder explains the creation of the cluster, which has slight variations between versions, hence the leaderboard_1.0 and leaderboard_2.0 folders.

Below is a summary of the different topics that will be discussed for a succesful implementation of the cloud infraestructure.

1. Install prerequisites
2. Infrastructure overview
3. Leaderboard cluster
   • Custom AMI
   • Configuration file
   • Creation of the cluster
   • Saving the logs
   • Manage cluster access
4. Running user submissions
   • Job overview
   • Containers overview
5. AWS interface
   • User permissions
   • Storage services
   • Deployment services
6. EvalAI Frontend
7. Useful Commands

_NOTE: These docs assume that you are using Linux and that all commands are run from either of the leaderboard folders.