Setting up AWS

Initial setup

The EC2 setup code is based on RLLAB, and the instructions for setting up your AWS account are located here: https://rllab.readthedocs.io/en/latest/user/cluster.html

To begin with setting up AWS, first set the $DOODAD_S3_BUCKET environment variable, then run:

python scripts/setup_ec2.py

The script will automatically create a bucket and initialize credentials required for launching jobs.

Next, install AWS CLI with:

curl "https://s3.amazonaws.com/aws-cli/awscli-bundle.zip" -o "awscli-bundle.zip"
unzip awscli-bundle.zip
sudo ./awscli-bundle/install -i /usr/local/aws -b /usr/local/bin/aws

Create an AMI image

In order to use doodad, the AMI image should be an Ubuntu image with awscli and docker installed. A list of pre-built images can be found here.

You can create an image by creating an EC2 instance, setting up the appropriate tools, and creating a "snapshot". Detailed instructions are here.

awscli can be installed via the following command:

curl "https://s3.amazonaws.com/aws-cli/awscli-bundle.zip" -o "awscli-bundle.zip"
unzip awscli-bundle.zip
sudo ./awscli-bundle/install -i /usr/local/aws -b /usr/local/bin/aws

After these commands, the aws command should become available.