Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

An experiment at running benchmarks on multiple EC2 instances #151

Open
wants to merge 29 commits into
base: future
Choose a base branch
from
Open

An experiment at running benchmarks on multiple EC2 instances #151

wants to merge 29 commits into from

Commits on Feb 22, 2021

  1. A waiter script that can run long running jobs in the background

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    f5f4c38 View commit details
    Browse the repository at this point in the history

  2. Add VolumeType in make/suggest

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    d258a84 View commit details
    Browse the repository at this point in the history

  3. Add connection attempts

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    23f128b View commit details
    Browse the repository at this point in the history

  4. Add some informative messages

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    3a9f590 View commit details
    Browse the repository at this point in the history

  5. Add two profiles for instances

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    c52a32a View commit details
    Browse the repository at this point in the history

  6. First stab at a multi-instance experiment

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    c9a9dc3 View commit details
    Browse the repository at this point in the history

  7. New version of bg-worker and poller

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    3307f19 View commit details
    Browse the repository at this point in the history

  8. Execute a script on ec2

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    f07db61 View commit details
    Browse the repository at this point in the history

  9. Modify instance profiles to have 20GB of storage since they were runn… 

    …ing out
    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    d1d3944 View commit details
    Browse the repository at this point in the history

  10. Remove the input script

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    51cb05c View commit details
    Browse the repository at this point in the history

  11. Update infrastructure to run experiments using async worker

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    abd1c4f View commit details
    Browse the repository at this point in the history

  12. Add a no-stop flag in with-ec2

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    db25df6 View commit details
    Browse the repository at this point in the history

  13. Fix ssh background poller to incrementally update the output log to s… 

    …how progress
    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    703afdb View commit details
    Browse the repository at this point in the history

  14. Close stdin, stdout, stderr so that bg worker can exit

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    b383cce View commit details
    Browse the repository at this point in the history

  15. Execute both experiments

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    fa7da49 View commit details
    Browse the repository at this point in the history

  16. Rename and add comments

    @angelhof
    angelhof committed Feb 22, 2021
    Configuration menu
    Copy the full SHA
    659de2e View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2021

  1. Remove unneccessary line

    @angelhof
    angelhof committed Feb 23, 2021
    Configuration menu
    Copy the full SHA
    0892ca1 View commit details
    Browse the repository at this point in the history

Commits on Feb 28, 2021

  1. Add archive

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    d5fc6b2 View commit details
    Browse the repository at this point in the history

  2. Modify gather results so that it can be imported

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    ba30feb View commit details
    Browse the repository at this point in the history

  3. Add a plotting script in the multi-instance experiment

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    1763d00 View commit details
    Browse the repository at this point in the history

  4. Add plot

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    06905e7 View commit details
    Browse the repository at this point in the history

  5. Allow commiting pdf plots in the archive directory

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    b4e0ccf View commit details
    Browse the repository at this point in the history

  6. Create directory if it doesn't exist in plot.py

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    c26ac03 View commit details
    Browse the repository at this point in the history

  7. Gather results in named directories

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    9c4bbc8 View commit details
    Browse the repository at this point in the history

  8. Plot bash and pash in the same plots

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    f63d476 View commit details
    Browse the repository at this point in the history

  9. Update archive results and plots

    @angelhof
    angelhof committed Feb 28, 2021
    Configuration menu
    Copy the full SHA
    7f20fa6 View commit details
    Browse the repository at this point in the history

Commits on Mar 1, 2021

  1. Make ec2 instance with IOPS too

    @angelhof
    angelhof committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    a735725 View commit details
    Browse the repository at this point in the history

  2. Update the profiles

    @angelhof
    angelhof committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    34ee3e5 View commit details
    Browse the repository at this point in the history

  3. Update instance id

    @angelhof
    angelhof committed Mar 1, 2021
    Configuration menu
    Copy the full SHA
    5655d7e View commit details
    Browse the repository at this point in the history