Skip to content

Latest commit

 

History

History
28 lines (23 loc) · 3.71 KB

previous_workflow.md

File metadata and controls

28 lines (23 loc) · 3.71 KB

Preamble

For the past two years I have created the AMIs for the Workshop on Genomics a couple of weeks prior to the workshops beginning - usually in my Christmas holiday and also during the Faculty set up week. 2014 was the first time that I had ever used Amazon EC2 and an AMI, let alone been tasked to create one of my own and so I wanted it to work the first time! Therefore, in that first year I decided to use a copy of BioLinux which helped expedite the process of installing software (their repositories already included many of the bioinformatics software we needed) but it is not really maintained that well anymore. Nevertheless it worked, and it was relatively stable. So, success!

In the second year I decided to install everything from scratch (well other than the base OS), so now more than a novice at using Amazon's webs services it was easy for me, but it's a bit of a laborious and slow process. It was very stable, and I can't remember any problems other than one with Stacks that was human error. The AMI was split half-way and used - I think - as a base to the Population and Speciation Genomics workshop by Adam Bazinet.

This year I want to try and get the building of the AMI to be as automated as possible. If I can use technology to help me automate the process, then all I need to do is press 'go' and come back later and double check it all completed (obviously so that I can go and drink more Czech Lager - surely the reason for anyone to become a bioinformatician; automate it = drink more). This will allow changes to be made to the install scripts and if anything breaks, a new AMI can be started from scratch, rather than keeping intermediate copies as I have in the past.

Previous Years

2015

I used a copy of Bio-Linux 8 as the base AMI on which to base the workshop machine image. This was fine back in 2014, but it hasn't really been updated since July of that year and doesn't look like it's going to be continued link, similarly CloudBioLinux isn't really mainted either and hasn't been updated since 2013.

2016

I decided to use the image ami-a75e12cd which is a copy of Ubuntu Server Wily 15.10 due to the lack of updates on BioLinux platforms. As I will mention elsewhere, this is a Server based version of Linux - that means there is no Desktop interface, just the shell. A Desktop GUI needs to be installed separately as some workshop material relies on a GUI and some students prefer it as an environment to start with. There aren't generally Desktop versions of Linux available on EC2.

Previous Workflow

Usually I would start with a base AMI (e.g. BioLinux or Ubuntu) and as I got the lists of programs, dependencies and software packages from the Faculty I would install them. I would also set up a range of other things, including:

  • MATE Desktop Environment - this is the default in Ubuntu anyway but needs to be instaled on the server version.
  • X2Go - Remote Desktop software which allows a graphical connection to the AMI much like NoMachine.
  • A stunning Workshop on Genomics desktop background.
  • Password enabled SSH Login and X-Forwarding
  • VNC & XRDP - last resort remote desktop interfaces for inevitable student laptop issues with X2Go.
  • other repositories, updates, motds and customisations etc