2015 05 27

• Agenda:
  • open TODOs:
    • DONE AM: check utilities -> no action needed
    • TODO MT: move semantic elements of tools into RP.utils
    • TODO MS: add/move remaining pieces (dataframe for profiles)
    • TODO AM: proposal to json export to persistent storage
    • TODO MS: proposal for persistent experimental data storage
  • Development Progress:
    • None (paper writing)
    • DONE AM: send update on lease manager problem to Antons
  • Data Roadmap:
    • document
    • TODO RP: start iterating on the API
    • TODO MS: look over the spark scripts etc.
  • Experiments:
    • AM: How to publish data sets (+ scripts)?
    • MT/MS: experimental data management service + tool to export data to that service after run
      • radical-update <session-id> -name my_experiment_123
      • 1. export json / collect profile / annotate metadata (TODO AM: proposal?)
      • 2. storage / provenance on some database / disk / service (TODO MS: proposal?)
      • 3. some interface to query and access
    • session type data vs. other 'raw data'?
    • data should never live only on the laptop...
    • TODO AM: create exp repo name space
    • TODO AM: document different github / bitbucket projects
  • Publications:
    • RP Paper:
      • TODO ALL: commit plots and graphs etc., discuss on next call.
      • TODO AM: micro benchmark data plots
• Notes:
  • MT: problem for runs longer than 8 hours - TODO MT: create ticket