Skip to content

2015 05 27

Andre Merzky edited this page May 27, 2015 · 5 revisions
  • Agenda:
    • open TODOs:
      • DONE AM: check utilities -> no action needed
      • TODO MT: move semantic elements of tools into RP.utils
      • TODO MS: add/move remaining pieces (dataframe for profiles)
      • TODO AM: proposal to json export to persistent storage
      • TODO MS: proposal for persistent experimental data storage
    • Development Progress:
      • None (paper writing)
      • DONE AM: send update on lease manager problem to Antons
    • Data Roadmap:
      • document
      • TODO RP: start iterating on the API
      • TODO MS: look over the spark scripts etc.
    • Experiments:
      • AM: How to publish data sets (+ scripts)?
      • MT/MS: experimental data management service + tool to export data to that service after run
        • radical-update <session-id> -name my_experiment_123
          1. export json / collect profile / annotate metadata (TODO AM: proposal?)
          1. storage / provenance on some database / disk / service (TODO MS: proposal?)
          1. some interface to query and access
      • session type data vs. other 'raw data'?
      • data should never live only on the laptop...
      • TODO AM: create exp repo name space (github and bitbucket)
      • TODO AM: document different github / bitbucket projects
    • Publications:
      • RP Paper:
        • TODO ALL: commit plots and graphs etc., discuss on next call.
        • TODO AM: micro benchmark data plots
  • Notes:
    • MT: problem for runs longer than 8 hours - TODO MT: create ticket
Clone this wiki locally