Skip to content

Statistics

Jump to bottom Edit New page
Bratwurscht edited this page Jan 25, 2016 · 15 revisions

Building statistics for shownot.es

REST-API definitions under https://github.com/shownotes/snotes20-restapi/wiki/Statistics (@drake81)

Idea

Perform analyses of all publications on shownot.es and generate some cool statistics with that data. Therefore we need to generate word frequency tables and tf-idf tables on each episode of each podcast. We also need to build an overall corpus and generate the same tables for this. We can do this analyses on all text and on all URLs separately. First of all there must be a definition of the tables in the database. By getting a clear structure the statistic feature must be implemented as a separate django application namely statistic.

Later on, the data from the extracted features must be reachable via REST. By achieving this, we need to build a proper API to generate and deliver the data for each graph to the angular frontend. The graphs will be implemented with the library d3.js. Therefore it's necessary to discover which JSON data is needed for the graphs.

Interactive TimeLine-Plot for publications and podcasts (@felipedsp)

Generate a Timeline on the top of the page, which enables the user to manually select a time periode. This could be used by a user to search for specific publication by time

  • Selecting a time range in the overall overview will show a list of podcasts which has publications in that time periode.
  • Selecting a time range while in the overview of a specific podcast the list of episode will be update in the same manner as above.
  • The selected time range in the overall overview should persist, if the user clicked on a podcast to visit the detail publication list.

Frontend specific Ressources

Possible graphs

  1. https://square.github.io/crossfilter/
  2. http://bl.ocks.org/mbostock/4062085
  3. http://bl.ocks.org/mbostock/3943967

Required JSON for graph

{
"foo":"bar"
}

Possible problems

  • All episodes have a created_date but not a date
    • Date is the date where the episode was live (discovered by hoersuppe API)
    • Maybe we should use episodes numbers not dates as X on the graph

Similarity of Podcasts and Episodes (@bratwurscht)

Frontend specific Ressources

Possible graphs

  1. http://bl.ocks.org/mbostock/4062045

Required JSON for graph

{
   "nodes":[
      {"name": "pocdcastname1", "coverfile": "../blablub.png"},
      {"name": "pocdcastname2", "coverfile": "../blubbla.png"},
      …
   ], 
   "links:[
      {"source": "podcastname1", "target": "podcastname2", "value":3},
      {"source": "podcastname2", "target": "podcastname2", "value":5},
      …
   ]
}

Wordclouds beside search (@bratwurscht)

Frontend specific Ressources

Possible graphs

Required JSON for graph

["Hallo", "Test", "Lorem", "Ipsum"]
Add a custom footer

Wiki for the Backend Application and Database model

Clone this wiki locally