Major tasks with videos:
- Add the playlists to the events files
- Add more videos
- Add twitch streams
- Add the speakers
- Add tags, update descriptions
Trailers: There are some conferences that upload two version of their talk the full version and one called -trailer which is a 3 min snippet. The trailers should be skipped. (We should probably also remove them later on.)
Each event has a field called youtube
that can hold the id of the playlist in YouTube of the videos of that specific event.
Running python3 video.py
will list all the event that do NOT have a playlist yet.
Check the conference web page and/or search for the name of the conference in YouTub and add the ID of
the playlist to the appropriate data/events/*
file.
We index the videos recorded at events. The videos of event abc-2000
which is stored at data/events/abc-2000.json
are located in data/videos/abc-2000
. Each video is represented by a JSON file in that directory. Optionally
each video can also have a .html file (with the same filename as the JSON file has). The content of this HTML file
will be the "description" of the video. The reason we allow external files is to make it easy to spread the
text to multiple lines and to include html tags.
For now we are only indexing videos on YouTube.
Using a forked version of the youtube.py from https://github.com/pyvideo/data/tree/master/tools we can fetch the list of videos from Youtube and create the JSON files.
python3 tools/youtube.py -k YOUTUBE_API_KEY --list YOTUBE_PLAYLIST_ID -d 2016-08-03
This will create the a directory called category-TIMESTAMP
inside that directory is a subdirectory
called videos
which needs to be moved to conferences/data/videos/abc-2000
.
TODO: further change the Python script to save the length of the video.
- in the
speakers
field add the name of the speaker or speakers in "full-name" format. The format should only include lower case a-z letters and dash (-).
The name of the speaker usually can be found in title of the talk and/or in the description of the talk. In many cases the filename of the video also contains the name of the speaker(s). Sometimes however this is missing or only part of the name can be found. In such cases it is harder to track down who is the speaker.
Check if the file date/people/full-name.json exist, if not create it and fill it with the appropriate fields. You can usually find some of the details of the speaker on the web site of the event. From there you can usually find the other values as well.
name:
twitter:
github:
home:
country:
- Remove the name of the speaker and the name (and year) of the conference from the title. Keep just the real title of the talk. For example if this was the title "Foo Bar - Frobnicating the FuzzBazz - Conference 2016" then it looks like the name of the speaker is "Foo Bar" and the event is "Conference 2016". We would like the title to be: "Frobnicating the FuzzBazz"
If possible add a field called 'abstract' that will lead to the original page of the talk on the web site of the conference.
If you can find the slides of the talk, add a field called 'slides' linking to those slides.
Run python3 generate.py --html
to generate the web site and to check if the values in the speakers
field match the filenames.
The videos of these conferences were already added, but the speaker information has not been added yet:
-
fscons-2012
-
fscons-2013
-
pgconfus-2015 - Here has no speakers name, and website could not work
-
postgresopen-2012
-
linuxfest-northwest-2015 - (Here has only 6 json file, but huge lecture in website)
-
rubyconf-taiwan-2015 - (Use Mandarin Language)
-
fisl-17
-
libreplanet-2015 - (same as 2016)
-
libreplanet-2016 - there are only 5 json files, but in the website https://libreplanet.org/2016/program/grid-schedule.html
-
german-perl-workshop-2016 - schedule Don't match with json talk Link: http://act.yapc.eu/gpw2016/index.html
-
cssconf-budapest-2016 - Here has a single file but see this link: http://cssconfbp.rocks/schedule.html
-
devoxx-poland-2016 - Could not find 2016 Schedule, Link: http://devoxx.pl/
-
drupalcon-asia-2016 - Could not find complete schedule and speakers profile https://events.drupal.org/asia2016/sessions/proposed/business
-
node-interactive-2016
-
devday-pl-2012
-
angular-up-2016
-
bee-scala-2016
-
devcon-telaviv-2016-11
-
gotocon-accelerate-2016
-
meetingcpp-2016
-
nodeconf-barcelona-2015
-
rails-israel-2016
-
rubyday-italy-2016
grep speaker * | grep '\[\]'