TODO

== BagelBox TODO

- KNOWN ISSUE: if you have a generic filter it will only match once per scraper run, even if there are multiple matching options.

- KNOWN ISSUE: Crontab sometimes doesn't stick unless I do a manual crontab -e...

- KNOWN ISSUE: Sometimes the download button on a source data file fails.



- More specs

- Add Auto refresh option to log page

- View amount of MB downloaded (or other kind of progress)

- Sort downloads. Show when it was downloaded

- Hide negatrive / disabled filters with a checkbox

- Contemplate replacing cron with the new whenever gem

- Detect if file type meta matchars have been changed in new version and offer to merge

- Auto update, if possible from within app

- Freeze gems/rails inside to make it standalone (if possible)

- Make sure current UI is cross-browser

- Create data_file_filters from every downloaded file automatically to prevent duplicate downloads with generic filters

- 'Search' content sources: some sites offer a rss stream for a search term. It would be nice to 
  use that as a content source dynamically based on active positive filters.
  
- List of all downloaded objects (also available via RSS)