Skip to content

aidiss/slant-scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

6 Commits
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Slant Scraper

Scrapes info from www.slant.co Only for educational purposes. Use at own risk, it might violate Slant policies.

  • Versus. A comparison of two techs.
  • Options. A detailed description of a particular option.
  • Topics. A comparison of different topics.

Dependencies

Install:

Tested configuration

  • Python 3.6.4 + Scrapy 1.5

Usage - Have fun!

cd slant-scraper/

Scrape and save data in JSON lines format:

scrapy crawl main -o output/result.json

For JSON format use:

scrapy crawl main -o output/result.json -t json