Scrapes info from www.slant.co Only for educational purposes. Use at own risk, it might violate Slant policies.
- Versus. A comparison of two techs.
- Options. A detailed description of a particular option.
- Topics. A comparison of different topics.
Install:
- Python 3.6.4 + Scrapy 1.5
cd slant-scraper/
Scrape and save data in JSON lines format:
scrapy crawl main -o output/result.json
For JSON format use:
scrapy crawl main -o output/result.json -t json