README Simple crawler to crwal Alexa categories How do I get set up? Install Scrapy Clone this repo Change the starturl in ntuci/spiders/alexaspider.py To run: scrapy crawl alexaspider