Skip to content

Latest commit

 

History

History
16 lines (11 loc) · 441 Bytes

README.md

File metadata and controls

16 lines (11 loc) · 441 Bytes

UyghurWebsiteCrawler

simple crawler for some uyghur website such as uy.ts.cn,bbs.bagdax.cn,www.bagdax.cn(using python and scrapy)

Preparations (all you need to know):

Python and Scrapy is needed.

Before run this code , please read the Scrapy Docs: http://scrapy.org/

how to RUN

To run the code open the Terminal and run the commond some like below(where xxx is your scrapy spider name ):

scrapy crawl xxxx