Summary 7 days for this small spider. It can crawl comment slowly and efficent. Starting command scrapy crawl commment data : saving basic comments and html others : this isn't related to this spider, just code Spider_ctrip : this is the main file for spider 2018-01-18