Skip to content

biggerbiggest/scrapy_alibaba

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

9 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

基于scrapy爬取ali巴巴移动版的供货商公司信息的爬虫

依赖包:BeautifulSoup,scrapy

运行方法

cd ./scrapy_alibaba
scrapy crawl ali88

数据保存在本地mongdb:27017/alibaba_test数据库下,可在setting.py中修改mongo设置,更多参考scrapy文档

运行结果 注:截图中地理坐标和区域是后续地理编码处理加上的,不包含在这里

About

scrapy阿里巴巴供货商公司爬虫

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%