Skip to content

382982408/blog_spider_user_scrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 

Repository files navigation

这是一个scrapy爬取博客的工程

  1. 环境:python3.6 + scrapy

  2. 主要原理:通过获取最新文章,利用xpath提取“下一页”和文章内容,自动进行全站爬取

About

scrapy的一个应用实例。

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages