-
Notifications
You must be signed in to change notification settings - Fork 2k
Issues: dataabc/weiboSpider
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
配置好json后,用pycharm运行Python3 -m weibo_spider没有报错也没有任何输出
failed
程序运行出错
#635
opened Feb 4, 2025 by
biejingaoguai
updated Feb 5, 2025
希望增加一个出现'NoneType' object报错以后过几分钟自动重新运行的功能
feature
新需求
#633
opened Jan 18, 2025 by
jackma64
updated Jan 18, 2025
随机等待时长已经加到非常长了,但还是会在相似的页数被封禁
failed
程序运行出错
#578
opened Apr 28, 2024 by
EthanNCai
updated Jan 13, 2025
运行一会下载了89条数据后,weibo.cn就访问不了。是被反爬策略禁止了吗?
failed
程序运行出错
#626
opened Dec 25, 2024 by
dahai001
updated Dec 25, 2024
File "D:\Ancaonda\Lib\site-packages\scrapy\core\spidermw.py", line 104, in process_sync for r in iterable: File "D:\Python Project\weibo-search-master\weibo\spiders\search.py", line 241, in parse_by_hour_province for weibo in self.parse_weibo(response): File "D:\Python Project\weibo-search-master\weibo\spiders\search.py", line 537, in parse_weibo weibo["ip"] = self.get_ip(bid) ~~~~~^^^^^^ File "D:\Ancaonda\Lib\site-packages\scrapy\item.py", line 85, in __setitem__ raise KeyError(f"{self.__class__.__name__} does not support field: {key}") KeyError: 'WeiboItem does not support field: ip'
bug
#625
opened Dec 19, 2024 by
ycwang806
updated Dec 19, 2024
WeiboItem does not support field: ip
failed
程序运行出错
#624
opened Dec 19, 2024 by
ycwang806
updated Dec 19, 2024
你好,我在setting.py中设置WEIBO_TYPE = 0,就运行不了,爬取不了数据是为什么。并且设置WEIBO_TYPE=2或者1的时候爬取不到头条url和发布位置和reweet_id是为什么# 要搜索的微博类型,0代表搜索全部微博,1代表搜索全部原创微博,2代表热门微博,3代表关注人微博,4代表认证用户微博,5代表媒体微博,6代表观点微博
failed
程序运行出错
#623
opened Dec 18, 2024 by
sansan303
updated Dec 18, 2024
cannot import name 'etree' from 'lxml'
bug
#611
opened Nov 19, 2024 by
Ehcochwy
updated Nov 19, 2024
end_date 设置为 now 无法正常爬取所有微博
failed
程序运行出错
#609
opened Nov 8, 2024 by
cinyearchan
updated Nov 8, 2024
Previous Next
ProTip!
Find all open issues with in progress development work with linked:pr.