This is an open source project aims at crawling data from the Internet.
One can't make bricks without straw.
The motivation of launching this project is that data is playing more and more important role in data science area, and most of the time the data scientist have to spend a lot of energy on crawling data that they need. Thus we launch the project for the sake of reducing burden of the one who need data from the Internet.
- Python 3.5 +
- shfe: Crawling the copper futures prices from Shanghai Futures Exchange
- desc:：Daily futures exchanging data from Shanghai Futures Exchange
- data page: http://www.shfe.com.cn/statements/dataview.html?paramid=kx
- url: "http://www.shfe.com.cn/data/dailydata/kx/kx" + exchange_date + ".dat"
- data description: @see table definition
There is a main method in each python file so you can run it easily.
- Yinwei Li
- wechat: coridc
- email: [email protected]
Don't hesitate to contact me on any topics about this project at your convenience.
When contributing to this repository, you can first discuss the change you wish to make via issue, email, or any other method with the owners of this repository.
This project is licensed under the GNU General Public License v3.0 License - see the LICENSE file for details.
I'd like hat tip to anyone who use the codes or send me any proposals of the project.