尚未完成的项目
This project is unfinished, you can see the following work progress in https://github.com/JohnDing1995/Selecting-Master-Program-USA
You can now serach admission cases on http://123.206.99.164/
Python 3.6
Scrapy
Pymongo
-
Clone this repository
-
cd to the root of the project, run
scrapy crawl ad_information -
The data will shown in your mongdb database,like this
-
Yan can query the database as according to your own need
eg. To find the admissions of CS master@north Carolina state university(NCSU),you can query like this
-
I'm developing a website which provides admission information query service at Here
-
2017/3/11 add mongdb data storage,
- bug to fix:some void data didn't added to db, which makes fields don't match with each other
-
2017/3/13 Rewrite Selector modual with regular expression , now the void data will be stored in the database, and the bug fixed;Optimize the database storage, now each admission information can be stored as a single object
-
2017/4/10 Save url link of each admission case to db
-
2017/7/3 Add admission status to db