Skip to content

This repo has the source code for the crawler and data crawled from auto-data.net

License

Notifications You must be signed in to change notification settings

Hyprnx/cars_specifications

Repository files navigation

CARS SPECIFICATION


This repo contains the source code for crawler and crawled data of cars specifications from autodata. The data has roughly 45k cars from round 1980 to late 2021. To be more specific, head to cars_specs.json. The data is raw, so you can do anything you want with it.

(back to top)


Getting started

Open Terminal / cmd and do the following:

Create and activate virtual environment

Create

 python -m venv <envname>

Activate

  • On Mac:
    source <envname>/bin/activate
  • On Windows:
    <envname>\Scripts\activate

(back to top)


Install requirements.txt

pip install -r requirement.txt

(back to top)

(back to top)


Running

This repo contains 1 (one) Python script that you can/should modify, head to autodata.py and run. If you are familiar with Scrapy, you can modify other settings, middleware or pipelines as you wish (not recommended).

Contact us

To Duc Anh

If you use this dataset, please give me a star and reference this repo. Thank you!

Project Link: Cars Specification

About

This repo has the source code for the crawler and data crawled from auto-data.net

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages