Simple webscraper made to scrape complaints for Mission 3 at Mission Ready. Data was to be used in a index as part of a customer service search portal. Dumps complaints to a csv for processing with a lightweight wrangler.
- Install dependancies
python3 -m venv ./env
source ./env/bin/activate
pip install -r reqs.txt
- update
main_link
in code - run
scraper.py
until sufficient complaints colected - run
wrangler.py
to tidy up csv