Web crawler This repository contains two methods for scrapping WP-JSON Use Wordpress API - more info in wp-json/README.md Scrapy Use Scrapy - more info in scrapy_scraper/README.md