all-page-scraper

ruby version

• try this tutorial: https://www.twilio.com/blog/5-ways-make-http-requests-ruby
• uses the english words list from https://github.com/dwyl/english-words
• uses gems 'httparty' and 'net/http', these are also viewable from the gemfile.
• 'httparty' -> https://rubygems.org/gems/httparty
• 'net/http' -> https://ruby-doc.org/stdlib-2.7.1/libdoc/net/http/rdoc/Net/HTTP.html

python version

• Please ensure you have (at some point) run

pip install requests

configuration is located at the top of the python file