rightmove.co.uk is one of the UK's largest property listings websites, hosting thousands of listings of properties for sale and to rent.
rightmove_webscraper.py is a simple Python interface to scrape property listings from the website and prepare them in a Pandas dataframe for analysis.
Version 0.3 is now available as a package with all required dependencies on Pip.
Install with:
pip install -U rightmove-webscraper
- Go to rightmove.co.uk and search for whatever listings you are interested in ...
- Filter the search however you choose ...
- Run the search and copy the URL of the results page ...
- Create an instance of the class on the URL ...
from rightmove_webscraper import rightmove_data
url = "http://www.rightmove.co.uk/property-for-sale/find.html?locationIdentifier= [...] "
rightmove_object = rightmove_data(url)- Access the data using the methods and attributes of the object ...
Find the average price of all listings returned by the search:
rightmove_object.average_price
Show the total number of listings returned by the search:
rightmove_object.results_count
Access the full results as a Pandas dataframe with the .get_results attribute.
rightmove_object.get_results
Get quick summary statistics of the results, showing the number of listings and average price grouped by the number of bedrooms:
rightmove_object.summary()
Alternatively group the results by any other column returned in the .get_results DataFrame, for example Postcode:
rightmove_object.summary(by = "postcode")
@toddy86 has pointed out per the terms and conditions here the use of webscrapers is unauthorised by rightmove. So please don't use this package!