Skip to content

Latest commit

 

History

History
110 lines (70 loc) · 3.65 KB

README.md

File metadata and controls

110 lines (70 loc) · 3.65 KB
Raw

UK Postcode data for Nominatim

The Nominatim server supports importing additional postcodes per country from comma-separated files, see import instructions. This document described how the file gb_postcodes.csv.gz gets created.

Older versions of Nominatim supported database dump files (gb_postcode_data.sql.gz) instead. If you want to generate those check out the older sql-file-generation tag of this repository.

Data sources and licenses

Data consists of

  1. Code-Point® Open for England, Scotland, Wales with about 1.7 million postcodes

    Ordnance Survey, the national mapping agency for Great Britain, publishes the open dataset four times per year at https://osdatahub.os.uk/downloads/open/CodePointOpen

  2. About 27.000 Northern Ireland postcodes

    https://github.com/osm-uk/NI-Postcodes derived from Food Hygiene Ratings Scheme Data sets. The data set contains duplicates which aggregate_ni.py removes by calculating a center point for each postcode. That leads to about 10.000 postcodes.

Both are licensed under Open Government Licence (v3).

GB vs UK

Great Britain is England, Scotland, Wales.

United Kingdom is England, Scotland, Wales, Northern Ireland.

For probably historical reasons the the ISO-3166 country code for the United Kingdom is 'GB'. Nominatim, and OpenStreetMap database in general, expects 'gb' thus the output filename contains 'gb'.

Creating the file

  1. Install dependencies

     # assuming Ubuntu
 apt-get install unzip python3
 pip3 install pyproj

  2. Download source files

     ./download.sh

    You'll see a directory of CSV files.

     cat codepo_gb/Data/CSV/*.csv | wc -l
 # 1719485

 more Data/CSV/n.csv
 "N1 0AA",10,530626,183961,"E92000001","E19000003","E18000007","","E09000019","E05000368"
 "N1 0AB",10,530559,183978,"E92000001","E19000003","E18000007","","E09000019","E05000368"

    The coordinates are "Northings" and "Eastings" in OSGB 1936 projection.

  3. Convert data

     ./convert.py > gb_postcodes.csv
 ./aggregate_ni.py > NI-postcodes-agg.csv
 cp gb_postcodes.csv gb_and_ni_postcodes.csv
 tail -n+2 NI-postcodes-agg.csv >> gb_and_ni_postcodes.csv

 # expect about 1.7m
 wc -l gb_*postcodes.csv

  4. Compare to previous data

     wget -O gb_postcodes.previous.csv.gz https://downloads.opencagedata.com/public/gb_postcodes.latest.csv.gz
 gunzip -f gb_postcodes.previous.csv.gz

 ./compare.py gb_postcodes.previous.csv gb_postcodes.csv
 # Read 1717777 postcodes from old file gb_postcodes.previous.csv
 # Read 1719485 postcodes from new file gb_postcodes.csv
 # Added: 3674 (0.214%)
 # Deleted: 1966 (0.114%)
 # Position moved: 68857 (4.005%)
 # Position moved more than 100 meters: 10517 (0.612%)
 # Position moved more than 1000 meters: 553 (0.032%)
 # Position moved more than 10000 meters: 16 (0.001%)
 # Average distance difference of all updates: 83.76 meters

  5. Compress output

     gzip -9 -f gb_*postcodes.csv
 ls -lah *.gz
 # 14M gb_and_ni_postcodes.csv.gz
 # 13M gb_postcodes.csv.gz

  6. Cleanup source files

     rm -r codepo_gb.zip codepo_gb NI-postcodes.csv NI-postcodes-agg.csv gb_postcodes.previous.csv

License

The source code is available under a GPLv2 license.