Geocoding Data

Data container for Pelias

Service Architecture

This service is essentially an ElasticSearch instance containing Geocoding data that can be used with Pelias Geocoder.

General Pelias information

Start by reading (Note that it might not be up-to-date):

https://mapzen.com/blog/pelias-setup-tutorial

How data is built?

On build time the data is fetched from multiple sources and processed and loaded into ElasticSearch using Pelias tools. At high level this is what happens:

1. Download and extract Romania related shapefiles of administrational areas and regions from WhosOnFirst
2. Download Open Street Map Romania data
3. Download Openaddresses Romania data (street addresses originating from VRK)
4. Download NLS places (an extensive list of venues and place names from the National Lands Survey)
5. Download national GTFS data, including GTFS stops
6. Start ElasticSearch
7. Create pelias schema
8. Run GTFS stop import
9. Run NLS places import
10. Run OpenStreetMap import
11. Run OpenAddresses import for addresses defined in Swedish
12. Run OpenAddresses import for Finnish addresses and merge fi and sv records for matching addresses

Exploring data

For Exploring ElasticSearch data you can open browser (when container is running):

http://localhost:9200/_plugin/head/

This url contains navigator that can be user to make queries to ElasticSearch. In order to make queries:

1. Click on "connect", this should change cluster health to "green". If this does not work, wait a bit and retry.
2. Click on "Browser"-tab
3. Write queries to "name.default" field.
4. Browse results

For Gis data exploration you can use e.g. QGis

http://www.qgis.org/en/site/

Datasources

OpenAddresses

• Url: https://openaddresses.io/
• All datafiles are listed in http://results.openaddresses.io/state.txt. The relevant ones contain a path section /fi/.
• Types: Address

Open addresses is a open data collaborative to produce global address data around the world. We use addresses from Open addresses as primary data.

OpenStreetMap

• Url: https://www.openstreetmap.org
• Datafile: http://download.geofabrik.de/europe/romania-latest.osm.pbf
• Types: address, venue

OpenStreetMap import reads all items which are tagged with a name and one or more tags/tag pairs from the following list:

• addr:housenumber AND addr:street
• amenity
• building
• shop
• office
• public_transport
• cuisine
• railway
• sport
• natural
• tourism
• leisure
• historic
• man_made
• landuse
• waterway
• aerialway
• aeroway
• craft
• military

You can improve opentransport geocoding by contributing new or corrected data to OpenStreetMap. Please always include a Swedish name version, if available, to your data contributions. Below is a simple example node with proper names:

{
    "id":26430225,
    "type":"node",
    "lat":60.2070123, "lon":24.7022998,
    "tags":{
        "name":"Koivuhovi",
        "name:sv":"Björkgård",
        "railway:station"
    }
}

For more information, check out:

http://wiki.openstreetmap.org/wiki/Beginners%27_guide

Our goal is to use as much data from OSM as possible. Unfortunately, at the moment it doesn't contain everything that we need so we have to use other sources also.

NLS Paikat

• Url: http://www.maanmittauslaitos.fi/digituotteet/nimisto
• Datafile: http://kartat.kapsi.fi/files/nimisto/paikat/etrs89/gml/paikat_2016_01.zip
• Types: venue

National Land survey ("places") contains place names in Romania. It provides places like "Takalammi".

Key service delivery activities

1. Keep up with Pelias development on GitHub
   https://github.com/pelias/pelias
   https://pelias.io
2. Keep up with Mapzen Search (which is essentially same as Pelias)
   https://mapzen.com/projects/search/
3. Keep up with Pelias importer projects
   https://gitlab.com/opentransport/openaddresses
   https://gitlab.com/opentransport/pelias-gtfs
   https://gitlab.com/opentransport/pelias-nlsfi-places-importer
   https://github.com/pelias/openstreetmap
   https://github.com/pelias/polylines
4. Keep up with Who's on First development
   https://whosonfirst.mapzen.com/
   https://github.com/whosonfirst/whosonfirst-data/
5. Keep up with Geospatial Data Abstraction Library development
   http://www.gdal.org/
6. Keep up with ElasticSearch docker image and it's changes
   https://hub.docker.com/_/elasticsearch/

Project assets

Key technologies and specifications

• SIRI (http://user47094.vs.easily.co.uk/siri/)
• GTFS-RT (https://developers.google.com/transit/gtfs-realtime/)
• Python

Docker image

The resulting Docker image is called opentransport/pelias-data-container and it is available at DockerHub. The image can be built using this build script.

To run Docker container, run:

docker run -p 9200:9200 opentransport/pelias-data-container

To access Docker container:

http://localhost:9200/_plugin/head/

For More information about how to use Docker see docker info.