peermaps-ingest

Status: This has been used to successfully import an OSM PBF of Puerto Rico.

Module and CLI to read OSM PBF data, store it in an intermediary leveldb, convert it to new line delimited georender file, put it into an eyros database, and then host that as a hyperdrive.

This module is glue between osm-pbf-parser, georender-pack & georender-eyros.

Do the entire processing pipeline, from OSM PBF to eyros hyperdrive by running:

peermaps-ingest osm.pbf --datadir data

This will write your OSM to a leveldb (data/level), write new line delimited georender of your OSM (dadta/georender), write an eyros db from your georender data (data/eyros), and a hyperdrive of the eyros db (data/hyperdrive).

The command can also be use in parts.

$ peermaps-ingest osm2level osm.pbf -o data/level
$ peermaps-ingest level2georender data/level -o data/georender
$ cat data/georender | npx georender-eyros --datadir data/eyros --format base64
$ peermaps-ingest eyros2hyperdrve data/eyros -o data/hyperdrive

To create a hyperdrive of a subset of OSM features, pass in the IDs that you want to have a hyperdrive of into peermaps-ingest level2georender

$ peermaps-ingest level2georender data/level -o data/georender --id relation:7117066,relation:253642,relation:2747855

The resulting georender-eyros-hyperdrive can be served using the peermaps cli, and consumed by peermaps-web.