SlideShare uma empresa Scribd logo
1 de 83
Baixar para ler offline
Nederland Ontsloten! 
Just van den Broecke 
OSGeo.nl Dag - Den Bosch - 25 nov 2014 
just@justobjects.nl
DRIE PETTEN 
Onafhankelijk Open 
Geo-ICT Professional 
justobjects.nl 
Lid van de 
OpenGeoGroep (NL) 
www.opengeogroep.nl 
Secretaris 
OSGeo.nl 
1. Intro
Nederland Ontsloten ?
Van Bron 
Naar Toepassing 
met Open Geo Data
Nuttige Dingen Doen 
Met Open Geo Data
Nederland Ontsloten! OSGeo.nl Dag 2014
1/1/2012 
Basisregistraties 
Worden Open Data!
We kunnen 
Downloaden bij 
PDOK!!
Bijvoorbeeld 
Top10 NL en BAG 
Binnenhalen....
Maar Wat Dan?
Bakken met XML/ 
GML......
GML ? 
XML 
Hoe maken we daar 
een kaart mee?
? 
GML 
XML 
Of bijv een adres-zoeker?
? 
GML 
XML 
Eerst inlezen in 
PostGIS....
GML 
Met NLExtract 
XML 
Dus!! 
NLExtract
Wat is NLExtract ?
Open Source 
Tools om vrije 
Nederlandse 
overheids-­geodata te 
converteren en te 
visualiseren
NLExtract - Welke Datasets ? 
BAG -­ Basis Registratie Adressen en Gebouwen 
BRT/Top10NL -­ Topografische Kaart 
BGT -­ Grootschalige Topografie 
AHN - Hoogtebestand 
Top10NL3D !!! 
Bonnebladen (historische kaarten)
NLExtract 
Praktijk 
Voorbeelden
Nederland Ontsloten! OSGeo.nl Dag 2014
Nederland Ontsloten! OSGeo.nl Dag 2014
NLExtract: 
BAG + Top10NL 
+WMS/Tiling + App
BAG in CitySDK
BGT in QGIS
Georefereren + aansluiten 
Bonnebladen
NLExtract Technologie 
ogr2ogr 
www.gdal.org Python 
QGIS 
Stetl
Meer weten, 
meedoen en/of 
sponsoren ?
www.nlextract.nl
Nederland Ontsloten! OSGeo.nl Dag 2014
NLExtract Plannen 
Downloads! 
Services! 
Apps! 
3D!!
http://data.nlextract.nl 
Downloads
NLExtract Plannen 
Downloads 
Services! 
Apps! 
3D!
http://app.nlextract.nl 
OpenTopo Tiles (TMS/WMTS) in Leaflet App
NLExtract Plannen 
Downloads 
Services 
Apps 
3D!!
Nederland Ontsloten! OSGeo.nl Dag 2014
Nederland Ontsloten! OSGeo.nl Dag 2014
What the…FGDB?!
Nederland Ontsloten! OSGeo.nl Dag 2014
FGDB naar GeoJSON en GML met ogr2ogr
Visualiseren met CesiumJS
Cesium is Cool!
Cesium is Cool (hier letterlijk) !
CesiumJS - SantaTracker
OpenTopo in CesiumJS
Zon in de Zee zien zakken in …
Top103D Gebouwen
Cesium - OpenLayers3 Integratie
Doorbraak 3D? 
Er kan nog veel meer met 
3D Open Source en 
NL Open Geo-Data 
Vector3D Tiles? 
AHN2 Terrain Server?
Samengevat 
• Ruwe data verwerking met NLExtract (en Stetl) 
• Opslaan in PostGIS (vector) en GeoTIFF (raster) 
• Serveren met GeoServer/MapServer/Tiling etc 
• Visualiseren: QGIS, Leaflet, OpenLayers, CesiumJS etc 
• 3D mogelijkheden te over!
Dank U
Stetl 
Indien tijd over ;-)
Programma per Dataset?
Inlezen 
Omzetten 
Wegschrijven
Extract 
Transform 
Load
ETL
FOSS ETL - High Level
FOSS ETL - Lower Level 
ogr2ogr 
Individueel krachtig maar 
kan vaak slechts deel van ETL uitvoeren
FOSS ETL - Hoe Combineren? 
+ + = ? 
ogr2ogr
FOSS ETL - Add Python to Equation 
( + + ) = ? 
ogr2ogr
( ) 
+ + = 
ogr2ogr 
Stetl
Stetl 
= 
Simple 
Streaming 
Spatial 
Speedy 
ETL
http://www.stetl.org
Stetl 
Concepten
Processing Keten 
Bron Doel 
Input Filter Filter Output 
Stetl concepten
Processing Keten 
Input Filter Output 
gml 
Filter 
Stetl concepten
Voorbeeld - XML naar Shapefile 
XML 
Input 
XSLT 
Filter 
ogr2ogr 
Output 
XML 
GML
Voorbeeld - Eigen Component 
Any 
Input 
My! 
Filter 
Any 
Output
Voorbeeld - XML naar Shapefile 
Stetl Configuratie File 
Process 
Chain 
XML 
XSLT 
Input 
Filter 
ogr2ogr 
Output
Example Components 
Input Filters Output 
File (XML, GML, CSV) XSLT (Multi)File (GML, GeoJSON,..) 
GDAL/OGR XMLAssembler GDAL/OGR 
LineStream XMLValidator WFS-T 
SQLite FormatConverter HTTP 
WFS FeatureExtractor SOS-T 
PostGIS Jinja2Filter PostGIS 
YourInput YourFilter YourOutput 
Stetl concepten
Speed: Streaming 
Input Filter Output 
gml 
Stetl concepts
Speed: Going Native 
Input Filter Output 
gml 
Calls 
ogr2ogr Stetl Stetl 
Native C Libs/Progs 
Stetl concepts
Stetl Uitvoeren 
stetl -c etl.cfg
Stetl Installeren 
via PyPi 
sudo pip install stetl 
Deps 
•GDAL+Python bindings! 
•lxml (xml proc)! 
•psycopg2 (Postgres)
Stetl - Praktijk ! 
• Basisregistraties 
GML to PostGIS: Top10NL, BGT 
• INSPIRE 
transformatie BAG naar Addresses 
• RIVM Luchtmetingen 
naar WMS-Time en SOS 
EU Air Quality/INSPIRE Reporting 
• UK Ordance Survey Mastermap
BGT - Dutch Large Scale Topo
2. Data Transformation (ETL) 
Stetl 
RIVM 
AQ 
Stetl 
Stetl 
Stetl
RIVM Luchtkwaliteit via WMS-Time 
4. Clients
Clients - SOS - SOS.js - 52N 
4. Clients
Samengevat 
• Ruwe data verwerking met NLExtract en Stetl 
• Opslaan in PostGIS (vector) en GeoTIFF (raster) 
• Serveren met GeoServer/MapServer/Tiling etc 
• Visualiseren met QGIS en Heron
Dank U
NLExtract Artikel Geo-info 2013 - 8/9
www.nlextract.nl 
! 
bezoek ook de 
OpenGeoGroep Stand
Stetl 
http://www.stetl.org

Mais conteúdo relacionado

Mais de Just van den Broecke

Just's Career Highlights - Version 2
Just's Career Highlights - Version 2Just's Career Highlights - Version 2
Just's Career Highlights - Version 2Just van den Broecke
 
Just's Career Highlights - Version 1
Just's Career Highlights - Version 1Just's Career Highlights - Version 1
Just's Career Highlights - Version 1Just van den Broecke
 
Open Sensor Networks with LoRa TTN and SensorThings API
Open Sensor Networks with LoRa TTN and SensorThings APIOpen Sensor Networks with LoRa TTN and SensorThings API
Open Sensor Networks with LoRa TTN and SensorThings APIJust van den Broecke
 
Sensor SDI in PDOK with Smart Emission Platform
Sensor SDI in PDOK with Smart Emission PlatformSensor SDI in PDOK with Smart Emission Platform
Sensor SDI in PDOK with Smart Emission PlatformJust van den Broecke
 
OSGeo.nl-NewYearsParty-2018-Opening
OSGeo.nl-NewYearsParty-2018-OpeningOSGeo.nl-NewYearsParty-2018-Opening
OSGeo.nl-NewYearsParty-2018-OpeningJust van den Broecke
 
Smart Emission - Citizens measuring Air Quality - Overview
Smart Emission - Citizens measuring Air Quality - OverviewSmart Emission - Citizens measuring Air Quality - Overview
Smart Emission - Citizens measuring Air Quality - OverviewJust van den Broecke
 
Geospatial ETL with Stetl - GeoPython 2016
Geospatial ETL with Stetl - GeoPython 2016Geospatial ETL with Stetl - GeoPython 2016
Geospatial ETL with Stetl - GeoPython 2016Just van den Broecke
 
Smart Emission - Data - Viewers - Standards
Smart Emission - Data - Viewers - StandardsSmart Emission - Data - Viewers - Standards
Smart Emission - Data - Viewers - StandardsJust van den Broecke
 
3D Breakthrough Meeting - 3D Standards progress
3D Breakthrough Meeting - 3D Standards progress3D Breakthrough Meeting - 3D Standards progress
3D Breakthrough Meeting - 3D Standards progressJust van den Broecke
 
Wandelen met GPS en De Evolutie van Navigatie
Wandelen met GPS en De Evolutie van NavigatieWandelen met GPS en De Evolutie van Navigatie
Wandelen met GPS en De Evolutie van NavigatieJust van den Broecke
 
Big Data - Introduction and Research Topics - for Dutch Kadaster
Big Data - Introduction and Research Topics - for Dutch KadasterBig Data - Introduction and Research Topics - for Dutch Kadaster
Big Data - Introduction and Research Topics - for Dutch KadasterJust van den Broecke
 
SensorWeb SOS Pilot RIVM/Geonovum - Status
SensorWeb SOS Pilot RIVM/Geonovum - StatusSensorWeb SOS Pilot RIVM/Geonovum - Status
SensorWeb SOS Pilot RIVM/Geonovum - StatusJust van den Broecke
 
Stetl for INSPIRE Data Transformation
Stetl for INSPIRE Data TransformationStetl for INSPIRE Data Transformation
Stetl for INSPIRE Data TransformationJust van den Broecke
 
XSLT for INSPIRE Transformation by Dutch Kadaster in ESDIN
XSLT for INSPIRE Transformation by Dutch Kadaster in ESDINXSLT for INSPIRE Transformation by Dutch Kadaster in ESDIN
XSLT for INSPIRE Transformation by Dutch Kadaster in ESDINJust van den Broecke
 

Mais de Just van den Broecke (20)

Just's Career Highlights - Version 2
Just's Career Highlights - Version 2Just's Career Highlights - Version 2
Just's Career Highlights - Version 2
 
Just's Career Highlights - Version 1
Just's Career Highlights - Version 1Just's Career Highlights - Version 1
Just's Career Highlights - Version 1
 
Open Sensor Networks
Open Sensor NetworksOpen Sensor Networks
Open Sensor Networks
 
Open Sensor Networks with LoRa TTN and SensorThings API
Open Sensor Networks with LoRa TTN and SensorThings APIOpen Sensor Networks with LoRa TTN and SensorThings API
Open Sensor Networks with LoRa TTN and SensorThings API
 
Sensor SDI in PDOK with Smart Emission Platform
Sensor SDI in PDOK with Smart Emission PlatformSensor SDI in PDOK with Smart Emission Platform
Sensor SDI in PDOK with Smart Emission Platform
 
osgeonl-opening-foss4gnl-2018
osgeonl-opening-foss4gnl-2018osgeonl-opening-foss4gnl-2018
osgeonl-opening-foss4gnl-2018
 
Stetl-engine-nlextract-smartem
Stetl-engine-nlextract-smartemStetl-engine-nlextract-smartem
Stetl-engine-nlextract-smartem
 
OSGeo.nl-NewYearsParty-2018-Opening
OSGeo.nl-NewYearsParty-2018-OpeningOSGeo.nl-NewYearsParty-2018-Opening
OSGeo.nl-NewYearsParty-2018-Opening
 
Opening OSGeo.nl Day 2017
Opening OSGeo.nl Day 2017Opening OSGeo.nl Day 2017
Opening OSGeo.nl Day 2017
 
Smart Emission Data Platform
Smart Emission Data PlatformSmart Emission Data Platform
Smart Emission Data Platform
 
Smart Emission - Citizens measuring Air Quality - Overview
Smart Emission - Citizens measuring Air Quality - OverviewSmart Emission - Citizens measuring Air Quality - Overview
Smart Emission - Citizens measuring Air Quality - Overview
 
Geospatial ETL with Stetl - GeoPython 2016
Geospatial ETL with Stetl - GeoPython 2016Geospatial ETL with Stetl - GeoPython 2016
Geospatial ETL with Stetl - GeoPython 2016
 
Smart Emission - Data - Viewers - Standards
Smart Emission - Data - Viewers - StandardsSmart Emission - Data - Viewers - Standards
Smart Emission - Data - Viewers - Standards
 
3D Breakthrough Meeting - 3D Standards progress
3D Breakthrough Meeting - 3D Standards progress3D Breakthrough Meeting - 3D Standards progress
3D Breakthrough Meeting - 3D Standards progress
 
Wandelen met GPS en De Evolutie van Navigatie
Wandelen met GPS en De Evolutie van NavigatieWandelen met GPS en De Evolutie van Navigatie
Wandelen met GPS en De Evolutie van Navigatie
 
OSGeo.nl - Year 2014 Highlights
OSGeo.nl - Year 2014 HighlightsOSGeo.nl - Year 2014 Highlights
OSGeo.nl - Year 2014 Highlights
 
Big Data - Introduction and Research Topics - for Dutch Kadaster
Big Data - Introduction and Research Topics - for Dutch KadasterBig Data - Introduction and Research Topics - for Dutch Kadaster
Big Data - Introduction and Research Topics - for Dutch Kadaster
 
SensorWeb SOS Pilot RIVM/Geonovum - Status
SensorWeb SOS Pilot RIVM/Geonovum - StatusSensorWeb SOS Pilot RIVM/Geonovum - Status
SensorWeb SOS Pilot RIVM/Geonovum - Status
 
Stetl for INSPIRE Data Transformation
Stetl for INSPIRE Data TransformationStetl for INSPIRE Data Transformation
Stetl for INSPIRE Data Transformation
 
XSLT for INSPIRE Transformation by Dutch Kadaster in ESDIN
XSLT for INSPIRE Transformation by Dutch Kadaster in ESDINXSLT for INSPIRE Transformation by Dutch Kadaster in ESDIN
XSLT for INSPIRE Transformation by Dutch Kadaster in ESDIN
 

Nederland Ontsloten! OSGeo.nl Dag 2014