GIS Tools for Hadoop

[darksabersan]

GIS Tools for Hadoop

The project contains an open source framework and API that enables big data developers to author custom spatial applications for Hadoop.

The GIS Tools project also enables the ArcGIS platform to leverage big data on Hadoop using tools that combine custom Hadoop applications with the ArcGIS Geoprocessing environment.

The project supports processing of simple vector data (Points, Lines, Polygons) and basic analysis operations, e.g. relationship analysis on that data, running in a Hadoop distributed processing environment.

An overview page, including sample tools, can be found here: http://esri.github.com/gis-tools-for-hadoop

 

Tutorials

• NEW : GIS Tools for Hadoop for Beginners: A tutorial for anyone new to Hadoop. A very quick intro on how to setup your own cluster using a virtual machine (we use VirtualBox with the Hortonworks Sandbox) and begin using GIS Tools for Hadoop.

• NEW : Aggregating CSV Data (Spatial Binning): This tutorial goes through the steps of aggregating big data into square bins to simplify the information.

• NEW: Correcting Projection in ArcGIS : This tutorial goes through two methods of making sure unprojected data from HDFS is properly projected in ArcMap.

• Getting the results of a Hive query into ArcGIS: This tutorial goes through the steps of using the Geoprocessing tools in ArcGIS to move your data from HDFS to ArcMap, where you can then display your data, as well as perform further analysis.

• Getting a Feature Class into HDFS: This tutorial goes through the steps of moving local data (stored as .shp or a feature class) to HDFS, which allows you to complete distributed analytics.

[Lurker]

oh geeez big spatial data, when I get chance to implement this database