Optimised Data Structures for Large Scale Content-Based Geo-Indexing

Egileak: Luigi Mascolo Marco Quartulli Giovanni Nico Pietro Guccione Igor García Olaizola

Data: 26.07.2015


Abstract

Image mining consists of the procedures that allow to access, search and explore very large databases of data. Institutions like spatial agencies have to manage huge archives of Earth Observation (EO) images and need solutions to make data available to users from both the algorithmic and the infrastructural point of views. On the other side, users would need to explore the variety of images not just based on metadata, like time of acquisition or sensor parameters, but also by getting knowledge of their content. In this contribution, we investigate methodologies for content-based EO image retrieval via example-based queries. In particular, we present a procedure for the indexing of large-scale unstructured archives, built on top of a cluster analytics framework, Apache Spark. The procedure is based on a hierarchical and scalable implementation of a space partitioning algorithm and allows O(log n) response query times. Scalability analyses are conducted on polarimetric data from NASA/JPL archives, by using virtualized computing resources distributed over the Internet. In particular, the effects of the cluster size and of the hardware scale-up are demonstrated. The results also reveal the applicative potential of using on-demand cloud-based resources.

BIB_text

@Article {
title = {Optimised Data Structures for Large Scale Content-Based Geo-Indexing},
pages = {1488-1491},
keywds = {

Content-Based Retrieval, Remote Sensing, Elastic Cloud Computing, Big Data, Polarimetric SAR


}
abstract = {

Image mining consists of the procedures that allow to access, search and explore very large databases of data. Institutions like spatial agencies have to manage huge archives of Earth Observation (EO) images and need solutions to make data available to users from both the algorithmic and the infrastructural point of views. On the other side, users would need to explore the variety of images not just based on metadata, like time of acquisition or sensor parameters, but also by getting knowledge of their content. In this contribution, we investigate methodologies for content-based EO image retrieval via example-based queries. In particular, we present a procedure for the indexing of large-scale unstructured archives, built on top of a cluster analytics framework, Apache Spark. The procedure is based on a hierarchical and scalable implementation of a space partitioning algorithm and allows O(log n) response query times. Scalability analyses are conducted on polarimetric data from NASA/JPL archives, by using virtualized computing resources distributed over the Internet. In particular, the effects of the cluster size and of the hardware scale-up are demonstrated. The results also reveal the applicative potential of using on-demand cloud-based resources.


}
isbn = {978-1-4799-7929-5},
isi = {1},
date = {2015-07-26},
year = {2015},
}
Vicomtech

Gipuzkoako Zientzia eta Teknologia Parkea,
Mikeletegi Pasealekua 57,
20009 Donostia / San Sebastián (Espainia)

+(34) 943 309 230

close overlay