Processing

Please wait...

Settings

Settings

Goto Application

1. CN110083598 - Spark-oriented remote sensing data indexing method and system and electronic equipment

Office China
Application Number 201910223461.8
Application Date 22.03.2019
Publication Number 110083598
Publication Date 02.08.2019
Publication Kind A
IPC
G06F 16/22
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
16Information retrieval; Database structures therefor; File system structures therefor
20of structured data, e.g. relational data
22Indexing; Data structures therefor; Storage structures
CPC
G06F 16/2246
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
16Information retrieval; Database structures therefor; File system structures therefor
20of structured data, e.g. relational data
22Indexing; Data structures therefor; Storage structures
2228Indexing structures
2246Trees, e.g. B+trees
G06F 16/2291
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
16Information retrieval; Database structures therefor; File system structures therefor
20of structured data, e.g. relational data
22Indexing; Data structures therefor; Storage structures
2291User-Defined Types; Storage management thereof
Applicants SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY
深圳先进技术研究院
Inventors XIONG JINGPAN
熊景盼
WANG YANG
王洋
XU CHENGZHONG
须成忠
Agents 深圳市科进知识产权代理事务所(普通合伙) 44316
Title
(EN) Spark-oriented remote sensing data indexing method and system and electronic equipment
(ZH) 一种面向Spark的遥感数据索引方法、系统及电子设备
Abstract
(EN)
The invention relates to a Spark-oriented remote sensing data indexing method and system and electronic equipment. The method comprises the steps that a quadtree index system, a GeoHash index systemand an R tree index system of remote sensing data are established in a PostgreSQL database respectively, the quadtree index system, the GeoHash index system and the R tree index system are stored respectively, and a multi-index storage system oriented to Spark multi-index coexistence is obtained; an index strategy selector is selected, and butt joint between the Spark and the multi-index storage system is established; and based on the index strategy selector, a corresponding index mode is distributed according to a calculation scene, and remote sensing data is searched in the multi-index storage system according to the index mode. Index modes can be distributed according to different calculation scenes. I The index time is greatly reduced relative to a single index mode. The method adaptsto Spark calculation tasks, needed files are quickly and efficiently indexed, and efficient calculation of remote sensing data is achieved.

(ZH)
本申请涉及一种面向Spark的遥感数据索引方法、系统及电子设备。所述包括:在PostgreSQL数据库中分别建立遥感数据的四叉树、GeoHash和R树索引系统,并将所述四叉树、GeoHash和R树索引系统进行分别存放,得到面向Spark多索引共存的多索引存储系统;选择索引策略选择器,建立Spark与所述多索引存储系统的对接;基于所述索引策略选择器,根据计算场景分配对应的索引方式,根据所述索引方式在所述多索引存储系统中查找遥感数据。本申请能够根据不同计算场景分配索引方式,使索引时间相对于单一的索引方式大幅度下降,并且适应Spark计算任务,快速高效的索引到所需文件,实现遥感数据的高效计算。

Also published as