Search International and National Patent Collections

1. (WO2018058998) DATA LOADING METHOD, TERMINAL AND COMPUTING CLUSTER

Pub. No.:    WO/2018/058998    International Application No.:    PCT/CN2017/087152
Publication Date: Fri Apr 06 01:59:59 CEST 2018 International Filing Date: Tue Jun 06 01:59:59 CEST 2017
IPC: G06F 17/30
Applicants: HUAWEI TECHNOLOGIES CO., LTD.
华为技术有限公司
Inventors: FANG, Hao
房浩
BI, Jieshan
毕杰山
MO, Kai
莫凯
GUO, Yijun
郭益君
ZHONG, Chaoqiang
钟超强
Title: DATA LOADING METHOD, TERMINAL AND COMPUTING CLUSTER
Abstract:
A data loading method, a terminal and a computing cluster, relating to the technical field of communications and capable of reducing the read and write time delay of a KeyValue database and improving the query performance of the KeyValue database. The specific solution comprises: a computing cluster receiving a data loading request carrying partition information of a data table to be loaded; determining first data partitions according to the partition information, all partitions indicated by the partition information being respectively bound with one first data partition; acquiring source data of each partition indicated by the partition information, and executing a mapping task on the source data of each partition; writing, according to binding relationships between the partitions indicated by the partition information and the first data partitions, the intermediate data obtained by executing each mapping task, into the corresponding first data partition; and executing a reduction task on the intermediate data in each first data partition to obtain a target file of each reduction task, the target file being used by the loaded data table of the KeyValue database for data querying.