Search International and National Patent Collections
|1. (WO2018058998) DATA LOADING METHOD, TERMINAL AND COMPUTING CLUSTER|
|Applicants:||HUAWEI TECHNOLOGIES CO., LTD.
|Title:||DATA LOADING METHOD, TERMINAL AND COMPUTING CLUSTER|
A data loading method, a terminal and a computing cluster, relating to the technical field of communications and capable of reducing the read and write time delay of a KeyValue database and improving the query performance of the KeyValue database. The specific solution comprises: a computing cluster receiving a data loading request carrying partition information of a data table to be loaded; determining first data partitions according to the partition information, all partitions indicated by the partition information being respectively bound with one first data partition; acquiring source data of each partition indicated by the partition information, and executing a mapping task on the source data of each partition; writing, according to binding relationships between the partitions indicated by the partition information and the first data partitions, the intermediate data obtained by executing each mapping task, into the corresponding first data partition; and executing a reduction task on the intermediate data in each first data partition to obtain a target file of each reduction task, the target file being used by the loaded data table of the KeyValue database for data querying.