Processing

Please wait...

Settings

Settings

Goto Application

1. WO2015038442 - PROCESSING DATASETS WITH A DBMS ENGINE

Publication Number WO/2015/038442
Publication Date 19.03.2015
International Application No. PCT/US2014/054449
International Filing Date 08.09.2014
Chapter 2 Demand Filed 13.05.2015
IPC
G06F 17/30 2006.01
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
17Digital computing or data processing equipment or methods, specially adapted for specific functions
30Information retrieval; Database structures therefor
CPC
G06F 16/221
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
16Information retrieval; Database structures therefor; File system structures therefor
20of structured data, e.g. relational data
22Indexing; Data structures therefor; Storage structures
221Column-oriented storage; Management thereof
G06F 16/2219
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
16Information retrieval; Database structures therefor; File system structures therefor
20of structured data, e.g. relational data
22Indexing; Data structures therefor; Storage structures
2219Large Object storage; Management thereof
G06F 16/24561
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
16Information retrieval; Database structures therefor; File system structures therefor
20of structured data, e.g. relational data
24Querying
245Query processing
2455Query execution
24553of query operations
24561Intermediate data storage techniques for performance improvement
G06F 16/258
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
16Information retrieval; Database structures therefor; File system structures therefor
20of structured data, e.g. relational data
25Integrating or interfacing systems involving database management systems
258Data format conversion from or to a database
G06F 16/27
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
16Information retrieval; Database structures therefor; File system structures therefor
20of structured data, e.g. relational data
27Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
Applicants
  • MICROSOFT TECHNOLOGY LICENSING, LLC [US]/[US]
Inventors
  • CHAIKEN, Ronnie
  • FOEHR, Oliver
  • LARSON, Per-Ake
Priority Data
14/024,25511.09.2013US
Publication Language English (EN)
Filing Language English (EN)
Designated States
Title
(EN) PROCESSING DATASETS WITH A DBMS ENGINE
(FR) TRAITEMENT D'ENSEMBLES DE DONNÉES AVEC UN MOTEUR DBMS
Abstract
(EN)
A system and method to process a dataset with a database management system (DBMS) engine. The method includes splitting bulk data into a plurality of chunks. The method also includes converting the chunks to a plurality of row groups. The row groups are a dataset external to a DBMS comprising the DBMS engine. The method further includes creating an empty DBMS table within the DBMS. Additionally, the method includes attaching the dataset external to the DBMS to the empty DBMS table. The method also includes executing a MapReduce job on a cluster of compute nodes, using the dataset external to the DBMS as input.
(FR)
La présente invention concerne un système et un procédé permettant de traiter un ensemble de données avec un moteur de système de gestion de base de données (DBMS). Le procédé comprend les étapes consistant à : diviser des données en vrac en une pluralité de blocs; convertir les blocs en une pluralité de groupes de lignes, les groupes de lignes étant un ensemble de données externe à un DBMS comprenant le moteur DBMS; créer une table DBMS vide dans le DBMS; associer l'ensemble de données externe au DBMS à la table DBMS vide; et exécuter une tâche MapReduce sur une grappe de nœuds de calcul en utilisant l'ensemble de données externe au DBMS à titre d'entrée.
Also published as
Latest bibliographic data on file with the International Bureau