국제 및 국내 특허문헌 검색

1. (WO2017201127) RECONFIGURABLE DISTRIBUTED PROCESSING

Pub. No.:    WO/2017/201127    International Application No.:    PCT/US2017/033033
Publication Date: Fri Nov 24 00:59:59 CET 2017 International Filing Date: Thu May 18 01:59:59 CEST 2017
IPC: G06F 9/50
G06F 9/44
Applicants: AB INITIO TECHNOLOGY LLC
Inventors: NEWBERN, Jeffrey
STANFILL, Craig W.
Title: RECONFIGURABLE DISTRIBUTED PROCESSING
Abstract:
Distributed processing of a data collection includes receiving information for configuring a distributed processing system. A first configuration of components is formed including sources (110) of data elements and workers (240) configured to process data elements, distributed among computing resources (190-194). Each data element includes a partition value that identifies a subset of the workers according to a partition rule. Data elements are accepted from the sources for a first part of the data collection in a first processing epoch and the data elements are routed through the first configuration. After accepting a first part of the data collection, change of configuration is initiated to a second configuration. A succession of two or more transitions between configurations of components is performed to a succession of modified configurations, a last of which corresponds to the second configuration. Further data elements are accepted from sources of the second configuration in a second processing epoch.