Search International and National Patent Collections

1. (WO2018081563) NEURAL ARCHITECTURE SEARCH

Pub. No.:    WO/2018/081563    International Application No.:    PCT/US2017/058760
Publication Date: Fri May 04 01:59:59 CEST 2018 International Filing Date: Sat Oct 28 01:59:59 CEST 2017
IPC: G06N 3/08
G06N 3/04
Applicants: GOOGLE LLC
Inventors: ZOPH, Barret
LE, Quoc V.
Title: NEURAL ARCHITECTURE SEARCH
Abstract:
Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining neural network architectures. One of the methods includes generating, using a controller neural network, a batch of output sequences, each output sequence in the batch defining a respective architecture of a child neural network that is configured to perform a particular neural network task; for each output sequence in the batch: training a respective instance of the child neural network having the architecture defined by the output sequence; evaluating a performance of the trained instance of the child neural network on the particular neural network task to determine a performance metric for the trained instance of the child neural network on the particular neural network task; and using the performance metrics for the trained instances of the child neural network to adjust the current values of the controller parameters of the controller neural network.