Search International and National Patent Collections

1. (WO2018083669) RECURRENT NEURAL NETWORKS

Pub. No.:    WO/2018/083669    International Application No.:    PCT/IB2017/056904
Publication Date: Sat May 12 01:59:59 CEST 2018 International Filing Date: Sun Nov 05 00:59:59 CET 2017
IPC: G06N 3/04
Applicants: DEEPMIND TECHNOLOGIES LIMITED
Inventors: WIERSTRA, Daniel Pieter
MOHAMED, Shakir
CHIAPPA, Silvia
RACANIERE, Sebastien Henri Andre
Title: RECURRENT NEURAL NETWORKS
Abstract:
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for environment simulation. In one aspect, a system comprises a recurrent neural network configured to, at each of a plurality of time steps, receive a preceding action for a preceding time step, update a preceding initial hidden state of the recurrent neural network from the preceding time step using the preceding action, update a preceding cell state of the recurrent neural network from the preceding time step using at least the initial hidden state for the time step, and determine a final hidden state for the time step using the cell state for the time step. The system further comprises a decoder neural network configured to receive the final hidden state for the time step and process the final hidden state to generate a predicted observation characterizing a predicted state of the environment at the time step.