Search International and National Patent Collections
Some content of this application is unavailable at the moment.
If this situation persists, please contact us atFeedback&Contact
1. (WO2017136077) ASSOCIATIVE LONG SHORT-TERM MEMORY NEURAL NETWORK LAYERS
Latest bibliographic data on file with the International Bureau

Pub. No.: WO/2017/136077 International Application No.: PCT/US2016/069505
Publication Date: 10.08.2017 International Filing Date: 30.12.2016
Chapter 2 Demand Filed: 04.12.2017
IPC:
G06N 3/04 (2006.01)
G PHYSICS
06
COMPUTING; CALCULATING; COUNTING
N
COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3
Computer systems based on biological models
02
using neural network models
04
Architecture, e.g. interconnection topology
Applicants:
DEEPMIND TECHNOLOGIES LIMITED [GB/GB]; 5 New Street Square London EC4A 3TW, GB
Inventors:
DANIHELKA, Ivo; GB
KALCHBRENNER, Nal Emmerich; GB
WAYNE, Gregory Duncan; GB
URIA-MARTINEZ, Benigno; GB
GRAVES, Alexander Benjamin; GB
Agent:
SHOGHI GHALEHSHAHI, Pooya; US
TROESCH, Hans R.; US
Priority Data:
62/291,46704.02.2016US
Title (EN) ASSOCIATIVE LONG SHORT-TERM MEMORY NEURAL NETWORK LAYERS
(FR) COUCHES ASSOCIATIVES DE RÉSEAU NEURONAL DE MÉMOIRE À LONG ET COURT TERME
Abstract:
(EN) Systems, methods, and apparatus, including computer programs encoded on a computer storage medium, related to associative long short-term memory (LSTM) neural network layers configured to maintain N copies of an internal state for the associative LSTM layer, N being an integer greater than one. In one aspect, a system includes a recurrent neural network including an associative LSTM layer, wherein the associative LSTM layer is configured to, for each time step, receive a layer input, update each of the N copies of the internal state using the layer input for the time step and a layer output generated by the associative LSTM layer for a preceding time step, and generate a layer output for the time step using the N updated copies of the internal state.
(FR) L'invention concerne des systèmes, des procédés et un appareil, comprenant des programmes informatiques codés sur un support d'enregistrement informatique, associés à des couches associatives de réseau neuronal de mémoire à long et court terme (LSTM) configurées pour conserver N copies d'un état interne de la couche associative de LSTM, N étant un nombre entier supérieur à un. Selon un aspect, un système comprend un réseau neuronal récursif comprenant une couche associative de LSTM, la couche associative de LSTM étant configurée pour, à chaque étape temporelle, recevoir une entrée de couche, mettre à jour chacune des N copies de l'état interne au moyen de l'entrée de couche de l'étape temporelle et d'une sortie de couche générée par la couche associative de LSTM lors d'une étape temporelle précédente, et générer une sortie de couche de l'étape temporelle au moyen des N copies mises à jour de l'état interne.
front page image
Designated States: AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BN, BR, BW, BY, BZ, CA, CH, CL, CN, CO, CR, CU, CZ, DE, DJ, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IR, IS, JP, KE, KG, KH, KN, KP, KR, KW, KZ, LA, LC, LK, LR, LS, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PA, PE, PG, PH, PL, PT, QA, RO, RS, RU, RW, SA, SC, SD, SE, SG, SK, SL, SM, ST, SV, SY, TH, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW
African Regional Intellectual Property Organization (ARIPO) (BW, GH, GM, KE, LR, LS, MW, MZ, NA, RW, SD, SL, ST, SZ, TZ, UG, ZM, ZW)
Eurasian Patent Organization (AM, AZ, BY, KG, KZ, RU, TJ, TM)
European Patent Office (AL, AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MK, MT, NL, NO, PL, PT, RO, RS, SE, SI, SK, SM, TR)
African Intellectual Property Organization (BF, BJ, CF, CG, CI, CM, GA, GN, GQ, GW, KM, ML, MR, NE, SN, TD, TG)
Publication Language: English (EN)
Filing Language: English (EN)
Also published as:
EP3398118CN108780521