Search International and National Patent Collections

1. (WO2018051841) MODEL LEARNING DEVICE, METHOD THEREFOR, AND PROGRAM

Pub. No.:    WO/2018/051841    International Application No.:    PCT/JP2017/031909
Publication Date: Fri Mar 23 00:59:59 CET 2018 International Filing Date: Wed Sep 06 01:59:59 CEST 2017
IPC: G10L 15/16
G06N 3/08
G06N 99/00
G10L 15/06
G10L 15/065
Applicants: NIPPON TELEGRAPH AND TELEPHONE CORPORATION
日本電信電話株式会社
Inventors: MASATAKI, Hirokazu
政瀧 浩和
ASAMI, Taichi
浅見 太一
NAKAMURA, Takashi
中村 孝
MASUMURA, Ryo
増村 亮
Title: MODEL LEARNING DEVICE, METHOD THEREFOR, AND PROGRAM
Abstract:
The present invention comprises: an initial value setting unit that, by using a parameter for a first model which has been learned and which includes a neutral network, sets a parameter for a second model which includes a neutral network having a structure similar to that of the first model; a first output probability distribution calculating unit that, by using the first model and a feature amount for learning, calculates a first output probability distribution including distribution of output probabilities of units in an output layer; a second output probability distribution calculating unit that, by using the second model and the feature amount for learning, calculates a second output probability distribution including distribution of the output probabilities of the units in the output layer; and a correction model updating unit that obtains a weighted sum of a second loss function calculated from the second output probability distribution and from information about a correct answer and cross entropy between the first output probability distribution and the second output probability distribution, and that updates the parameter for the second model such that the weighted sum is decreased.