Search International and National Patent Collections 
1. (WO2018051841) MODEL LEARNING DEVICE, METHOD THEREFOR, AND PROGRAM 


IPC:  G10L 15/16 G06N 3/08 G06N 99/00 G10L 15/06 G10L 15/065 

Applicants:  NIPPON TELEGRAPH AND TELEPHONE CORPORATION 日本電信電話株式会社 

Inventors:  MASATAKI, Hirokazu 政瀧 浩和 ASAMI, Taichi 浅見 太一 NAKAMURA, Takashi 中村 孝 MASUMURA, Ryo 増村 亮 
Title:  MODEL LEARNING DEVICE, METHOD THEREFOR, AND PROGRAM 
Abstract: 
The present invention comprises: an initial value setting unit that, by using a parameter for a first model which has been learned and which includes a neutral network, sets a parameter for a second model which includes a neutral network having a structure similar to that of the first model; a first output probability distribution calculating unit that, by using the first model and a feature amount for learning, calculates a first output probability distribution including distribution of output probabilities of units in an output layer; a second output probability distribution calculating unit that, by using the second model and the feature amount for learning, calculates a second output probability distribution including distribution of the output probabilities of the units in the output layer; and a correction model updating unit that obtains a weighted sum of a second loss function calculated from the second output probability distribution and from information about a correct answer and cross entropy between the first output probability distribution and the second output probability distribution, and that updates the parameter for the second model such that the weighted sum is decreased.
