Processing

Please wait...

Settings

Settings

Goto Application

1. CN109543824 - A method and apparatus for processing a sequence model

Office China
Application Number 201811458681.0
Application Date 30.11.2018
Publication Number 109543824
Publication Date 29.03.2019
Publication Kind A
IPC
G06N 3/04
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
04Architecture, e.g. interconnection topology
G06F 17/28
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
FELECTRIC DIGITAL DATA PROCESSING
17Digital computing or data processing equipment or methods, specially adapted for specific functions
20Handling natural language data
28Processing or translating of natural language
CPC
G06F 40/58
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
FELECTRIC DIGITAL DATA PROCESSING
40Handling natural language data
40Processing or translation of natural language
58Use of machine translation, e.g. for multi-lingual retrieval, for server-side translation for client devices or for real-time translation
G06N 3/0454
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
NCOMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS
3Computer systems based on biological models
02using neural network models
04Architectures, e.g. interconnection topology
0454using a combination of multiple neural nets
Applicants TENCENT TECHNOLOGY (SHENZHEN) CO., LTD.
腾讯科技(深圳)有限公司
Inventors TU ZHAOPENG
涂兆鹏
HAO JIE
郝杰
WANG XING
王星
WANG LONGYUE
王龙跃
Agents 深圳市深佳知识产权代理事务所(普通合伙) 44285
Title
(EN) A method and apparatus for processing a sequence model
(ZH) 一种序列模型的处理方法和装置
Abstract
(EN)
The embodiment of the invention discloses a method and apparatus for processing a sequence model, which are used for improving the task execution effect of the sequence model. The method comprises thefollowing steps of: obtaining a source end sequence from a source end database and inputting the source end sequence to an encoding end of a sequence model, wherein the encoding end comprises a self-attention encoder and a timing encoder; encoding The source sequence by a timing encoder to obtain a first encoding result, wherein the first encoding result comprises timing information obtained by using the source sequence to perform timing modeling; And performing encoding processing on the source sequence by a self-attention encoder to obtain a second encoding result; Obtaining a target end sequence from a target end database, and inputting the target end sequence, a first coding result and a second coding result to a decoding end of a sequence model; using A decoding end to perform decoding processing on a target end sequence, a first encoding result and a second encoding result, and outputting a decoding result obtained after the decoding processing.

(ZH)
本发明实施例公开了一种序列模型的处理方法和装置,用于提高序列模型的任务执行效果。该方法包括:从源端数据库中获取到源端序列,并将源端序列输入到序列模型的编码端,编码端包括:自关注编码器和时序编码器;通过时序编码器对源端序列进行编码处理从而得到第一编码结果,第一编码结果包括:使用源端序列进行时序建模得到的时序信息;以及通过自关注编码器对源端序列进行编码处理从而得到第二编码结果;从目标端数据库中获取到目标端序列,并将目标端序列、第一编码结果和第二编码结果输入到序列模型的解码端;通过解码端对目标端序列、第一编码结果和第二编码结果进行解码处理,并输出解码处理后得到的解码结果。

Also published as