Search International and National Patent Collections

1. (WO2018089762) ONLINE PERSONAL ASSISTANT WITH IMAGE TEXT LOCALIZATION

Pub. No.:    WO/2018/089762    International Application No.:    PCT/US2017/061053
Publication Date: Fri May 18 01:59:59 CEST 2018 International Filing Date: Sat Nov 11 00:59:59 CET 2017
IPC: G06K 9/46
G06T 7/00
G06K 9/62
G06F 17/30
G06Q 30/00
G06K 9/68
Applicants: EBAY INC.
Inventors: ZHENG, Shuai
PIRAMUTHU, Robinson
Title: ONLINE PERSONAL ASSISTANT WITH IMAGE TEXT LOCALIZATION
Abstract:
Systems, methods, and computer program products for identifying a candidate product in an electronic marketplace based on a visual comparison between candidate product image visual text content and input query image visual text content. Unlike conventional optical character recognition (OCR) based systems, embodiments automatically localize and isolate portions of a candidate product image and an input query image that each contain visual text content, and calculate a visual similarity measure between the respective portions. A trained neural network may be re-trained to more effectively find visual text content by using the localized and isolated visual text content portions as additional ground truths. The visual similarity measure serves as a visual search result score for the candidate product. Any number of images of any number of candidate products may be compared to an input query image to enable text-in-image based product searching without resorting to conventional OCR techniques.