Processing

Please wait...

Settings

Settings

Goto Application

1. US20220005200 - Machine Learning based Image Segmentation Training with Contour Accuracy Evaluation

Office
United States of America
Application Number 17179061
Application Date 18.02.2021
Publication Number 20220005200
Publication Date 06.01.2022
Publication Kind A1
IPC
G06T 7/12
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
7Image analysis
10Segmentation; Edge detection
12Edge-based segmentation
G06K 9/62
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
62Methods or arrangements for recognition using electronic means
G06K 9/46
GPHYSICS
06COMPUTING; CALCULATING OR COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
46Extraction of features or characteristics of the image
CPC
G06T 2207/10024
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
2207Indexing scheme for image analysis or image enhancement
10Image acquisition modality
10024Color image
G06T 7/12
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
7Image analysis
10Segmentation; Edge detection
12Edge-based segmentation
G06K 9/4604
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
36Image preprocessing, i.e. processing the image information without deciding about the identity of the image
46Extraction of features or characteristics of the image
4604Detecting partial patterns, e.g. edges or contours, or configurations, e.g. loops, corners, strokes, intersections
G06K 9/6256
GPHYSICS
06COMPUTING; CALCULATING; COUNTING
KRECOGNITION OF DATA; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
9Methods or arrangements for reading or recognising printed or written characters or for recognising patterns, e.g. fingerprints
62Methods or arrangements for recognition using electronic means
6217Design or setup of recognition systems and techniques; Extraction of features in feature space; Clustering techniques; Blind source separation
6256Obtaining sets of training patterns; Bootstrap methods, e.g. bagging, boosting
Applicants Sony Corporation
Sony Pictures Entertainment Inc.
Inventors Mengyu Chen
Miaoqi Zhu
Yoshikazu Takashima
Ouyang Chao
Daniel De La Rosa
Michael Lafuente
Stephen Shapiro
Title
(EN) Machine Learning based Image Segmentation Training with Contour Accuracy Evaluation
Abstract
(EN)

Improving the accuracy of predicted segmentation masks, including: extracting a ground-truth RGB image buffer and a binary contour image buffer from a ground-truth RGB image container for segmentation training; generating predicted segmentation masks from the ground-truth RGB image buffer; generating second binary contours from the predicted segmentation masks using a particular algorithm; computing a segmentation loss between manually-segmented masks of the ground-truth RGB image buffer and the predicted segmentation masks; computing a contour accuracy loss between contours of the binary contour image buffer and the binary contours of the predicted segmentation masks; computing a total loss as a weighted average of the segmentation loss and the contour accuracy loss; and generating improved binary contours by compensating the contours of the binary contour image buffer with the computed total loss, wherein the improved binary contours are used to improve the accuracy of the predicted segmentation masks.


Related patent documents