Systems and Methods for Virtual Facial Makeup Removal and Simulation, Fast Facial Detection and Landmark Tracking, Reduction in Input Video Lag and Shaking, and Method for Recommending Makeup

Patent №

US 11,039,675

Granted

2021-06-22

Filed 2019

Owner

SHISEIDO AMERICAS CORPORATION

Lab

AI components

3

ml · vision · planning

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

16403274

The present disclosure provides systems and methods for virtual facial makeup simulation through virtual makeup removal and virtual makeup add-ons, virtual end effects and simulated textures. In one aspect, the present disclosure provides a method for virtually removing facial makeup, the method comprising providing a facial image of a user with makeups being applied thereto, locating facial landmarks from the facial image of the user in one or more regions, decomposing some regions into first channels which are fed to histogram matching to obtain a first image without makeup in that region and transferring other regions into color channels which are fed into histogram matching under different lighting conditions to obtain a second image without makeup in that region, and combining the images to form a resultant image with makeups removed in the facial regions. The disclosure also provides systems and methods for virtually generating output effects on an input image having a face, for creating dynamic texturing to a lip region of a facial image, for a virtual eye makeup add-on that may include multiple layers, a makeup recommendation system based on a trained neural network model, a method for providing a virtual makeup tutorial, a method for fast facial detection and landmark tracking which may also reduce lag associated with fast movement and to reduce shaking from lack of movement, a method of adjusting brightness and of calibrating a color and a method for advanced landmark location and feature detection using a Gaussian mixture model.

Machine learningVisionPlanningA45D 44/005G06T 1/0007G06T 11/60G06T 17/205G06T 19/20G06V 20/20G06V 40/168G06V 40/171+3 more

AI classification

Vision1.00
Machine learning0.99
Planning0.69
AI hardware0.32
Natural language0.06
Evolutionary computation0.00
Knowledge representation0.00
Speech0.00

Ownership

SHISEIDO AMERICAS CORPORATION

assignment · 493110874

Assignors

FU, YUN, WANG, SHUYANG, JIANG, SONGYAO, SUN, BIN, MAO, HAIYI, CHEUNG, KAI HO EDGAR, LEE, SUMIN

On an employer assignment, the assignors are typically the inventors.

From the same owner

© 2026 NYSGPT2525 LLC