TEMPORAL FEATURE ALIGNMENT NETWORK FOR VIDEO INPAINTING

Patent №

US 11,625,814

Granted

2023-04-11

Filed 2021

Owner

BYTEDANCE INC.

+1 more

Lab

AI components

3

vision · evo · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

17192549

Systems and methods are directed to inpainting video. More specifically, initial video data including a sequence of image frames containing missing or corrupted pixel information may be received. Optical flow displacement values and optical flow validity masks may be generated for neighboring image frames of initial video data. Image features from image feature maps of one or more neighboring image frames may be warp-shifted to image feature maps of a current image frame using the optical flow displacement values and warp-shifted image features from the feature maps of the one or more neighboring image frames may be selected based on one or more of the optical flow validity masks. A sequence of complete image frames may be generated based on the selected warp-shifted image features from the feature maps of the one or more neighboring image frames and image features from the image feature maps of the current image frame.

VisionEvolutionary computationAI hardwareG06T 5/80G06N 3/045G06N 3/0455G06N 3/0464G06N 3/0475G06N 3/08G06N 3/09G06N 3/094+7 more

AI classification

Vision1.00
AI hardware0.96
Evolutionary computation0.80
Planning0.22
Machine learning0.13
Knowledge representation0.00
Natural language0.00
Speech0.00

Ownership

BYTEDANCE INC.

assignment · 554990033

LEMON INC.

assignment · 554990107

Assignors

YANG, LINJIE, LIU, DING, ZOU, XUEYAN

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC