AUTOMATIC PERSONALIZED STORY GENERATION FOR VISUAL MEDIA

Patent №

US 10,805,647

Granted

2020-10-13

Filed 2017

Owner

FACEBOOK, INC.

AI components

6

ml · nlp · vision · speech · kr · hardware

Assignment

Recorded

Dataset

AIPD

2023_r1 edition

Application

15850746

Exemplary embodiments relate to the automatic generation of captions for visual media, including photos, photo albums, non-live video, and live video. The visual media may be analyzed to determine contextual information (such as location information, people and objects in the video, time, etc.). A system may integrate this information with information from the user's social network and a personalized language model built using public-facing language from the user. The personalized language model captures the user's way of speaking to make the generated captions more detailed and personalized. The language model may account for the context in which the video was generated. The captions maybe used to simplify and encourage content generation, and may also be used to index visual media, rank the media, and recommend the media to users likely to engage with the media.

Machine learningNatural languageVisionSpeechKnowledge representationAI hardwareG06F 40/237G06F 40/10G06F 40/56G06Q 10/40G06V 20/30G06V 20/47H04N 21/23418H04N 21/2743+3 more

AI classification

Natural language1.00
Speech1.00
Vision1.00
Machine learning1.00
AI hardware1.00
Knowledge representation0.92
Planning0.01
Evolutionary computation0.00

Ownership

FACEBOOK, INC.

assignment · 446830728

Assignors

ZHANG, YING, GUO, SHENGBO

On an employer assignment, the assignors are typically the inventors.

© 2026 NYSGPT2525 LLC