Patent №
US 10,805,647
Granted
2020-10-13
Filed 2017
Owner
FACEBOOK, INC.
AI components
6
ml · nlp · vision · speech · kr · hardware
Assignment
Recorded
Dataset
AIPD
2023_r1 edition
Application
15850746
Exemplary embodiments relate to the automatic generation of captions for visual media, including photos, photo albums, non-live video, and live video. The visual media may be analyzed to determine contextual information (such as location information, people and objects in the video, time, etc.). A system may integrate this information with information from the user's social network and a personalized language model built using public-facing language from the user. The personalized language model captures the user's way of speaking to make the generated captions more detailed and personalized. The language model may account for the context in which the video was generated. The captions maybe used to simplify and encourage content generation, and may also be used to index visual media, rank the media, and recommend the media to users likely to engage with the media.
AI classification
Ownership
FACEBOOK, INC.
assignment · 446830728
Assignors
ZHANG, YING, GUO, SHENGBO
On an employer assignment, the assignors are typically the inventors.