Library

Automatic Annotations and Enrichments for Audiovisual Archives

: The practical availability of Audiovisual Processing tools to media scholars and heritage institutions remains limited, despite all the technical advancements of recent years. In this article we present the approach chosen in the CLARIAH project to increase this availability, we discuss the challenges encountered, and introduce the technical solutions we are implementing. Through three use cases focused on the enrichment of AV archives, Pose Analysis, and Automatic Speech Recognition, we demonstrate the potential and breadth of using Audiovisual Processing for archives and Digital Humanities research.

Computer ScienceHistory
View graphSource

Paper

Full text

PDF

Automatic Annotations and Enrichments for Audiovisual Archives

Semantic Scholar · Computer Science · 2021

Abstract

: The practical availability of Audiovisual Processing tools to media scholars and heritage institutions remains limited, despite all the technical advancements of recent years. In this article we present the approach chosen in the CLARIAH project to increase this availability, we discuss the challenges encountered, and introduce the technical solutions we are implementing. Through three use cases focused on the enrichment of AV archives, Pose Analysis, and Automatic Speech Recognition, we demonstrate the potential and breadth of using Audiovisual Processing for archives and Digital Humanities research.

Source of record · Semantic Scholar

References (31)

01Cutting RhythmsK. Pearlman2025 · 62 citations
02CAMPI: Computer-Aided Metadata Generation for Photo archives InitiativeMatthew D. Lincoln, J. Corrin, Emily Davis et al.2020 · 12 citations
03Deep Learning as a Tool for Early Cinema AnalysisSamarth Bhargav, N. V. Noord, Jaap Kamps2019 · SUMAC @ ACM Multimedia · 9 citations
04Media Suite: Unlocking Audiovisual Archives for Mixed Media Scholarly ResearchR. Ordelman, Liliana Melgar, J. V. Gorp et al.2019 · CLARIN Annual Conference · 5 citations
05The CLARIAH Media Suite: a Hybrid Approach to System Design in the HumanitiesL. M. Estrada, M. Koolen, K. Beelen et al.2019 · Conference on Human Information Interaction and Retrieval · 11 citations
06The visual digital turn: Using neural networks to study historical imagesMelvin Wevers, T. Smits2019 · Digital Scholarship in the Humanities · 102 citations
07Rhythmic Trajectories – Visualizing Cinematic Rhythm in Film SequencesSzilvia Ruszev2018 · 3 citations
08From Text Mining to Visual Classification: Rethinking Computational New Cinema History with Jean Desmet’s Digitised Business ArchiveC. Olesen, I. Kisjes2018 · 3 citations
09Efficient Indexing of Billion-Scale Datasets of Deep DescriptorsArtem Babenko, V. Lempitsky2016 · Computer Vision and Pattern Recognition · 325 citations
10Toward automated discovery of artistic influenceBabak Saleh, Kanako Abe, Ravneet Arora et al.2014 · Multimedia tools and applications · 99 citations In Library
11MOVIE: Large Scale Automated Analysis of MOVing ImagEsVirginia Kuhn, Michael Simeone, Luigi Marini et al.2014 · Extreme Science and Engineering Discovery Environment · 2 citations
12Talking with Scholars: Developing a Research Environment for Oral History CollectionsMax Kemman, S. Scagliola, F. D. Jong et al.2013 · TPDL Workshops · 6 citations

Scroll for more · 19 remaining

Similar papers

Write What You Want: Applying Text-to-Video Retrieval to Audiovisual ArchivesYuchen Yang2023 · Journal on Computing and Cultural Heritage In Library
Write What You Want: Applying Text-to-video Retrieval to Audiovisual ArchivesYuchen Yang2023 · arXiv (Cornell University) In Library
The CLAMS Platform at Work: Processing Audiovisual Data from the American Archive of Public BroadcastingM. Verhagen, K. Lynch, Kyeongmin Rim et al.2022 · International Conference on Language Resources and Evaluation · 0 citations In Library
Using Artificial Intelligence to Preserve Audiovisual Archives: New Horizons, More QuestionsJ. Carrive2019 · ACM Multimedia · 2 citations In Library
A two-way street between AI research and media scholarsRasa Bočytė, Philo van Kemenade, Johan Oomen2022 · Zenodo (CERN European Organization for Nuclear Research) In Library
Augmenting the Metadata of Audiovisual Archives with NLP Techniques: Challenges and SolutionsGiacomo Alliata, Yang, Yuchen, Sarah Kenderdine2023 · Infoscience (Ecole Polytechnique Fédérale de Lausanne) In Library
Latent Wander: an Alternative Interface for Interactive and Serendipitous Discovery of Large AV ArchivesYuchen Yang, Linyida Zhang2023 In Library
Expanding Perspectives to Improve Access to Visual Archives through Multimodal Image EnrichmentKarina Rodríguez Echavarria, Myrsini Samaroudi2025 · Journal on Computing and Cultural Heritage In Library
Catalogue Grounded Multimodal Attribution for Museum Video under Resource and Regulatory ConstraintsMinsak Nanang, Adrian Hilton, Armin Mustafa2026 · 0 citations In Library
Content Adaptation, Personalisation and Fine-grained Retrieval: Applying AI to Support Engagement with and Reuse of Archival Content at ScaleR. Bocyte, J. Oomen2020 · International Conference on Agents and Artificial Intelligence · 11 citations In Library
© 2026 NYSGPT2525 LLC