Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model

Wenqi Zhang, Zhenglin Cheng, Yuanyu He, Mengna Wang, Yongliang Shen, Zeqi Tan, Guiyang Hou, Mingqian He, Yanna Ma, Weiming Lu, Yueting Zhuang. Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing. 2024.

Multimodal Machine Learning Applications

View graph Source

Paper

The full text of this publication is not hosted on 44B due to licensing.

Read it at OpenAlex

DIXITWORLD: Evaluating Multimodal Abductive Reasoning in Vision-Language Models with Multi-Agent Dixit GameplayYunxiang Mo, Tianshi Zheng, Qing Zong et al.2026 In Library

Instruction-tuned Self-Questioning Framework for Multimodal ReasoningJang, You-Won, Yu‐Jung Heo, Jaeseok Kim et al.2025 · arXiv (Cornell University) In Library

Premise-based Multimodal Reasoning: Conditional Inference on Joint Textual and Visual CluesQingxiu Dong, Ziwei Qin, Heming Xia et al.2022 · Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers) In Library

Probing Audio-Visual Reasoning in Multimodal Language Models through the Lens of AudioKaixiong Gong, Kaituo Feng, Bohao Li et al.2026 In Library

Mementos: A Comprehensive Benchmark for Multimodal Large Language Model Reasoning over Image SequencesXiyao Wang, Yuhang Zhou, Xiaoyu Liu et al.2024 In Library

InfiMM: Advancing Multimodal Understanding with an Open-Sourced Visual Language ModelHaogeng Liu, Quanzeng You, Yiqi Wang et al.2024 · Annual Meeting of the Association for Computational Linguistics · 7 citations In Library

Self-Imagine: Effective Unimodal Reasoning with Multimodal Models using Self-ImaginationSyeda Nahida Akter, Aman Madaan, Sangwu Lee et al.2024 · arXiv (Cornell University) In Library

GoViG: Goal-Conditioned Visual Navigation Instruction Generation via Multimodal ReasoningFengyi Wu, Yifei Dong, Yilong Dai et al.2026 In Library

Vision-Language Models Can Self-Improve Reasoning via ReflectionKanzhi Cheng, Yantao Li, Fangzhi Xu et al.2025 In Library

Patents near this paper

MULTI-MODAL VISUAL QUESTION ANSWERING SYSTEMUS 10,949,718 · ACCENTURE GLOBAL SOLUTIONS LIMITED · 2021 SEMANTIC IMAGE MANIPULATION USING VISUAL-SEMANTIC JOINT EMBEDDINGSUS 11,574,142 · ADOBE INC. · 2023 Method and system for visio-linguistic understanding using contextual language model reasonersUS 11,699,275 · TATA CONSULTANCY SERVICES LIMITED · 2023 SELF-PACED ADVERSARIAL TRAINING FOR MULTIMODAL AND 3D MODEL FEW-SHOT LEARNINGUS 10,990,848 · SAP SE · 2021 ARTIFICIAL INTELLIGENCE GENERATED SYNTHETIC IMAGE DATA FOR USE WITH MACHINE LANGUAGE MODELSUS 11,687,620 · INTERNATIONAL BUSINESS MACHINES CORPORATION · 2023

Source of record

OpenAlex

Multimodal Self-Instruct: Synthetic Abstract Image and Visual Reasoning Instruction Using Language Model

Paper

Similar papers

Patents near this paper

Welcome.

Patents near this paper