Summary
The paper proposes a new approach to addressing the hallucination problem in Large Vision-Language Models (LVLMs). This phenomenon occurs when generated text responses appear linguistically plausible but contradict the visual input, indicating a misalignment between image and text pairs. The proposed solution, Calibrated Self-Rewarding (CSR), allows the model to self-improve by iteratively generating candidate responses, evaluating the reward for each response, and curating preference data for fine-tuning. This method incorporates visual constraints into the self-rewarding process, emphasizing visual input. Empirical results show performance improvements and reduced hallucinations across various benchmarks and tasks.
Strengths
The paper addresses the critical issue of hallucination in LVLMs by introducing a new Calibrated Self-Rewarding (CSR) approach. This method is new in its use of visual constraints within the self-rewarding paradigm to enhance image-text alignment.
The empirical evaluation is thorough, encompassing twelve benchmarks and tasks. The results show improvements over existing methods, demonstrating the effectiveness of CSR.
The paper is well-organized, providing a clear explanation of the problem, proposed solution, and empirical results. The inclusion of theoretical analysis further strengthens the clarity and credibility of the work.
The proposed CSR method has implications for improving the reliability and accuracy of LVLMs, which is crucial for their application in various real-world scenarios.
Weaknesses
**Technical Novelty:** The primary distinction of the proposed method from previous approaches is the introduction of a new reward score based on vision-language similarity and step-wise evaluation. While this is a meaningful contribution, the paper could benefit from a more detailed discussion on how this approach fundamentally differs from and improves upon existing methods.
**Performance Improvements:** Although CSR shows substantial improvements on average, the performance gains in some benchmarks, such as LLaVA-1.5-13B, are not very substantial. It would be beneficial to explore the reasons behind these limited improvements and suggest potential avenues for further enhancement.
**Figures:** Figures 1 and 2 lack clarity. The visual representation of preference data and the meaning of green and red circles in Figure 2, as well as the shapes and score positions in Figure 1, need to be better explained and presented more clearly.
Questions
How is the improvement of approximately 7.62% computed? Please provide a detailed explanation of the calculation method used to arrive at this figure.
What is the upper bound in the performance gain of CSR? A case study showing its potential on one or several benchmarks with LLaVA-1.5 13B would be helpful, given the increasing trend shown in Figure 3.
Figure 2 is unclear. What do the green and red circles represent? What does "Option" mean? Is it possible to visualize the generated preference data in Figure 2 or elsewhere? Additionally, Figure 1 appears confusing regarding the shapes and score positions. Can these be clarified and improved for better understanding?
Limitations
The authors acknowledge some limitations of their work, such as conducting three iterations of CSR. While this approach shows promise, its technical novelty compared to existing methods is somewhat limited.
Additionally, the performance improvements are not uniformly substantial across all benchmarks. The paper could benefit from a more detailed discussion of these limitations and potential strategies for addressing them in future work.
Furthermore, the potential negative societal impact of the work should be considered, particularly in terms of the ethical implications of improving LVLMs that might be used in sensitive applications. Providing constructive suggestions for mitigating any negative impacts would be valuable.