Summary
This paper proposes a hypernetworks-based all-in-one image restoration plug-and-play method called HAIR. This method generates parameters based on the input image, allowing the model to dynamically adapt to specific degradations. HAIR consists of two main components，the Classifier and the Hyper Selecting Net. The Classifier is a simple image classification network that generates a Global Information Vector containing the degradation information of the input image. The HSN is a fully connected neural network that receives the GIV and outputs parameters for the corresponding modules.
Strengths
1. The paper introduces HAIR, a novel approach that leverages hypernetworks to dynamically generate parameters for image restoration tasks. This represents an innovative application of hypernetworks in the field of image restoration, offering a fresh perspective. The method is designed to be plug-and-play, allowing integration with existing image restoration models to enhance their performance without significant structural changes. The authors have also provided code for supplementary materials, which is a positive aspect for reproducibility.
2. The paper is well-organized and structured, guiding the reader through the problem, the proposed solutions, experiments, and results. Each section transitions logically to the next, making the paper easy to follow.
Weaknesses
1. While the paper claims that HAIR can generalize to unseen composite degradations, the results for these cases show only marginal improvements over the baseline PromptIR method. The restoration outcomes for such degradations are not satisfactory, indicating that the model may not be fully capturing the complexities of real-world degradation combinations.
2. The paper emphasizes the parameter efficiency of HAIR compared to embedding-based methods. However, there is a lack of discussion on the computational cost and runtime of the hypernetwork-generated parameters. In practical applications, especially in resource-constrained environments, both the number of parameters and the computational efficiency are crucial.
3. The experiments are comprehensive but are limited to a specific set of benchmark datasets. To further validate the generalization capabilities of HAIR, it would be beneficial to include additional datasets that capture a wider variety of real-world conditions and degradation types. Furthermore, the paper does not provide a more comprehensive visual comparison.
4. The ablation studies are limited to the impact of the Classifier and HSN components. More detailed ablation studies on other aspects, such as the depth of the Hyper Selecting Net or the dimensionality of the Global Information Vector, could provide deeper insights into the factors that influence HAIR's performance.
Questions
1. Could the authors elaborate on how the classifier module performs classification? For example, is it based on degradation types such as denoising or deraining, or does it classify based on internal features or another method? A detailed explanation would be helpful. Additionally, are the authors familiar with the PromptIR model? The results in Table 3 indicate that there is little difference between Res-HAIR and PromptIR. Have the authors validated the effectiveness and computational efficiency of these two networks?
2. The ablation study is limited to the impact of the classifier and HSN components. It is suggested that the authors investigate the influence of the depth of the Hyper Selecting Network or the dimension of the Global Information Vector on the model's performance. Additionally, in Table 4, the Rain100L dataset is used for the ablation study, while the de-raining results in Table 2 also employ the Rain100L dataset. Could the authors explain the discrepancy in the obtained PSNR results?
3. Could the authors discuss potential practical applications of HAIR, especially in scenarios where images are degraded by multiple factors, such as in autonomous driving or surveillance systems? How does HAIR's performance translate to these real-world applications?