Summary
The paper introduces a novel framework for converting high dynamic range (HDR) images to low dynamic range (LDR) images, a crucial task in digital imaging. The proposed framework aims to improve the balance between image enhancement and computational efficiency by incorporating global and local tone mapping operators.
Traditional methods are either global, processing the whole image uniformly but often missing fine details, or local, capturing fine details with higher computational requirements. To overcome this dichotomy, the authors propose integrating 3D LookUp Tables (3D LUT) as a global operator and local Laplacian filters as a local operator into one end-to-end system. The 3D LUTs are used for global tone manipulation, while local Laplacian filters refine high-frequency edge details.
Moreover, the authors introduce a learnable local Laplacian filter (LLF) and a lightweight network that progressively learns parameter value maps from annotated data for the local Laplacian filters. This approach reduces manual tuning, which is a limitation of existing methods.
The results of the extensive experiments on two benchmark datasets demonstrate that the proposed framework outperforms state-of-the-art methods in terms of both image quality and computational efficiency. The paper contributes to digital imaging by offering an efficient solution to HDR image tone mapping while preserving important details.
Strengths
The paper is well-written and structured. The authors clearly explain the problems with existing methods and why their proposed framework offers a solution. Concepts are clearly defined, and the methodology is explained in a detailed and straightforward manner. Diagrams, equations, and examples effectively support the reader's understanding.
Weaknesses
- The paper misses the discussions and comparisons of many related methods [1-3]. These methods are all published in good venues within the past five years and thus deserve a fair discussion.
- Why the evaluation metrics do not contain TMQI, Fidelity, and Naturalness? These three evaluation metrics are common practice in TMO papers (see [1] for example). As tone mapping is a subjective task, using PSNR or SSIM to evaluate does not provide much information.
- Some of the compared methods, such as CLUT [39], are tacking low-light image enhancement. Why did the authors compare these methods? The input of tone-mapping is an HDR radiance map, while the input to low-light image enhancement is an already tone-mapped non-linear image. The comparison is unfair and could mislead future work.
- I strongly suggest the authors revisit the goal of their proposed method. Is it a TMO (tone mapping operator) or low-light image enhancement (LLIE)? I really don't see many TMO methods in the comparison section. If that is the case, I would suggest the authors rename the paper title to low-light image enhancement and change all the terms in the paper.
- If the proposed method indeed is a TMO, then the first step should be LDR to HDR as the input is a low-light image. Then the authors should also discuss the related work [4-6] and design choices for LDR2HDR.
- While the authors tested their framework on two benchmark datasets, it would have been beneficial to see the system evaluated on more diverse datasets, including real-world photographs, video frames, and even synthetic images. This could have offered a more comprehensive understanding of the method's robustness and generalizability.
- The paper lacks a complex analysis of the proposed framework. A comparison of the computational complexity and memory usage between the proposed model and existing methods would give a clearer picture of the performance trade-off.
- The authors have not thoroughly discussed the potential limitations of their proposed method. Understanding what the model struggles with or where it might fail is essential for future improvements and applications.
[1] Liang, Zhetong, et al. "A hybrid l1-l0 layer decomposition model for tone mapping." Proceedings of the IEEE conference on computer vision and pattern recognition. 2018.
[2] Su, Chien-Chuan, et al. "Explorable tone mapping operators." 2020 25th International Conference on Pattern Recognition (ICPR). IEEE, 2021.
[3] Vinker, Yael, Inbar Huberman-Spiegelglas, and Raanan Fattal. "Unpaired learning for high dynamic range image tone mapping." Proceedings of the IEEE/CVF International Conference on Computer Vision. 2021.
[4] Liu, Yu-Lun, et al. "Single-image HDR reconstruction by learning to reverse the camera pipeline." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2020.
[5] Santos, Marcel Santana, Tsang Ing Ren, and Nima Khademi Kalantari. "Single image HDR reconstruction using a CNN with masked features and perceptual loss." arXiv preprint arXiv:2005.07335 (2020).
[6] Chen, Xiangyu, et al. "Hdrunet: Single image hdr reconstruction with denoising and dequantization." Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021.
Questions
See the section above.
Rating
7: Accept: Technically solid paper, with high impact on at least one sub-area, or moderate-to-high impact on more than one areas, with good-to-excellent evaluation, resources, reproducibility, and no unaddressed ethical considerations.
Confidence
5: You are absolutely certain about your assessment. You are very familiar with the related work and checked the math/other details carefully.
Limitations
The paper does not discuss the limitation of the proposed method. I believe the proposed method will not have a potential negative societal impact.