Light Field Reconstruction Based on Compressed Sensing via Deep Learning

Abstract

The light field has excellent application prospects in immersive media because of the abundant information of the light. Due to the sparsity and redundancy in light field images, light field reconstruction based on compressed sensing is used to recover light field images from only a few measurements. And the light field compressed sensing usually optimizes the measurement matrix and the dictionary and processes each of the light field images separately. Since the high similarity of light field images, the different viewpoints of images can be stacked together and formed as a 4D tensor. In this paper, we propose tensor based on compressed sensing (TCS) method to yield measurements with common characteristics. Besides, a better deep learning network is designed for TCS, the measurement matrix optimization and image reconstruction will be performed simultaneously. Experimental results show that the proposed method gets at least 3 dB gain in PSNR and outperforms state-of-the-art in the reconstruction quality.