Efficient Diffusion as Low Light Enhancer

1 Northwestern Polytechnical University    2 Shanghai Jiao Tong University   
3 Shanghai AI Laboratory    4 TeleAI   
CVPR 2025

*Indicates Equal Contribution
Denotes Corresponding Author
Teaser.

ReDDiT shifts the teacher trajectory from the original Gaussian distribution to a residual space, effectively reducing the sampling gap. Subsequently, it refines the teacher trajectory towards the ground truth trajectory to mitigate fitting errors.

Abstract

The computational burden of the iterative sampling process remains a major challenge in diffusion-based Low-Light Image Enhancement (LLIE). Current acceleration methods, whether training-based or training-free, often lead to significant performance degradation, highlighting the trade-off between performance and efficiency. In this paper, we identify two primary factors contributing to performance degradation: fitting errors and the inference gap. Our key insight is that fitting errors can be mitigated by linearly extrapolating the incorrect score functions, while the inference gap can be reduced by shifting the Gaussian flow to a reflectance-aware residual space. Based on the above insights, we design Reflectance-Aware Trajectory Refinement (RATR) module, a simple yet effective module to refine the teacher trajectory using the reflectance component of images. Following this, we introduce Reflectance-aware Diffusion with Distilled Trajectory (ReDDiT), an efficient and flexible distillation framework tailored for LLIE. Our framework achieves comparable performance to previous diffusion-based methods with redundant steps in just 2 steps while establishing new state-of-the-art (SOTA) results with 8 or 4 steps. Comprehensive experimental evaluations on 10 benchmark datasets validate the effectiveness of our method, consistently outperforming existing SOTA methods.

Teaser.

Pipiline of our proposed ReDDiT. The distillation process involves two parts: teacher model leverages the estimated reflectance to refine its trajectory and student model's trajectory is guided by teacher's trajectory, via a distillation loss. TD denotes the Trajectory Decoder while RATR denotes the Reflectance-Aware Trajectory Refinement.

MY ALT TEXT

MY ALT TEXT

MY ALT TEXT

MY ALT TEXT

BibTeX

If you find our work useful, please consider citing our paper:


        @InProceedings{lan2024towards,
          title={Efficient Diffusion as Low Light Enhancer},
          author={Lan, Guanzhou and Ma, Qianli and Yang, Yuqi and Wang, Zhigang and Wang, Dong and Li, Xuelong and Zhao, Bin},
          booktitle={Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition},
          year={2025}
          }