Production Workflows for Low-light Environments
AI-based Image Processing and Computer Vision
The human visual system operates using various opponent processes, present in both the retina and visual cortex. These processes heavily rely on distinctions in color, luminance, or motion to trigger salient reactions. Contrast, which refers to differences in luminance and/or color that enable the differentiation of objects, plays a crucial role in subjectively evaluating image quality. Images and videos captured in low-light conditions often exhibit poor quality and visibility due to limitations in shutter angles, high ISO resulting in noise, and spectral biasing toward blue. Traditional enhancement techniques tend to wash out details, flatten the appearance, and amplify noise.
This project aims to develop and validate a perceptually inspired deep learning framework for joint restoration of noisy, low light content (targeting natural history filmmaking) ensuring temporal consistency in terms of colour, luminance and motion.
Research team
Core
- N. Anantrasirichai and D.R. Bull: Lead academics
- Guoxi Huang (Edward): Researcher on low-light enhancement [BVI-Mamba]
- Alexandra Malyugina: Researcher on low-light image denoising [Project page] [Paper] [arXiv]
- Crispian Morris: PhD on low-ight autofocus for advanced wildlife coverage (with BBC R&D) [arXiv]
- Rachel Lin: PhD on low-light video enhancement [Paper1, Code] [Paper2, Code] [arXiv, Dataset]
- Joanne Lin: PhD on segmentation and object tracking in low-light environment [Paper]
Alumni
- Duolikun Danier: Researcher on low-light image enhancement
Undergrad/Postgrad projects
- Qi (Karlee) Sun (2024), Low-light video enhancement with conditional diffusion model [Thesis] [Paper, Code]
- Anastasia Yi (2023), A comprehensive study of object tracking in low-light environments [Thesis] [Paper]
- Siyu Zhou (2023), Temporal consistency in low-light video enhancement [Thesis]
- Felicia Dubicki-Piper (2023), VideoINR+: Video denoising with implicit neural representation [Code]
Downloads
Publications
- Feature Denoising For Low-Light Instance Segmentation Using Weighted Non-Local Blocks. J Lin, N Anantrasirichai, D Bull, IEEE International Conference on Acoustics, Speech, and Signal Processing. 2025
[ PDF] - Low-light Video Enhancement with Conditional Diffusion Models and Wavelet Interscale Attentions. R Lin, Q Sun, N Anantrasirichai. ACM SIGGRAPH Conference on Visual Media Production. 2024
[ PDF] - A comprehensive study of object tracking in low-light environments. A Yi and N Anantrasirichai. Sensors. 2024
[ PDF] - A Spatio-temporal Aligned SUNet Model for Low-light Video Enhancement. R Lin, N Anantrasirichai, A Malyugina, D Bull. IEEE International Conference on Image Processing. 2024
[ PDF] [ CODE] [ Dataset] - Topological Loss Function for Image Denoising on a new BVI-lowlight Dataset. A. Malyugina, N. Anantrasirichai, and D. Bull. Signal Processing. 2023. [PDF]
- Contextual colorization and denoising for low-light ultra high resolution sequences. N. Anantrasirichai and D. Bull. In Proceedings of the IEEE International Conference on Image Processing. 2021 [PDF] [Project page]
Datasets
- Paired video dataset for low-light enhancement [dataset] [arXiv]
- Paired image dataset for image denoising [dataset] [paper]
- Unpaired UHD video dataset [dataset] [paper]
Code
- BVI-Mamba [https://github.com/russellllaputa/BVI-Mamba]
- BVI-CDM [https://github.com/lrr-rachel/BVI-CDM]
- STA-SUNet [https://github.com/lrr-rachel/STA-SUNet]
- PCDUNet [https://github.com/lrr-rachel/PCDUNet]
Related research
Related publications from VI-Lab
- Artificial intelligence in the creative industries: A review. N Anantrasirichai and D R Bull, Artif Intell Rev 55, 2022
- ST-MFNet Mini: Knowledge distillation-driven frame interpolation. C Morris, D Danier, F Zhang, N Anantrasirichai, D R Bull. IEEE International Conference on Image Processing. 2023