Text in the dark: Extremely low-light text image enhancement
Journal article, 2025

Extremely low-light text images pose significant challenges for scene text detection. Existing methods enhance these images using low-light image enhancement techniques before text detection. However, they fail to address the importance of low-level features, which are essential for optimal performance in downstream scene text tasks. Further research is also limited by the scarcity of extremely low-light text datasets. To address these limitations, we propose a novel, text-aware extremely low-light image enhancement framework. Our approach first integrates a Text-Aware Copy-Paste (Text-CP) augmentation method as a preprocessing step, followed by a dual-encoder–decoder architecture enhanced with Edge-Aware attention modules. We also introduce text detection and edge reconstruction losses to train the model to generate images with higher text visibility. Additionally, we propose a Supervised Deep Curve Estimation (Supervised-DCE) model for synthesizing extremely low-light images, allowing training on publicly available scene text datasets such as IC15. To further advance this domain, we annotated texts in the extremely low-light See In the Dark (SID) and ordinary LOw-Light (LOL) datasets. The proposed framework is rigorously tested against various traditional and deep learning-based methods on the newly labeled SID-Sony-Text, SID-Fuji-Text, LOL-Text, and synthetic extremely low-light IC15 datasets. Our extensive experiments demonstrate notable improvements in both image enhancement and scene text tasks, showcasing the model’s efficacy in text detection under extremely low-light conditions. Code and datasets will be released publicly at https://github.com/chunchet-ng/Text-in-the-Dark.

Scene text detection

Scene text recognition

Edge attention

Extremely low-light image enhancement

Text aware augmentation

Author

Che-Tsung Lin

Chalmers, Electrical Engineering, Signal Processing and Biomedical Engineering

Chun Chet Ng

Universiti Malaya

Zhi Qin Tan

Universiti Malaya

Wan Jun Nah

Universiti Malaya

Xinyu Wang

Universiti Malaya

Jie Long Kew

Universiti Malaya

Pohao Hsu

National Tsing Hua University

Shang Hong Lai

National Tsing Hua University

Chee Seng Chan

Universiti Malaya

Christopher Zach

Chalmers, Electrical Engineering, Signal Processing and Biomedical Engineering

Signal Processing: Image Communication

0923-5965 (ISSN)

Vol. 130 117222

Subject Categories

Signal Processing

DOI

10.1016/j.image.2024.117222

More information

Latest update

11/13/2024