Share Email Print

Proceedings Paper

Assessing the prospects for robust sub-diffraction limited super-resolution imaging with deep neural networks
Author(s): Robert P. J. Nieuwenhuizen; Dennis D. Bouwman; Klamer Schutte
Format Member Price Non-Member Price
PDF $17.00 $21.00

Paper Abstract

High resolution images are critical for a wide variety of military detection, recognition and identification tasks. Super-resolution reconstruction algorithms aim to enhance the image resolution beyond the capability of the imaging system being used. Until recently, undersampling of the optical signal on the image sensor has been the key factor limiting the attainable resolution of visible and infrared imaging systems. Traditional SR algorithms aim to overcome this undersampling by combining data from multiple frames in a sequence. However, recent advances in manufacturing technologies have led to a steady increase in the number of pixels in an image sensor. Instead, image blur caused by optical diffraction is becoming an important limitation to the attainable image resolution. Here we investigate if image resolutions beyond the limitations posed by optical diffraction may be achieved using deep neural network based single image super-resolution algorithms. These networks learn a mapping from low resolution images to high resolution counterparts from pairs of training images. This could allow them to reconstruct high frequency information beyond the diffraction limit based on prior information about likely scene contents. We find that an average gain in image resolution of over 30% could be achieved by such networks on simulated diffraction limited imagery. In addition we investigate how robust these networks are to the presence of noise in the low resolution input imagery. We show that low noise levels can lead to poor reconstruction results with networks trained on noise free examples, but also that training on multiple noise levels can be used to mitigate this deterioration in performance.

Paper Details

Date Published: 4 October 2018
PDF: 13 pages
Proc. SPIE 10799, Emerging Imaging and Sensing Technologies for Security and Defence III; and Unmanned Sensors, Systems, and Countermeasures, 1079905 (4 October 2018);
Show Author Affiliations
Robert P. J. Nieuwenhuizen, TNO (Netherlands)
Dennis D. Bouwman, TNO (Netherlands)
Klamer Schutte, TNO (Netherlands)

Published in SPIE Proceedings Vol. 10799:
Emerging Imaging and Sensing Technologies for Security and Defence III; and Unmanned Sensors, Systems, and Countermeasures
Gerald S. Buller; Markus Mueller; Richard C. Hollins; Robert A. Lamb, Editor(s)

© SPIE. Terms of Use
Back to Top
Sign in to read the full article
Create a free SPIE account to get access to
premium articles and original research
Forgot your username?