Follow the convention adopted by Cossairt et al. [1], we define a conventional camera as an impulse imaging system which measures the desired signal directly (e.g. without blur). CI performance is then compared against the impulse imaging system. Noise is related to the lighting level, scene properties and sensor characteristics. To calculate the photon noise in our experiments, we assume an average scene reflectivity of R=0.5 and sensor quantum efficiency of q=0.5, aperture setting of F/11 and exposure time of t=6 milliseconds. We choose three different example cameras that span the a wide range of consumer imaging devices: 1) a high end SLR camera, 2) a machine vision camera (MVC) and 3) a smartphone camera (SPC). For each of these example camera types, we choose parameters that are typical in the marketplace today: sensor pixel size: δSLR=8 μm for the SLR camera, δMVC=2.5 μm for the MVC, and δSPC=1 μm for the SPC. We also assume a sensor read noise of σr=4e- which is typical for today’s CMOS sensors. The figure shows the relation between light levels and average signal levels for the different camera specifications.

Subplots (a) and (b) show the simulation results obtained by focal sweep and impulse imaging for low (J/σr2=0.2) and high (J/σr2=20) photon to read noise ratios. For the low photon to read noise ratio case, application of our GMM prior increases SNR by around 14dB for both focal sweep and impulse imaging. Multiplexing increases SNR by about 8 dB regardless of the use of prior. For the high photon to read noise ratio case, the SNR gains due to both prior and multiplexing decrease.

Here we plot the SNR gain of various EDOF systems at different photon to read noise ratios (J/σr2). In the extended x-axis, we also show the effective illumination levels (in lux) required to produce the given J/σr2 for the three camera specifications: SLR, MVC and SPC. The EDOF systems that we consider are: cubic phase wavefront coding [9], focal sweep camera [3.4], and the coded aperture designs by Zhou et al. [7] and Levin et al. [8]. Signal priors are used to improve performance for both CI and impulse cameras. Wavefront coding achieves a peak SNR gain of 8.8 dB and an average SNR gain of about 7 dB.

In this figure, we study the performance of motion invariant [6], flutter shutter [5] and impulse cameras when image priors are taken into account. Subplot (a) shows the analytic SNR gain (in dB) vs. photon to read noise ratio J/σr2 for the two motion deblurring systems. In the extended x-axis, we also plot the corresponding light levels (in lux) for the three different camera specifications: SLR, MVC and SPC. The motion invariant camera achieves a peak SNR gain of 7.3 dB and an average SNR gain of about 4.5 dB. Subplots (b-c) show the corresponding simulation results. At a low photon to read noise ratio of J/σr2=0.2, motion invariant imaging performs 7.4 dB better than impulse imaging. At the high photon to read noise ratio of J/σr2=20, it is only 1.2 dB better.

Here we compute the optimal exposure time for a conventional camera with signal priors taken into account. We first fix the exposure setting of the impulse imaging in such a way that the motion blur is less than a pixel. We then analytically compute the expected SNR gain of different exposure settings (PSF kernel lengths) with respect to the impulse imaging system (of PSF kernel length 1) at various light levels, see subplot (a). For light levels less than 150 lux capturing the image with a larger exposure and then deblurring is a better option, whereas, for light levels greater than 150 lux we should always capture impulse image and then denoise. Subplot (b) shows the optimal blur PSF length at different light levels. At light level of 1 lux, the optimal PSF is 23, whereas for light levels greater than or equal to 150 lux the optimal is 1, i.e., the impulse image setting. Subplots (c-e) show the simulated results with different PSF kernel lengths at a few lighting levels.

Here we compute the optimal aperture setting for a conventional camera with signal priors taken into account. We fix the aperture size of the impulse imaging system so that the defocus blur is less than a pixel. We then analytically compute the SNR gain of different aperture settings (PSF kernel size) with respect to impulse imaging system of PSF kernel size 1×1 pixels for various light levels, see subplot (a). For light levels less than 400 lux capturing the image with a larger aperture and then deblurring is a better option, whereas, for light levels greater than 400 lux we should capture impulse image and then denoise. In subplot (b) we show the optimal blur PSF size at different light levels. At light level of 1 lux, the optimal PSF is 9×9 pixels, whereas for light levels greater than 400 lux the optimal is 1×1 pixels, i.e., the impulse image setting. Subplots (c-d) show the simulated results with different PSF size at a few lighting levels.