Documents
Poster
TIME-RESOLVED IMAGE DEMIXING
- Citation Author(s):
- Submitted by:
- Ayush Bhandari
- Last updated:
- 19 March 2016 - 11:15pm
- Document Type:
- Poster
- Document Year:
- 2016
- Event:
- Presenters:
- Ayush Bhandari
- Categories:
- Keywords:
- Log in to post comments
When multiple light paths combine at a given location on an image sensor, an image mixture is created. Demixing or recovering the original constituent components in such cases is a highly ill--posed problem. A number of elegant solutions have thus been developed in the literature, relying on measurement diversity such as polarization, shift, motion, or scene features. In this paper, we approach the image-mixing problem as a time--resolved phenomenon---if every photon arriving at the sensor could be time--stamped, the demixing problem would then amount to separating transient events in time. Based on this idea, we first show that, while acquiring measurements is prohibitive and challenging in the time domain, this task is surprisingly straightforward in the frequency domain. We then establish a link between frequency-domain measurements and consumer time--of--flight (ToF) imaging. Finally, we propose a demixing algorithm, relying only on magnitude information of the ToF sensor. We show that our problem is closely tied to the topic of phase retrieval and that for $K$-image mixture, $(K^2-K)/2 + 1$ magnitude-only ToF measurements suffice to demix images exactly in noiseless settings. Our developments are corroborated with experiments on synthetic and ToF data acquired using the Microsoft Kinect sensor.