Sorry, you need to enable JavaScript to visit this website.

Vision Transformer MST++: Efficient Hyperspectral Skin Reconstruction

Citation Author(s):
Ana Clara C. Silveira, Diedre S. do Carmo, Lucas H. Ueda, Denis G. Fantinato, Paula D. P. Costa, Leticia Rittner
Submitted by:
Ana Caznok Silveira
Last updated:
16 April 2024 - 8:02pm
Document Type:
Presentation Slides
Event:
Presenters:
Ana Clara Silveira
Paper Code:
GC-L5.4
 

Channel reconstruction transforms a subsampled mutispectral image into hyperspectral, offering hyperspectral imaging benefits without a dedicated camera. MST++ is a
state of the art channel reconstruction technique, but it faces memory limitations for high spatial resolution images. In this context, we introduce VITMST++, a novel architecture in-
corporating Vision Transformer embedding and compression, multi-resolution image context and a channel-weighted loss. Developed for the ICASSP 2024 Hyperspectral Skin Chal-
lenge, VITMST++ outperforms the state-of-the-art MST++ in both performance and computational efficiency in channel reconstruction.

up
0 users have voted: