Documents
Presentation Slides
Presentation Slides
Vision Transformer MST++: Efficient Hyperspectral Skin Reconstruction
- DOI:
- 10.60864/6fyw-y955
- Citation Author(s):
- Submitted by:
- Ana Caznok Silveira
- Last updated:
- 6 June 2024 - 10:23am
- Document Type:
- Presentation Slides
- Event:
- Presenters:
- Ana Clara Silveira
- Paper Code:
- GC-L5.4
- Categories:
- Log in to post comments
Channel reconstruction transforms a subsampled mutispectral image into hyperspectral, offering hyperspectral imaging benefits without a dedicated camera. MST++ is a
state of the art channel reconstruction technique, but it faces memory limitations for high spatial resolution images. In this context, we introduce VITMST++, a novel architecture in-
corporating Vision Transformer embedding and compression, multi-resolution image context and a channel-weighted loss. Developed for the ICASSP 2024 Hyperspectral Skin Chal-
lenge, VITMST++ outperforms the state-of-the-art MST++ in both performance and computational efficiency in channel reconstruction.