Sorry, you need to enable JavaScript to visit this website.

facebooktwittermailshare

ICASSP 2018 Tutorial T11 Natual and Augmented Listening for VR/AR/MR

Abstract: 

This tutorial aims to equip the participants with basic and advanced signal processing techniques that can be used in VR/AR applications to create a natural and augmented listening experience using headsets.
This tutorial is divided into 5 sections and cover following topics:
Introduction to spatial audio, fundamentals in natural listening, and emerging audio applications
Audio Reproduction in the New VR/AR world: This section will cover audio processing, rendering and auralization for various audio formats, including object-based, channel-based, and ambisonics. Special focus will be given on role of acoustic modelling based on 3D models in VR/AR environment for immersive audio.
Binaural Rendering of 3D audio in headsets. Binaural audio has evolved to be the main audio reproduction methods for VR/AR. In this section, we will cover how we can recreate the most natural binaural sound over headphones using various signal processing techniques. Topics covered include: HRTF measurements and individualization, headphones equalization, head tracking, and finally integrating these techniques into 3D audio headphones for VR applications.
Augmented reality audio in Headsets: Natural listening in augmented reality scenario will be covered. One of the primary goals of augmented reality audio is the fusion of virtual sources with real sources and environment. Techniques covered are hearing through of headphones, adaptive equalization of headphones, acoustic environment identification and rendering, active noise control with integrated 3D audio for headsets, and assistive listening devices.
Summary of the tutorial and point out the future trends of immersive audio in headsets. Demos will be presented.

up
0 users have voted:

Paper Details

Authors:
Rishabh Ranjan, Rishabh Gupta
Submitted On:
18 April 2018 - 12:04am
Short Link:
Type:
Tutorial
Event:
Presenter's Name:
Woon-Seng Gan, Jianjun He, Rishabh Ranjan, Rishabh Gupta
Paper Code:
T-11
Document Year:
2018
Cite

Document Files

ICASSP2018_Tutorial_T11_Natual_and_Augmented_Listening_for_VR_AR_MR.pdf

(116 downloads)

Subscribe

[1] Rishabh Ranjan, Rishabh Gupta, "ICASSP 2018 Tutorial T11 Natual and Augmented Listening for VR/AR/MR", IEEE SigPort, 2018. [Online]. Available: http://sigport.org/2958. Accessed: Oct. 15, 2018.
@article{2958-18,
url = {http://sigport.org/2958},
author = {Rishabh Ranjan; Rishabh Gupta },
publisher = {IEEE SigPort},
title = {ICASSP 2018 Tutorial T11 Natual and Augmented Listening for VR/AR/MR},
year = {2018} }
TY - EJOUR
T1 - ICASSP 2018 Tutorial T11 Natual and Augmented Listening for VR/AR/MR
AU - Rishabh Ranjan; Rishabh Gupta
PY - 2018
PB - IEEE SigPort
UR - http://sigport.org/2958
ER -
Rishabh Ranjan, Rishabh Gupta. (2018). ICASSP 2018 Tutorial T11 Natual and Augmented Listening for VR/AR/MR. IEEE SigPort. http://sigport.org/2958
Rishabh Ranjan, Rishabh Gupta, 2018. ICASSP 2018 Tutorial T11 Natual and Augmented Listening for VR/AR/MR. Available at: http://sigport.org/2958.
Rishabh Ranjan, Rishabh Gupta. (2018). "ICASSP 2018 Tutorial T11 Natual and Augmented Listening for VR/AR/MR." Web.
1. Rishabh Ranjan, Rishabh Gupta. ICASSP 2018 Tutorial T11 Natual and Augmented Listening for VR/AR/MR [Internet]. IEEE SigPort; 2018. Available from : http://sigport.org/2958