RIR-in-a-Box: Estimating Room Acoustics from 3D Mesh Data through Shoebox Approximation - Laboratoire Traitement et Communication de l'Information Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

RIR-in-a-Box: Estimating Room Acoustics from 3D Mesh Data through Shoebox Approximation

Résumé

This paper describes a method for estimating the room impulse response (RIR) for a microphone and a sound source located at arbitrary positions from the 3D mesh data of the room. Simulat- ing realistic RIRs with pure physics-driven methods often fails the balance between physical consistency and computational ef- ficiency, hindering application to real-time speech processing. Alternatively, one can use MESH2IR, a fast black-box estima- tor that consists of an encoder extracting latent code from mesh data with a graph convolutional network (GCN) and a decoder generating the RIR from the latent code. Combining these two approaches, we propose a fast yet physically coherent estimator with interpretable latent code based on differentiable digital sig- nal processing (DDSP). Specifically, the encoder estimates a vir- tual shoebox room scene that acoustically approximates the real scene, accelerating physical simulation with the differentiable image-source model in the decoder. Our experiments showed that our method outperformed MESH2IR for real mesh data ob- tained with the depth scanner of Microsoft HoloLens 2, and can provide correct spatial consistency for binaural RIRs.
Fichier principal
Vignette du fichier
Interspeech_RIR_in_a_Box.pdf (859.17 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04632526 , version 1 (02-07-2024)

Identifiants

  • HAL Id : hal-04632526 , version 1

Citer

Liam Kelley, Diego Di Carlo, Aditya Arie Nugraha, Mathieu Fontaine, Yoshiaki Bando, et al.. RIR-in-a-Box: Estimating Room Acoustics from 3D Mesh Data through Shoebox Approximation. INTERSPEECH, Sep 2024, Kos International Convention Center, Kos Island, Greece. ⟨hal-04632526⟩
0 Consultations
0 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More