Audio inpainting based on joint-sparse modeling

Ichrak Toumi 1 Valentin Emiya 1
1 QARMA - éQuipe d'AppRentissage de MArseille
LIS - Laboratoire d'Informatique et Systèmes
Abstract : We present a new framework for the restoration of missing samples in audio signals. It consists in locating audio frames that share similar sparse structures and in applying a joint-sparse algorithm to estimate the missing samples. Such similar frames are found in audio signals due to the signals' intrinsic structures: across channels, in the temporal neighboring of each frame and, since patterns are repeated non-locally. We propose a fast and robust strategy for locating the similar frames by introducing a spectral cosine similarity that is more suitable than the usual correlation similarity. We present and compare the inpainting versions of three known joint-sparse algorithms and show how they lead to a better reconstruction of the missing parts. Experimental results reveal that by selecting only a few similar frames, joint-sparse audio inpainting outperform the state-of-the-art OMP inpainting method by up to 5 dB, and that improvements cumulatively result from non-local and inter-channel joint decomposition.
Complete list of metadatas

Cited literature [18 references]  Display  Hide  Download

https://hal-amu.archives-ouvertes.fr/hal-01928569
Contributor : Valentin Emiya <>
Submitted on : Tuesday, November 20, 2018 - 3:57:49 PM
Last modification on : Saturday, June 15, 2019 - 11:46:13 PM

File

2018-11-12_submitted.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-01928569, version 1

Collections

Citation

Ichrak Toumi, Valentin Emiya. Audio inpainting based on joint-sparse modeling. 2019. ⟨hal-01928569⟩

Share

Metrics

Record views

125

Files downloads

73