A multimodal approach for percussion music transcription from audio and video

Marenco, Bernardo - Fuentes, Magdalena - Lanzaro, Florencia - Rocamora, Martín - Gómez, Alvaro

Resumen:

A multimodal approach for percussion music transcription from audio and video recordings is proposed in this work. It is part of an ongoing research effort for the development of tools for computeraided analysis of Candombe drumming, a popular afro-rooted rhythm from Uruguay. Several signal processing techniques are applied to automatically extract meaningful information from each source. This involves detecting certain relevant objects in the scene from the video stream. The location of events is obtained from the audio signal and this information is used to drive the processing of both modalities. Then, the detected events are classified by combining the information from each source in a feature-level fusion scheme. The experiments conducted yield promising results that show the advantages of the proposed method. Keywords: multimodal signal processing, machine learning applications, music transcription, percussion music, sound classification


Detalles Bibliográficos
2015
Multimodal signal processing
Machine learning applications
Music transcription
Percussion music
Sound classication
Procesamiento de Señales
Inglés
Universidad de la República
COLIBRI
https://hdl.handle.net/20.500.12008/42666
Acceso abierto
Licencia Creative Commons Atribución - No Comercial - Sin Derivadas (CC - By-NC-ND 4.0)