eduzhai > Applied Sciences > Engineering >

Towards Reliable Real-time Opera Tracking Combining Alignment with Audio Event Detectors to Increase Robustness

  • Save

... pages left unread,continue reading

Document pages: 7 pages

Abstract: Recent advances in real-time music score following have made it possible formachines to automatically track highly complex polyphonic music, including fullorchestra performances. In this paper, we attempt to take this to an evenhigher level, namely, live tracking of full operas. We first apply astate-of-the-art audio alignment method based on online Dynamic Time-Warping(OLTW) to full-length recordings of a Mozart opera and, analyzing the tracker smost severe errors, identify three common sources of problems specific to theopera scenario. To address these, we propose a combination of a DTW-based musictracker with specialized audio event detectors (for applause, silence noise,and speech) that condition the DTW algorithm in a top-down fashion, and show,step by step, how these detectors add robustness to the score follower.However, there remain a number of open problems which we identify as targetsfor ongoing and future research.

Please select stars to rate!


0 comments Sign in to leave a comment.

    Data loading, please wait...