FreiDi:syncPlayer Tests & Demos

As score following and music synchronisation as such are not a new topic or problem that has been solved in our project, let us explain its relevance and focus in the Freischütz Digital (FreiDi) project. While the FreiDi project site in Erlangen, Germany researched on algorithms for audio synchronisation, the Detmold part of FreiDi worked on their digital music edition. In order to conform to the ideas of a critical archive the synchronisation data gained in Erlangen was incorporated into our MEI encoding, applying the principals of our CoRe-Model. That is to say: the individual MEI files for the recordings capture the synchronization data and link them to mei:measure elements in order to allow identifying which measure is being played at a certain timeslot of the audio. The mei:measures on the other hand reference our CoRE-file and thus allow a connection to the captured scores. This allows access to the digital facsimiles or even the encoded musical content.

While a facsimile based synchronisation was the basis for a first draft version, it is the combination with an ad hoc rendering via verovio that lies the foundation for a combined cross-modal syncPlayer.

This section contains a general Verovio Rendering Test, the first test implementations Facsimile Test and Rendering Test, as well as our final syncPlayer Demo:

Facsimile Test

implements a facsimile page turn demo of No. 6, using the recording made during our project and digital facsimiles fomr Weber's autograph score.

Verovio Test

test verovio with an example copied from the verovio website.

Rendering Test

implements a synchronised rendered score with measure highlighting and page turn of No. 6, using the recording made during our project and an encoding made during our project.

syncPlayer Demo

implements a cross modal synchronisation combining both facsimile and rendering with multiple recordings of No. 6, No. 8, and No. 9.