F. Heyen, Q. Ngo, and M. Sedlmair. Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR), page 692-699. ISMIR, (December 2023)
DOI: 10.5281/ZENODO.10265383
Abstract
We propose different methods for alternative representation and visual augmentation of sheet music that help users gain an overview of general structure, repeating patterns, and the similarity of segments. To this end, we explored mapping the overall similarity between sections or bars to colors. For these mappings, we use dimensionality reduction or clustering to assign similar segments to similar colors and vice versa. To provide a better overview, we further designed simplified music notation representations, including hierarchical and compressed encodings. These overviews allow users to display whole pieces more compactly on a single screen without clutter and to find and navigate to distant segments more quickly. Our preliminary evaluation with guitarists and tablature shows that our design supports users in tasks such as analyzing structure, finding repetitions, and determining the similarity of specific segments to others.
Description
More materials here: https://ismir2023program.ismir.net/poster_216.html
and here: https://visvar.github.io/pub/heyen2023visual.html
%0 Conference Paper
%1 https://doi.org/10.5281/zenodo.10265383
%A Heyen, Frank
%A Ngo, Quynh Quang
%A Sedlmair, Michael
%B Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR)
%D 2023
%I ISMIR
%K 2023 cybervalley myown peerreviewed sfbtrr161 vis(us) visus visus:heyenfk visus:ngoqh visus:sedlmaml
%P 692-699
%R 10.5281/ZENODO.10265383
%T Visual Overviews for Sheet Music Structure
%U https://zenodo.org/doi/10.5281/zenodo.10265383
%X We propose different methods for alternative representation and visual augmentation of sheet music that help users gain an overview of general structure, repeating patterns, and the similarity of segments. To this end, we explored mapping the overall similarity between sections or bars to colors. For these mappings, we use dimensionality reduction or clustering to assign similar segments to similar colors and vice versa. To provide a better overview, we further designed simplified music notation representations, including hierarchical and compressed encodings. These overviews allow users to display whole pieces more compactly on a single screen without clutter and to find and navigate to distant segments more quickly. Our preliminary evaluation with guitarists and tablature shows that our design supports users in tasks such as analyzing structure, finding repetitions, and determining the similarity of specific segments to others.
@inproceedings{https://doi.org/10.5281/zenodo.10265383,
abstract = {We propose different methods for alternative representation and visual augmentation of sheet music that help users gain an overview of general structure, repeating patterns, and the similarity of segments. To this end, we explored mapping the overall similarity between sections or bars to colors. For these mappings, we use dimensionality reduction or clustering to assign similar segments to similar colors and vice versa. To provide a better overview, we further designed simplified music notation representations, including hierarchical and compressed encodings. These overviews allow users to display whole pieces more compactly on a single screen without clutter and to find and navigate to distant segments more quickly. Our preliminary evaluation with guitarists and tablature shows that our design supports users in tasks such as analyzing structure, finding repetitions, and determining the similarity of specific segments to others.},
added-at = {2024-01-05T17:11:56.000+0100},
author = {Heyen, Frank and Ngo, Quynh Quang and Sedlmair, Michael},
biburl = {https://puma.ub.uni-stuttgart.de/bibtex/21a5a2f9c38c1681813ec4543f0020088/frankheyen},
booktitle = {Proceedings of the 24th International Society for Music Information Retrieval Conference (ISMIR)},
copyright = {Creative Commons Attribution 4.0 International},
description = {More materials here: https://ismir2023program.ismir.net/poster_216.html
and here: https://visvar.github.io/pub/heyen2023visual.html},
doi = {10.5281/ZENODO.10265383},
interhash = {1380e23419fe4dd89f3a9f38d4831cd3},
intrahash = {1a5a2f9c38c1681813ec4543f0020088},
keywords = {2023 cybervalley myown peerreviewed sfbtrr161 vis(us) visus visus:heyenfk visus:ngoqh visus:sedlmaml},
month = dec,
pages = {692-699},
publisher = {ISMIR},
timestamp = {2024-01-05T17:11:56.000+0100},
title = {Visual Overviews for Sheet Music Structure},
url = {https://zenodo.org/doi/10.5281/zenodo.10265383},
venue = {Milan, Italy},
year = 2023
}