Sonifying the Global Jukebox

Posted on Jan 19, 2023

The following post introduces a data sonification that I created in response to the monthly sonification challenge set by Decibels, a data sonification community I am part of. You can listen to it two ways: the SoundCloud link is a "podcast style" version, where I introduce the dataset and each sound to act as a sort of "legend" for understanding the sonification. Or, you can read through the post below and listen to the sonification clips standalone (quicker option probably).

Ben Dexter Cooley · Global Jukebox Sonification

The cultural meanings of instruments

Have you ever wondered what a culture's instrumentation says about itself? I mean, maybe not… it is a… very specific question. But, it is based on a simpler, more intuitive premise: the things that a culture invent probably reflect a shared value or priority for that culture. Right? Without any well-researched, peer-reviewed evidence, this still sounds likely to me.

I was asking myself this question after looking at particular dataset: the Global Jukebox (journal article here and interactive map here). This dataset holds many rows and columns containing data about instruments: how large they are, who often plays them, when they were invented, and what they are used for. This last question—what their most important function in society is—stuck with me.

The following data sonification is a sonic exploration of this question. After a bit of analysis, I was able to identify the 5 most common “functions” for instruments across all cultures in the dataset: DANCE, RITUALS, PASSIVE LISTENING, SELF ENTERTAINMENT, and SIGNALING. I ignored some categories such as MISSING DATA here. Then, using a sonification approach called parameter mapping, I assigned different functions to different aspects of the music. The result is a series of soundscapes on loop, each one representing a different culture.

To decode the meaning, here's what you need to know:

Let's take a listen to a few cultures that are very high in one of these 5 functions to pick out the differences.

Southern United States

Listen to the the sonification:

Japan

Listen to the the sonification:

Northern India

Listen to the the sonification:

Zulu

Listen to the the sonification:

Ashanti

Listen to the the sonification:

As you can hear, each of the above five cultures really stands out in one of the most common instrument functions. Southern United States by far was credited with the most instruments meant for DANCE. Zulu had the most instruments dedicated to SELF-ENTERTAINMENT. Interestingly, N. India had the highest value for PASSIVE LISTENING, but playing back the tracks, JAPAN also seems to have a relatively high number for this category with some reverb-drenched tones (in contrast, JAPAN was a clear leader in instruments dedicated to RITUALS, which can be heard in the near constant cadence of arpeggiating notes). Ashanti had one of the slowest beats, but the growliest bass (i.e. high in SIGNALING).

I love that sonification can introduce this level of nuance. This was a fun challenge to get started with and I hope to spin out more of this kind of work in the future.

For those curious, my process was the following:

If you'd like to join in on the sonification challenges, join us on the Decibels Discord!


You can find me on the Mastodon vis.social instance or LinkedIn. I also write a newsletter about these types of things called Data Curious.