Logo TU Vienna  Logo IFS Information & Software Engineering Group
Vienna University of Technology
Institute of Software Technology and Interactive Systems
Information & Software Engineering Group

Music Information Retrieval

Logo Music Information 
Retrieval at TU Vienna IFS
  [Topics] [Projects] [Downloads] [People] [Publications] [Press] [Events]  

The Algorithm

Tools

Evaluation

Downloads

 

Automatic Chord Detection

Many music-related tasks that humans solve easily, like distinguishing the constituting instrument in polyphonic audio or the recognition of rhythm or harmonies are still not solved for computers. Especially the development of an automatic transcription system that computes the score out of a music recording is still a distant prospect despite decades-long research efforts. Here we deal with a subproblem of automatic transcription - automatic chord detection. Chord detection is particularly interesting as chords are comparatively simple and stable structures, and at the same time completely describe the harmonic properties of a piece of music.

We have designed an algorithm that operates on musical pieces of arbitrary instrumentation and considers music theoretical knowledge. Our detection method incorporates rhythm and tonality of the musical piece the same as knowledge about the common frequencies of chord-changes. An average accuracy rate of 65% has been achieved on a test set of 19 popular songs of the last decades and confirms the strength of this approach.

 

The Algorithm

Our chord-detector consists of 4 modules: The basic chord detection itself, beat tracking, key detection and a chord-sequence optimizer. Beat tracking is used to split the audio data into blocks of sizes that correspond to the computed beat structure. As chord changes usually happen on beat times, beat detection is a good method to enlarge analysis blocks without risking to miss chord-changes. Each of the obtained blocks is passed to an enhanced autocorrelation-algorithm. Its output is then used to compute the intensity of each pitch class, the so called Pitch Class Profile (short PCP). The calculated PCP's are compared to a set of reference chordtype-PCP's using only those reference chords that fit to the key of the song. Finally the smoothing algorithm rates each chord according to the number of chord changes around it.

Flowchart

Large flowchart of the algorithm
 

Tools

Several tools have been implemented to help the user interpret and evaluate the outputs of genchords. These include labeldiff, that compares two labelfiles (files containing time-chord pairs for the song) and prints out a detailed comparison table as well as confusion matrix and statistical data. Transpose provides methods for transposing and converting labelfiles to different formats, including enharmonic equivalent representations.

But probably the most interesting tool is a tool to resynthesize the detected chords and mix them with the original song. This tool, called chordmix, enables the user to get a quick first estimation of the correctness of the detected chords by simply listening to the results.
Evaluation by listening
 
 

Evaluation

On a testset of 19 songs our system achieved an average accuracy rate of 65%. As our algorithm has a modular design we were able to evaluate the influence of each module seperately: The basic chord-detector ("shortspan detection") without beat, key and optimization modules only correctly detected the chords at an average of 37% of the time. Beat detection allone enhances detection quality by 6%, optimization by 7% and key detection alone by 13%. See the diagram below for detailed results on every test-song.

Testset

Artist Album Title Length Accuracy Truth File
ABBA Gold Dancing Queen 03:51 82% truth file
Bob Dylan Best of Bob Dylan Blowin In The Wind 02:48 63% truth file
Cat Stevens The Very Best Of Cat Stevens Wild World 03:20 77% truth file
Elton John The Very Best Of Elton John Sorry Seems To Be The Hardest Word 03:50 60% truth file
Elvis Presley Elvis 30 No.1 Hits (You're The) Devil In Disguise 02:20 60% truth file
Eva Cassidy Songbird Fields Of Gold 04:42 42% truth file
Green Day Dookie Basket Case 03:03 73% truth file
Jack Johnson In Between Dreams Sitting Waiting Wishing 03:03 44% truth file
Mando Diao Hurricane Bar God Knows 03:50 52% truth file
Muse Absolution Thoughts Of Dying Atheist 03:11 71% truth file
Norah Jones Come Away With Me Come Away With Me 03:18 83% truth file
Radiohead OK Computer Karma Police 04:21 65% truth file
Reinhard Fendrich
I Am From Austria 03:48 63% truth file
REM In Time Everybody Hurts 05:18 92% truth file
Red Hot Chili Peppers Californication Californication 05:21 55% truth file
The Beatles 1 Help! 02:18 61% truth file
The Beatles 1 Yesterday 02:05 64% truth file
Tina Turner The Best of Tina Turner What's Love Got To Do With It 03:50 46% truth file
Travis The Invisible Band Sing 03:50 82% truth file
Testset 1


Song Nr. Truth File
14 truth file
40 truth file
44 truth file
45 truth file
46 truth file
71 truth file
Testset RWC-MDB-P-2001
 
 

Downloads

 

 

 
 
top
created 17.04.2007 by Veronika Zenz, last edited 21.11.2007 by Thomas Lidy