Science Corner: Neuer Audiokompressionscodec encodiert 20 Sec. Musik auf 1KB – bisher aber nur Klarinetten

Klarinette
Vorher und Nachher (nachgestellte Szene)

Wissenschaftler der University of Rorchester haben eine Methode entwickelt, eine um den Faktor 1000 effektivere Audiokomprimierung zu entwickeln. Auf Basis von Physical Modelling und Performance-Modelling wurde ein Klarinettensolo von 20 Sec auf 1KB komprimiert.

„This is essentially a human-scale system of reproducing music,“ says Mark Bocko, professor of electrical and computer engineering and co-creator of the technology. „Humans can manipulate their tongue, breath, and fingers only so fast, so in theory we shouldn‘t really have to measure the music many thousands of times a second like we do on a CD. As a result, I think we may have found the absolute least amount of data needed to reproduce a piece of music.“

In replaying the music, a computer literally reproduces the original performance based on everything it knows about clarinets and clarinet playing. Two of Bocko’s doctoral students, Xiaoxiao Dong and Mark Sterling, worked with Bocko to measure every aspect of a clarinet that affects its sound—from the backpressure in the mouthpiece for every different fingering, to the way sound radiates from the instrument. They then built a computer model of the clarinet, and the result is a virtual instrument built entirely from the real-world acoustical measurements.

Das ganze ist also ein Art Midi-cum-Modelling Information File, das einen Synthesizer füttert. Klangbeispiele findet ihr hier. Die Technik, um den Codec auch auf komplette Band/Orchesterperformances anzuwenden, ist auch schon in Arbeit. Anwendungsbereich soll aber weniger die Datenkompression als die Einbindung von virtuellen Musikern in den Musikkreationprozess sein:

„Maybe the future of music recording lies in reproducing performers and not recording them,“ says Bocko.

Nicht Sample-basiertes Performance-Modelling finde ich prinzipiell spannend, da es da ungleich Virtual Guitarist und ähnlichen Ansätzen Möglichkeiten zum Übersteuern gibt – ich bau mir ein 200M lange Flöte gespielt von einem Bläser mit Zebrakopf. Klingt bestimmt toll!

DasDAS

via Audio Lemon

  • Twitter

2 Antworten auf “Science Corner: Neuer Audiokompressionscodec encodiert 20 Sec. Musik auf 1KB – bisher aber nur Klarinetten”


  1. 1 Anonymous 16. April 2008 um 13:37 Uhr

    hmm – interesting stuff – but not sure how much different this is from midi – using this kind of synthesis is not too far away from the sampling of midi, and would require a PC to playback anyway, oder?

    (allerdings – habe dein blog abboniert seit ein paar wochen und alles war bisher sehr interresant – danke)

  2. 2 DasDAS 16. April 2008 um 14:05 Uhr

    thanx!

    It seem to be two step process: first analysis and transcription to a midi-like note-system including a performance analysis, then resynthesis with a physical modelling system. You probably could do this with Melodyne, Midi-tweaking and a Physical Modeling synth.

    But what makes this interesting is that the whole process can be done in one, much like a codec, that could be implemented anywhere. If you see how small in filesize Physical Modelling VSTis such as the Pianoteq are, this is entirely feasible. Of course, this is still doing baby steps, as you would need complete seperation of all instruments and pictches as well as a modelling system for any sound. But the creative possibilities seem endless to me. I don‘t see it replacing mp3 but rather as a means to create new sounds with avatar players.

Die Kommentarfunktion wurde für diesen Beitrag deaktiviert.