Musical Engineering and Discovery with Wavelet Analysis

April 3, 2021   /  

Name: Rephael Berkooz
Major: Mathematics
Minor: Computer Science
Advisors: Dr. Pamela Pierce, Dr. Subhadip Chowdhury

This project presents a novel method for extracting musical features via signal processing and wavelet analysis. I begin by exploring the human experience of consuming music, contrasting the digital construction and playback of music. Beginning with the Fourier transform, I construct and explore different modes of encoding music information. This project also introduces the fundamental limitations of encoding time and frequency information. Further, this project constructs the mathematics of Wavelet Analysis, which allows the representation digital music information in a format very close to our human understanding of music. Building upon the mathematics convolutions and other techniques in signal processing, this project pioneers methods for extracting beats and rhythm structure. Using these extracted musical components, I propose a method for recommending music. Theoretically, this music recommendation system enables individuals to choose the degree of similarity between different repeating parts of the recommended songs, such as bass line, rhythm, and melody.My IS project has given me a new way of connecting music with different modes of mathematical analysis, all within the context of the human-digital information interface.

Rephael will be online to field comments on April 16:
noon-2pm EDT (PST 9-11am, Africa/Europe: early evening) and 4-6 pm EDT (PST 1-3pm, Africa/Europe: late evening)