HYBRID MUSICAL INSTRUMENT SOUND GENERATION USING
TEMPORAL AND SPECTRAL SHAPE FEATURES
Guided By Presented By
Mr.Arun Jose Noufiya Nazarudin
Asst. Professor,ECE SP M.Tech
TKMIT TKMIT1
OBJECTIVE
Quest for a fresh music soundHybrid musical instrument sound generation
using sound morphing
2
INTRODUCTION
Sound morphing-blending of two or more sounds into a single percept
Transform across timbre dimensionsTemporal and Spectral shape features are usedFeatures are morphed separately and mixed
back together Features and interpolation factor should vary
linearly
3
BLOCK DIAGRAM
Selected 2 or more sounds
Temporal Processing
Spectral Processing
Feature Extraction Comparison Feature
Extraction
Morphing
Minimum Error
4
Compare with a sound database
Target sound
METHODS USED
Feature extraction* Temporal- Log attack time & Temporal centroid
* Spectral- centroid, spread, skewness, kurtosis
Temporal Processing
* Segmentation
* Alignment
* Envelope Estimation
5
6
Contd…
Spectral Processing
* Sinusoidal & Residual Decomposition
* Source-Filter Modeling
Morphing
* Spectral envelope morphing
* Interpolation of frequencies of partials
* Temporal envelope morphing
MODIFICATION
Can tune the morphed sound using recorded music
Combination of various morphed sounds can be used for automatic orchestra/karoke generation
7
APPLICATIONS
Entertainment and Music industryMusic compositionComputer Music Generation
8
REFERENCES[1] Marcelo Caetano and Xavier Rodet, “Musical Instrument Sound
Morphing Guided by Perceptually Motivated Features”, IEEE Trans.on audio,speech and language processing., vol.21, no.8,pp.1666–1675,Aug. 2013.
[2] William Sethares and James Bucklew, “Kernel Techniques for Audio Morphing”, Department of Electrical and Computer Engineering, University of Wisconsin-Madison, Madison, May,2012.
[3] Nicholas Waggoner and Chris McGilliard, “Music Morph”, Physics of Music.,pp 498-599, May 2005.
[4] Gianpaolo Evangelista and Sergio Cavaliere, “Audio Effects Based on Biorthogonal Time-Varying FrequencyWarping”, EURASIP Journal on Applied Signal Processing 2001:1, 27–35.
9