A flexible spectral modification method based on temporal decomposition and Gaussian mixture model
-
- Nguyen Binh Phu
- School of Information Science, Japan Advanced Institute of Science and Technology
-
- Akagi Masato
- School of Information Science, Japan Advanced Institute of Science and Technology
Search this article
Description
Manipulating spectral structure often leads to degradation of speech quality, which is mainly due to insufficient smoothness of the modified spectra between frames, and ineffective spectral modification. This paper presents a new spectral modification method to improve the quality of modified speech. If frames are processed independently, discontinuous features may be generated. Therefore, a speech analysis technique called temporal decomposition (TD), which decomposes speech into event targets and event functions, is used to model the spectral evolution effectively. Instead of modifying the speech spectra frame by frame, we only need to modify event targets and event functions. This feature leads to easy modification of the speech spectra, and the smoothness of modified speech is ensured by the shape of event functions. To improve spectral modification, we explore Gaussian mixture model parameters (spectral-GMM parameters) to model the spectral envelope of each event target, and develop a new algorithm for modifying spectral-GMM parameters in accordance with formant scaling factors. We first evaluate the effectiveness of our proposed method in spectra modeling, and then apply it to two areas which require different amounts of spectral modification, emotional speech synthesis and voice gender conversion. Experimental results show that the effectiveness of our proposed method is verified for spectra modeling and spectral modification.
Journal
-
- Acoustical Science and Technology
-
Acoustical Science and Technology 30 (3), 170-179, 2009
ACOUSTICAL SOCIETY OF JAPAN
- Tweet
Details 詳細情報について
-
- CRID
- 1390282680065721728
-
- NII Article ID
- 10025992412
-
- NII Book ID
- AA11501808
-
- ISSN
- 13475177
- 03694232
- 13463969
-
- NDL BIB ID
- 10214420
-
- Text Lang
- en
-
- Data Source
-
- JaLC
- IRDB
- NDL
- Crossref
- CiNii Articles
-
- Abstract License Flag
- Disallowed