Multimodal
EmoInstruct-TTS: Dual-Path Instruction-Guided Emotional Speech Synthesis
EmoInstruct-TTS is a newly proposed dual-path framework for emotional speech synthesis that allows users to specify emotions through natural language instructions. It features Emotion2embed, a supervised semantic-acoustic embedding covering 48 emotional states with fine-grained intensity levels, and utilizes the Instruction-Conditioned Emotion Flow Model (ICE-Flow) to generate emotion representations. This system enhances emotional controllability and the naturalness of synthesized speech, making it a significant advancement for practitioners looking to implement nuanced emotional expression in AI-generated speech.
ttsemotional synthesisllm