ai-digest.dev
last updated 1 h ago
MultimodalarXiv cs.AI 19 d ago

EmoInstruct-TTS: Dual-Path Instruction-Guided Emotional Speech Synthesis

EmoInstruct-TTS is a newly proposed dual-path framework for emotional speech synthesis that allows users to specify emotions through natural language instructions. It features Emotion2embed, a supervised semantic-acoustic embedding covering 48 emotional states with fine-grained intensity levels, and utilizes the Instruction-Conditioned Emotion Flow Model (ICE-Flow) to generate emotion representations. This system enhances emotional controllability and the naturalness of synthesized speech, making it a significant advancement for practitioners looking to implement nuanced emotional expression in AI-generated speech.

ttsemotional synthesisllmrelevance 0.00 · engagement 0.00
Read at source ↗← all news
EmoInstruct-TTS: Dual-Path Instruction-Guided Emotional Speech Synthesis — AI News Digest