 |
Today, we’re saying the final availability of the generative engine of Amazon Polly with three voices: Ruth and Matthew in American English and Amy in British English. The new generative engine was educated with publicly accessible and proprietary information, a wide range of voices, languages, and types. It performs with the best precision to render context-dependent prosody, pausing, spelling, dialectal properties, overseas phrase pronunciation, and extra.
Amazon Polly is a machine studying (ML) service that converts textual content to lifelike speech, referred to as text-to-speech (TTS) expertise. Now, Amazon Polly contains high-quality, natural-sounding human-like voices in dozens of languages, so you’ll be able to choose the perfect voice and distribute your speech-enabled functions in lots of locales or nations.
With Amazon Polly, you’ll be able to choose numerous voice choices, together with neural, long-form, and generative voices, which ship ground-breaking enhancements in speech high quality and produce human-like, extremely expressive, and emotionally adept voices. You can retailer speech output in commonplace codecs like MP3 or OGG, alter the speech price, pitch, or quantity with Speech Synthesis Markup Language (SSML) tags, and rapidly ship lifelike voices and conversational consumer experiences with persistently quick response occasions.
What’s the brand new generative engine?
Amazon Polly now helps 4 voice engines: commonplace, neural, long-form, and generative voices.
Standard TTS voices, launched in 2016 use conventional concatenative synthesis. This methodology strings collectively the phonemes of recorded speech, producing very natural-sounding synthesized speech. However, the inevitable variations in speech and the methods used to section the waveforms restrict the standard of speech.
Neural TTS (NTTS) voices, launched in 2019, use a sequence-to-sequence neural community that converts a sequence of phonemes into spectrograms, and a neural vocoder that converts the spectrograms right into a steady audio sign. The NTTS produces even larger high quality human-like voices than its commonplace voices.
Long-form voices, launched in 2023, are developed with cutting-edge deep studying TTS expertise and designed to captivate listeners’ consideration for longer content material, comparable to information articles, coaching supplies, or advertising movies.
In February 2024, Amazon scientists launched a brand new analysis TTS mannequin referred to as Big Adaptive Streamable TTS with Emergent talents (BASE). With this expertise, Polly Generative engine is ready to create human-like synthetically generated voices. You can use these voices as a educated buyer assistant, a digital coach, or an skilled marketer.
Here are the brand new generative voices:
| Name | Locale | Gender | Language | Sample immediate | NTTS voices | Generative voices |
| Ruth | en_US | Female | English (US) | Selma was mendacity on the bottom midway down the steps. 'Selma! Selma!' we shouted in panic. | ||
| Matthew | en_US | Male | English (US) | The guards have been standing outdoors with a few of our neighbours, listening to a transistor radio. 'Any excellent news?' I requested. 'No, we're listening to the names of people that have been killed yesterday,' Bruno replied. | ||
| Amy | en_GB | Female | English (British) | What are you taking a look at?' he mentioned as he stood over me. They received off the bus and began looking the bags compartment. The pressure on the bus was like a darkish, menacing cloud that hovered above us. |
You can select from these voice choices to fit your utility and use case. To study extra in regards to the generative engine, go to Generative voices within the AWS documentation.
Get began with utilizing generative voices
You can entry the brand new voices utilizing the AWS Management Console, AWS Command Line Interface (AWS CLI), or the AWS SDKs.
To get began, go to the Amazon Polly console within the US (N. Virginia) Region and select Text-to-Speech menu within the left pane. If you choose the voice of Ruth or Matthew within the language of English, US or Amy in English, UK, you’ll be able to select Generative engine. Input your textual content and hearken to or obtain the generated voice output.
Using the CLI, you’ll be able to listing the voices that use the brand new generative engine:
$ aws polly describe-voices --output json --region us-east-1
| jq -r '.Voices[] | choose(.SupportedEngines | index("generative")) | .Name'
Matthew
Amy
RuthNow, run the synthesize-speech CLI command to synthesize pattern textual content to an audio file (hey.mp3) with the parameters of generative engine and a supported voice ID.
$ aws polly synthesize-speech --output-format mp3 --region us-east-1
--text "Hello. This is my first generative voices!"
--voice-id Matthew --engine generative hey.mp3To study extra code examples utilizing AWS SDKs, go to Code and Application Examples within the AWS documentation. You can use Java and Python code examples, application examples comparable to net functions utilizing Java or Python, or iOS and Android functions.
Now accessible
The new generative voices of Amazon Polly at the moment are accessible right now within the US East (N. Virginia) Region. You solely pay for what you employ primarily based on the variety of characters of textual content that you just convert to speech. To study extra, go to our Amazon Polly Pricing web page.
Give new generative voices a attempt within the Amazon Polly console right now and ship suggestions to AWS re:Post for Amazon Polly or by your ordinary AWS Support contacts.
— Channy