Automated translation/dubbing of videos in the same voice!
Elevenlab's AI automatically translated my video from English to Hindi in my voice
Watch this 1-minute video in Hindi by me and Shrikant.
Now watch the 1st minute of the original video which we shot in English:
The Hindi version was automatically generated by https://elevenlabs.io/. It took me exactly 4 mouse clicks to create the Hindi version. Everything was done by the AI automatically.
Specifically, it did the following:
Fetch the original from YouTube
Autodetect the original language
Understand the English in the original video
Translate it to Hindi
Understand the multiple different voices in the original video
Synthesize speech in Hindi in the voices of Shrikant and I
Insert the generated Hindi speech in the correct places in the video, replacing the English
I used the free version, so I got only the first minute, but I assume that with the paid version, I would get my entire video in Hindi. With just 4 mouse clicks. (And it will happen in minutes!)
The system supports 29 languages already and I’m sure more are coming:
Gen AI technology is being developed faster than we can think of ways to use it.
(By the way, the video itself is about how pollution is making you not just sick, but dumb. It doesn't just affect your lungs, it also affects your brain: it reduces your productivity, makes your decisions worse, it increases chances of you getting Alzheimer's, and it even affects your unborn baby. If you find that topic interesting, you can watch the whole video above, or you can read it in article form here.)
The Hindi translation made a basic error. Like called millions as lakhs where as 1 million is 10 lakhs