How to Swap Characters and Voices in Any Video (Full Transcript)

[00:00:00] Speaker 1: In this video, you're going to learn how to swap the character within any video and keep the exact same movement and also swap the voice while keeping the exact same delivery using Eleven Creative.

[00:00:09] Speaker 2: Let's begin.

[00:00:09] Speaker 1: So to begin swapping our character, we want to head to Eleven Creative and you can click the first link in the description down below to get started. Here we want to go ahead and click image and video. Now, if you already have your character and your video, all you want to do is head to video right here and then we're going to go ahead and change the model to Kling 2.6 motion control. This allows us to upload our video and use as the motion reference and then upload the character image. But first, I want to go back to images and I want to generate our character. So let's say we wanted a new alien character. Here, I'm going to go ahead and choose a model that I like and so I'm going to select Nano Banana 2. I'm going to change the resolution to 2K and then we're simply going to type out our prompt. Once you've got your prompt, we can simply click generate. And so as you can see now, we've got four generations that we can go and use and swap into our video. So let's say we liked this one right here with the galaxy broadcast and we like this character and we thought this was perfect. But what we can do now is we can switch back to the video model and here again, we want to make sure that we've selected Kling motion control and we want to drag the generation that we like into the character box. And now we want to select the video that we want to apply this character to or the video in which we want to swap the character. So for example here, I've actually got one in my files intro video and I'm going to drag and drop it just like so. Now what I want to do, if I close files like this, I want to either select match video or match image. And basically match video applies the character to the video movement, but match image applies the motion from the video to the image. But for the most accurate copy of the motion, if you want to keep the exact same motion for your character, you want to go ahead and make sure you select match video. And then here you can include a prompt, but I tend to just leave this blank and then we simply click generate. And while that's generating, let's say we wanted to swap the character but keep it in the exact same environment. Well, what we could do here is if we actually go back to image, here I'm going to use my image reference again, and then I'm going to actually go back to files and I'm going to drag in my video as a second reference, but here we need to make sure we select a frame. So let's just choose this frame right here as the start frame, select the frame, and now I'm basically going to type out swap the man from at image 2 with the alien from at image 1. And for this, I'm going to be using Nano Banana 2 because it's the best at AI image editing. And then again, I simply click generate. So now I'm placing my character in the original scene of the video. So we're swapping just the character and not the entire location. Then I would go through the same process of going back to video, click motion control, and this time we would select one of the new generations of my character in the original environment. So I would use this one as the character and then again apply the motion from the reference video. Make sure that I match the video movement and then click generate. And now we've got our generations, let's take a look.

[00:02:58] Speaker 3: So you need an AI video voice changer to change the voice on your videos, whether it's for yourself or it's for AI films and characters that you're creating. Well, let me show you exactly how.

[00:03:06] Speaker 1: And so as you can see, we've got our character in the original environment with the exact same movement. And if we put them side by side, you can see that the movement is exactly the same. But there is one problem right here, the voice. It doesn't sound natural, right? So once we've swapped the character, we now want to swap the voice. So we can do this by simply clicking on edit in studio on this video clip. This now takes us into Eleven Creative Studio and here we can simply click on the video in the timeline and we want to click on use voice changer. And so now here I can go and choose any voice that I'd like to swap it to. So let's say we look for an alien voice, right? Strange, sci-fi, horrible, or blue alien, which is one of my older voices. Or maybe we want some kind of just female voice that matches the character a little bit more. Well, I could go ahead and choose one. So let's say we choose Ellen right here and we click change voice. And now Eleven Creative has used the speech-to-speech model to swap the voice, but keep the exact same delivery. So it sounds just like this.

[00:04:02] Speaker 3: So you need an AI video voice changer to change the voice on your videos, whether it's for yourself or it's for AI films and characters that you're creating. Well, let me show you exactly how.

[00:04:10] Speaker 1: And so now we could go and click on export and then export as a video or just simply download the audio with the voice changed. And that is how to swap characters in your video, including the movement and also the voice. If you have any questions, let us know in the comment section down below. And if you enjoyed this video and you want to see more, don't forget to hit that like button and subscribe. Thanks for watching.