11 Comments
User's avatar
-R.Fumes's avatar

This is a wonderful and practical tutorial

Thank you for making and sharing this

The AI Architect's avatar

The handshake method is brillant for keeping character consistency - I've been struggling with exactly this problem where the protagonist morphs into a completly different person halfway through. Your point about using the last frame as the anchor for the next clip is such a simple fix but somehow I never thought to enforce it that strictly. The ROI argument is really compelling too tbh, especially when you factor in iteration costs not just the first pass.

Maria Sukhareva's avatar

I think eventually one could probably build the automatic pipeline but now I do not think it’s possible simply because the images are not always good on the first shot.

Ebenezer Rolston's avatar

Hi Maria

How do I register ? It is taking me to a third party service provider.

Thank you.

Ebe.

Maria Sukhareva's avatar

Yeah, it’s a third party. But I think I will do our own ai realist version

Peter's avatar

When Marks finds out the laptop is missing, he's changing into another man (different face, younger, not tired, no beard). You could sell that idea to Hollywood!

Maria Sukhareva's avatar

Haha fair enough. I think my mistake was the frames were generated in a way that he was standing with his back and then there is an aerial shot, so he was not anchored correctly. Probably should have generated a short frame where he turned around with his face clearly visible and anchor it in character

Peter's avatar

There are more inconsistencies in the video (mark couldn't miss seeing the thief before he turns to walk away, why does the thief freezes at the doorstep, why does Mark stare at the door) but those are small things that will be ironed out when the technology becomes better. For something made in an hour at almost no cost it's not bad.

Maria Sukhareva's avatar

Haha, Mark is so shocked that he lost his laptop that he started staring at the door.

Ok, the door was driving me crazy. There was almost no way to generate the box in front of Mark, him not staring at the door but at the desk and standing with his back to the camera. It is either the image had the box next to him, he was staring at the door or he would turn around.

The thief freezes because that is the end of the frame, theoretically the easy fix would be just to make a video half a second shorter in capcut so the freeze is not visible.

Sergei Polevikov's avatar

Thanks for doing this, Maria. Are you sure the registration link is correct? It’s taking me to some weird places. 😉

Maria Sukhareva's avatar

Yeah, it’s a Macedonian company. For some reason their website always opens in Macedonian