You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi. I'm trying to do a full body video to video with talking and body movement & ran into a brick wall.
The programs that do the body movement have improved greatly but still warp the face really bad.
I was hoping to use your program to replace the face but found out it doesn't work that way. Once I do the body movement if I use that as a driving video I get back the face but lose the body movement and if I use it as the reference video the face gains the correct movement but looks nothing like the original face.
It would be great if you came up with a 3rd option where we could use LivePortrait to combine the driving & reference videos to get the face, then use that as a driving video to put the face back. That's confusing so I'll try to list the steps below.
Maybe you can achieve this by using masking and something to track the placement to make sure the head & hair are in the right place.
Steps:
1 Create Video A (body)
Start with a driving and a reference video
Make the body movement in another program to create Video A to get the body movement (face will warp)
2 Create Video B (face)
Use the driving & reference videos in LivePortrait to create Video B to get the face movement with the right face
Combine Video A & B to replace the warped face
Use video B as the driving video and video A as the reference video
Video B would replace the face in Video A
reacted with thumbs up emoji reacted with thumbs down emoji reacted with laugh emoji reacted with hooray emoji reacted with confused emoji reacted with heart emoji reacted with rocket emoji reacted with eyes emoji
-
Hi. I'm trying to do a full body video to video with talking and body movement & ran into a brick wall.
The programs that do the body movement have improved greatly but still warp the face really bad.
I was hoping to use your program to replace the face but found out it doesn't work that way. Once I do the body movement if I use that as a driving video I get back the face but lose the body movement and if I use it as the reference video the face gains the correct movement but looks nothing like the original face.
It would be great if you came up with a 3rd option where we could use LivePortrait to combine the driving & reference videos to get the face, then use that as a driving video to put the face back. That's confusing so I'll try to list the steps below.
Maybe you can achieve this by using masking and something to track the placement to make sure the head & hair are in the right place.
Steps:
1 Create Video A (body)
Start with a driving and a reference video
Make the body movement in another program to create Video A to get the body movement (face will warp)
2 Create Video B (face)
Use the driving & reference videos in LivePortrait to create Video B to get the face movement with the right face
Use video B as the driving video and video A as the reference video
Video B would replace the face in Video A
Hope that make sense.
Beta Was this translation helpful? Give feedback.
All reactions