Stable Diffusion ComfyUI Create AI Influencer Dance Video With Mimic Motion (2024 Guide)
12,635
2024-07-05に共有
We are diving into the fascinating world of ComfyUI and exploring how to create AI influencer dance videos using their Mimic Motion framework. If you want to take your dance videos to the next level and achieve that perfect synchronization with your favorite anime characters or any other source videos, then this video is for you.
Videos About AI Animation With Stable Diffusion And ComfyUI
• How To Make Stable Diffusion Video To...
• ComfyUI Workflow Create Animation Wit...
Example Workflow github.com/kijai/ComfyUI-MimicMotionWrapper/tree/m…
Workflow For Freebies : www.patreon.com/posts/comfyui-create-107532705
Additional Tutorial Content For Patreon Supporters : www.patreon.com/posts/mimicmotion-v1-107525816
Throughout this tutorial, I'll guide you through the installation process of the ComfyUI Minimic Motion wrapper and its dependencies. We'll also download the necessary files, including the Minimic Motion package and SVD models.
I'll demonstrate the basic workflow for creating Mimic Motion, showcasing how it generates realistic movements by utilizing DW pose control net models. We'll explore the various steps involved, such as getting the pose, combining the skeleton motion, and generating the final dance video presentation.
Using examples from Naruto and Artlist, I'll show you how to work with different aspect ratios and dimensions to achieve the best results. We'll discuss the importance of consistency and avoiding deformations by using the same aspect ratios for your loaded videos and images.
Additionally, I'll provide a sneak peek into more advanced workflows, including segmentations for DW pose and restyling videos using static AI images. These advanced techniques will be exclusively available to my Patreon supporters, so make sure to join our community for access to exclusive content and detailed tutorials.
If you're ready to create stunning AI influencer dance videos with ComfyUI's Mimic Motion, then don't miss this tutorial. Hit that subscribe button and turn on the notification bell, so you never miss any future videos on AI technology, video editing, and more.
Paper: tencent.github.io/MimicMotion/
MimicMotion Github : github.com/tencent/MimicMotion
ComfyUI MimicMotion Custom Node from KiJai : github.com/kijai/ComfyUI-MimicMotionWrapper
Timestamps:
00:00 Introduction
00:50 What Is Mimic Motion
02:50 Ways To Use Mimic Motion
04:00 Mimic Motion in ComfyUI Installation
04:30 Run The Basic Example Of Mimic Motion Workflow
06:00 AI Dance Motion Generation Example Result
06:34 Input Reference Date Need To Be Aware Of
08:38 Tuned Workflow For Everyone
09:05 Additional Content For Patreon Members
09:26 AI Influnencer Dance Examples
If You Like tutorial like this, You Can Support Our Work In Patreon:
www.patreon.com/aifuturetech/
Discord : discord.gg/BTXWX4vVTS
コメント (21)
-
before doing any thing make sure your comfy UI is on any drives upper most directory for example d:/comfyui avoid any folders or sub folders that will result in hugging face download error
-
This is very cool framework. Really game changer.
-
Is it possible for it to look as realistic as a real person if combined with the most realistic model possible, rather than semi-realistic like this? I want to adapt it to create AI girls dancing ?^^
-
😄 我來了！Ben 嘩, 見到真係 Youtube 好多白痴留言。D人係咪真係咁L蠢 問D問題...好心佢哋啦, 認真了解就明白架啦👍
-
the installer guide should be step by step. It has been very difficult for me and I can't install it😶😶
-
Just tested it. Looks good, I created with anime and 3D characters.
-
🎉🎉nice , I think I can move on from AnimateDiff to this 😂😂😂
-
Thx for new info 👍👍👍
-
Nice! Thanks! Bye AnimateDiff 👋👋
-
Thanks King
-
I use run comfyai how to make it make all video lent my inputs is 10 sec he oly make first 2 sec and stop any solution for this , thanks in advanced
-
just cut the model/backgrounf out of the scene using tracking feature in davinci or your preferred video editor then use AI to modify model then export it again in davinci so your background would be fine and sharp with minimum aberrations
-
Sir i getting this error. Error occurred when executing DownloadAndLoadMimicMotionModel: Error no file named config.json found in directory C:\Users\akash\Documents\ComfyUI_windows_portable\ComfyUI\models\diffusers\stable-video-diffusion-img2vid-xt-1-
-
On this video progress takes ~1 sec for a step. On my 8gb GPU - 1 min (!) for a step. How much VRAM do you have?
-
it gives error as :- Using `low_cpu_mem_usage=True` or a `device_map` requires Accelerate: `pip install accelerate` any idea?
-
Nice. How long does it take to generate a 5 sec video?
-
Only when patreon is unlocked can workflow be download?
-
Is it better than viggle
-
What is gpu requirements for this to run as I have 8gb vram only.
-
Anyone please tell im new to this, Is it better than animate anyone and viggle ai ?
