Technical Workflow:

Using Captury(Markless Mocap) related to

【Metahuman Animation + Body/Facial Motion Capture+FACS Rig】:

🎬Technical Animation Workflow| Part 1: MetaHuman creation & Body/Facial Motion Capture & FACS Rig_by Using Captury(Markless Mocap) :

🔸①【 Personalized MetaHuman (Facial ROM Footage)】:
●Record facial Range of Motion (ROM) footage using Live Link Face.(leveraging the captured video‘s depth data)
●Import the recorded footage into Live Link Hub(UE).
●Create Metahuman ROM Identity, Identity Solve, Solve facial expressions and teeth.
●Create MetaHuman Rig and MetaHuman Performance asset.
●Use the ROM ID and Head Conform option in MetaHuman Creator (MHC) to generate a full-body MetaHuman character and adjust its body features.
●Add physics cloth assets to the character/or Add assets through its Blueprint.
●Fix Cloth Penatration issues through the Sculpt → Skeletal Mesh → Cloth → Outfit → Wardrobe workflow.


🔸②【Facial Motion Capture】:
●Capture Facial Animation footage using Live Link Face/Captive/FaceGood(headset).
●Import facial capture footage into Unreal Engine.
●Create a MetaHuman Performance asset and process the footage using the previously generated ROM Identity.
●Export the resulting facial animation as FBX data.


🔸③【Body Motion Capture】:
●UE real-time synchronization Captury.(Markless Capture) The Captury
●Use the built-in retargeting capability of Captury Live to create Character's LiveLink BP in UE.
●Connect LiveLink BP to the body component of the personalized MetaHuman Blueprint.
●Drive the MetaHumans body in real time using the streamed motion capture data.
●Animation Recording workflows:
A: Record real-time performances using Unreal Engines Take Recorder and export the recorded Animation Sequences.
B: Export offline motion capture data recorded directly from Captury.
Or
●Export the MetaHuman skeleton into MotionBuilder (MoBu) for retargeting.
Process the body motion capture data recorded on-site through Captury.

🎬Technical Animation Workflow| Part 2: Import Data & MetaHuman Rig /FACS Rig Maya Animation Cleanup & Unreal Engine Import:

🔸④【Importing MetaHuman Rig(Body+Facial) into Maya】:
Body Animation Workflow:
●Import the MetaHuman rig directly into Maya using MetaHuman Creator and the Unreal Engine plugin for Maya.
●Set up body controls using AdvancedSkeleton, Custom-built controllers, or Python scripts to transfer Control Rig setups from UE. Use AdvancedSkeleton retargeting tools to retarget body motion capture data onto the body ADV controllers...
●Alternatively, if the MetaHuman skeleton is used directly in the Captury workflow, body animation cleanup can also be performed in MotionBuilder.

Facial Animation Workflow:
●Import facial animation FBX data into Maya on FACS-based facial controllers through LIGHTSPEED STUDIOS' LightBox pipeline (DCC software environment and dependency package management system) and LSA tools.


🔸⑤【Motion Capture Animation Cleanup】:
●Create additional Animation Layers to cleanup animation, then merge the layers.
●Start by reviewing the original performance footage to identify and reconstruct the actor's intended expressions and movements before refining the animation.
●Understanding how different facial rig controllers correspond to specific muscle movements and expressions.
●Body and facial animations can also be combined and previewed directly in Maya to evaluate the character's overall performance.


🔸⑥【Exporting Refined Animations Back to Unreal Engine Sequencer】:
Body Animation Export:
●Export the cleaned skeletal body animation from Maya as FBX. Assign it to the MetaHuman character's body track in Sequencer.
●Open Metahuman Bp to adjust the animation retargeting settings as needed to ensure proper skeletal alignment.

Facial Animation Export:
●Export the cleaned facial animation from Maya. In Unreal Engine Sequencer, select the MetaHuman character's facial Control Rig track. Use Import Control Rig FBX to transfer the animation.

Previous
Previous

Streaming Vicon to MoBu to UE