Motion capture is not necessary to have fun in Mikoverse, but it certainly adds to your experience and everyone you're with!
The intent of this guide is to help index the different solutions available, and provide context on how to use it in Mikoverse. There is no particular one-size-fits-all solution, and which solution fits you will depend on your comfort level on the different solutions available.
If you need help with any of the motion tracking, please swing by the Mikoverse Discord #tracking-discussion channel.
Live-Link is a quicker way to have a better experience so that players can see each other talk in higher definition. It's possible to use VMC Protocol for Face motion capture with the other solutions further below.
There is currently an issue with Imported avatars with networked LiveLink, but it will work with avatars registered with Mikoverse.
LiveLink Face (iOS only)[]
Minimum iPhone model is iPhone X[1] This is the lowest Latency solution in terms of Live Link.
Make sure your iPhone and the Mikoverse PC is on the same network
On your Mikoverse PC
Find your local IPV4 address by opening Command Prompt (type in 'cmd' in the Start menu)
Look for your 'IPv4 Address'. This should start with 192.168. or 10.0.
Take note of the address
In Live Link:
Start Live Link Face, go to the gear icon on the top left
Look for 'Live Link' under 'Streaming'. Tap into it.
Input target IP as your Mikoverse IP
Head back to the camera screen and make sure the 'LIVE' box is green. If not, tap it.
To re-center where your avatar is looking, press C (with gizmo mode is off)
Troubleshooting
Live Link Face may require your Mikoverse PC to be set to "Private Network"
Live Link will only transmit to the first application that asks for it. Meaning if you have a UE project open using LiveLink, Mikoverse will not be able to use LiveLink. You can close the app using LinkLink and Mikoverse should be able to connect.
"With this utility you can easily convert iOS and Android MeowFace (iFacialMocap) motion data to LiveLink used by Unreal Engine. This should help those whom use Android with MikoVerse facial and head tracking." -Ultimationzzz
Download windows EXE (202mb) MogueMotionCapture.exe
Run the MogueMotionCapture.exe
If "Windows protected your PC" click "more info" and "Run anyway"
Press the play button to begin tracking
Make sure your face is being captured in the preview window
Smile in MikoVerse Press ESC key to close the application. You can relocate the "MogueMotionCapture.exe" anywhere on your PC. A "MogueMotionCapture.ini" file will be saved when you exit the application. The file will be in the same directory as the exe, it has some default configurations that can be changed.
Note: running the application from Python loads faster and is recommended if you are familiar with Python
Body Tracking[]
Please also note that if you're using VMC Protocol full body tracking, you will "slide" in Mikoverse while moving with mouse and keyboard. However it is possible to use a treadmill to walk and simulate walking in Mikoverse.
Webcam-based Tracking[]
Most of these solutions use AI tracking. Results will vary and will require tuning. All have issues of being a little jittery
Face Capture may be possible with these application, but the system is different than LiveLink.
In all cases that use VMC Protocol, VMC Protocol needs to be enabled in Mikoverse. Head to Actions > Search for 'Enable VMC'
Idle Animations means if the app cannot detect a specific limb, the app will place the limb back to the Idle Animation. However, if an Idle animation has a 'twist' (e.g. a dance animation), upper body tracking should be turned off (Advanced Tracking Settings > Enable/Disable Tracking > Uncheck Head + Upper Body)
Parts available to control what is being controlled by which receiver or VSeeFace
Can specify which app applies to each bone
Has Leap Motion Support
VSeeFace does not have native body tracking, but is able to capture face motion and support two VMC Protocol receivers.
It's recommended to use multiple solutions so that VSeeFace acts as the main output to Mikoverse. For instance, you can use XR Animator to output to a specific port and have VSeeFace receive the VMC Protocol data from XR Animator.
You can also control which body part is controlled by which VMC Protocol Receiver
In case of using Local Media, you can drag-and-drop MP4 videos and the app will attempt to track the person in the video
Motion Capture
Double-click 🧍♂️Person icon
Select your preferred motion capture mode (generally Body + Hands)
Turn on VMC Protocol
Double-click 'VMC' icon
Click "VMC-protocol: OFF". Should switch to "VMC-protocol: ON
Posing
Double click 🕺 Dancing Icon
Select a default pose
Browsing poses can be a pain. Take some time to familiarize how to select a pose
When the motion capture can't detect a specific body part, the body part returns to the selected pose.
In Mikoverse:
Go to Actions > "Enable VMC" ("Enable VMC Pose only" if using LiveLink)
To use FBX animations
Make sure Mocap is off.
To turn off Mocap, double-clicking the icon again and selecting turn off.
Drag-and-drop the FBX animation directly into XR animator.
Known working FBX animations are available on Mixamo. If the FBX animation doesn't work, the animation may need to be run through Unreal Editor and re-exported.
