![[Face, Fingers, Upper Body Tracking] VTubing in Warudo with Just One iPhone! thumbnail](https://img.youtube.com/vi/Tl8zpukvJi4/mqdefault.jpg)
VTubing with just one iPhone?
45sThe promise of full upper body and finger tracking with a single iPhone is surprising and highly shareable.
▶ Play ClipAI Summary
This tutorial demonstrates how to use a single iPhone or iPad for Vtuber live streaming in Warudo using the SAI app, which provides full ARKit facial capture and upper body motion capture including fingers. The setup involves configuring Warudo and SAI to stream data via VMC protocol.
Chapters
[0:00]
Overview
Use one iOS device with SAI for full ARKit facial capture and upper body motion capture including fingers, streaming to Unreal Engine and VMC-compatible software like Warudo.
[0:26]
Download SAI
Find a complete introduction to SAI and download it from the dollar's mocap website; link in description.
[0:38]
Initial Setup in Warudo
Open Warudo and SAI. In onboarding assistant, click get started, select a character, then configure motion capture by selecting VMC for both face and pose tracking.
[1:05]
Configure VMC Receiver
In Warudo sidebar, select VMC receiver to see listening port and IP address. In SAI settings, enter the IP and port.
[1:19]
Activate VMC Streaming
Return to SAI main screen and activate VMC streaming to control your character.
[1:30]
Fixed Lower Body Pose
To set a fixed lower body pose, select character in sidebar, setup motion capture, select VMC for face and motion capture, choose 'no' for full body tracking, remove legs from tracked parts, and select an idle animation.
By following these steps, you can achieve face, finger, and upper body tracking for VTubing in Warudo using just one iPhone or iPad.
Clickbait Check
95% Legit"Title accurately describes the tutorial content; video delivers on its promise."
Mentioned in this Video
Tutorial Checklist
2
0:48
Configure motion capture: select 'I know what to use', then select VMC for both face tracking and pose tracking.
6
1:30
To fix lower body pose: select character in sidebar, click setup motion capture, select VMC for face and motion capture, choose 'no' for full body tracking, remove legs from tracked parts, and select an idle animation.
Study Flashcards (4)
What app is used for facial and upper body motion capture on iOS?
easy
Click to reveal answer
What app is used for facial and upper body motion capture on iOS?
easy
Click to reveal answer
SAI
0:02
Which protocol does SAI use to stream data to Warudo?
medium
Click to reveal answer
Which protocol does SAI use to stream data to Warudo?
medium
Click to reveal answer
VMC (Virtual Motion Capture) protocol
0:52
What two types of tracking should be set to VMC in Warudo?
easy
Click to reveal answer
What two types of tracking should be set to VMC in Warudo?
easy
Click to reveal answer
Face tracking and pose tracking
0:52
How do you fix the lower body pose so motion capture doesn't affect the legs?
hard
Click to reveal answer
How do you fix the lower body pose so motion capture doesn't affect the legs?
hard
Click to reveal answer
Select 'no' for full body tracking, remove left leg and right leg from tracked body parts, and select an idle animation.
1:49
💡 Key Takeaways
🔧
Single iOS Device VTubing
Demonstrates that full VTubing with face, fingers, and upper body tracking is possible with just one iPhone or iPad.
0:02
🔧
VMC Receiver Configuration
Key step to connect SAI and Warudo via IP and port for real-time streaming.
1:05
🔧
Fixed Lower Body Pose Workaround
Provides a method to keep character's legs animated while upper body is motion-captured.
1:30Full Transcript
[00:00] In this video, we'll show you how to use
[00:02] a single iPhone or iPad to do Vtuber
[00:04] live streaming in Werudo. We'll be using
[00:07] dollar SAI, which enables full ARKit
[00:09] facial capture and upper body motion
[00:11] capture, including fingers using just
[00:13] one iOS device. Seiya streams data in
[00:16] real time to Unreal Engine and VMC
[00:18] compatible Vtuber software like Wudo,
[00:21] Inzoi, and Anime. [music]
[00:26] You can find a more complete
[00:27] introduction to SA and download it from
[00:29] the dollar's mocap website. The link is
[00:32] in the video description.
[00:38] Here we have Wudo and SA already open.
[00:41] In the onboarding assistant, click get
[00:43] started. Under basic setup, select a
[00:46] character.
[00:48] When configuring motion capture, select
[00:50] I know what to use.
[00:52] Then select VMC for both face tracking
[00:55] and pose tracking.
[01:00] Click okay all the way through.
[01:05] Select VMC receiver in the sidebar where
[01:08] you can see [music] the listening port
[01:09] and IP address. Next, in Sia, tap the
[01:13] gear button in the bottom right corner
[01:14] to open the settings dialogue and enter
[01:16] the IP and port.
[01:19] Return to the Sia main screen and
[01:21] activate VMC streaming. You can now
[01:24] control your character through SA.
[01:30] If you want to set a fixed pose for your
[01:32] character's lower body, select the
[01:34] character in the sidebar.
[01:39] Click setup motion capture.
[01:42] Select VMC for face capture. Select VMC
[01:46] [music] for motion capture as well.
[01:49] Select no for the track full body
[01:51] option. Remove the left leg and right
[01:54] leg from the tracked body parts list.
[01:57] This way motion capture won't affect the
[01:59] legs. Then select an idle animation. You
[02:03] can see that the character's legs can
[02:05] now have [music] animations applied.
[02:10] Thank you for [music] watching. Please
[02:12] subscribe to our channel so you don't
[02:14] miss future tutorials and feature
[02:15] introductions.
[02:17] See you in the next video.