3D VTubing Primer
Below is a list of frequently asked questions about 3D VTubing; they are not specific to Warudo, but are still useful to know!
What is a blendshape?
A blendshape is a set of vertices moving from one position to another, like the following:
A blendshape's value is between 0 and 1. When the value is 0, the vertices do not move. When the value is 1, the vertices move to the target position, as shown below:
Note that blendshapes in Unity takes values from 0-100, but in Warudo (and most 3D tools) blendshapes take values from 0-1. Reference: https://developpaper.com/unity-realizes-facial-expression-transition-and-switching-animation-tutorial-through-blendshape/
The list of blendshapes on a model is entirely up to the modeler (and the modeling tool). Below are a few lists of common blendshapes (for reference only; your model may have more or fewer blendshapes):
VRoid Studio models
- Fcl_ALL_Neutral
- Fcl_ALL_Angry
- Fcl_ALL_Fun
- Fcl_ALL_Joy
- Fcl_ALL_Sorrow
- Fcl_ALL_Surprised
- Fcl_BRW_Angry
- Fcl_BRW_Fun
- Fcl_BRW_Joy
- Fcl_BRW_Sorrow
- Fcl_BRW_Surprised
- Fcl_EYE_Natural
- Fcl_EYE_Angry
- Fcl_EYE_Close
- Fcl_EYE_Close_R
- Fcl_EYE_Close_L
- Fcl_EYE_Fun
- Fcl_EYE_Joy
- Fcl_EYE_Joy_R
- Fcl_EYE_Joy_L
- Fcl_EYE_Sorrow
- Fcl_EYE_Surprised
- Fcl_EYE_Spread
- Fcl_EYE_Iris_Hide
- Fcl_EYE_Highlight_Hide
- Fcl_MTH_Close
- Fcl_MTH_Up
- Fcl_MTH_Down
- Fcl_MTH_Angry
- Fcl_MTH_Small
- Fcl_MTH_Large
- Fcl_MTH_Neutral
- Fcl_MTH_Fun
- Fcl_MTH_Joy
- Fcl_MTH_Sorrow
- Fcl_MTH_Surprised
- Fcl_MTH_SkinFung
- Fcl_MTH_SkinFung_R
- Fcl_MTH_SkinFung_L
- Fcl_MTH_A
- Fcl_MTH_I
- Fcl_MTH_U
- Fcl_MTH_E
- Fcl_MTH_O
- Fcl_HA_Hide
- Fcl_HA_Fung1
- Fcl_HA_Fung1_Low
- Fcl_HA_Fung1_Up
- Fcl_HA_Fung2
- Fcl_HA_Fung2_Low
- Fcl_HA_Fung2_Up
- Fcl_HA_Fung3
- Fcl_HA_Fung3_Up
- Fcl_HA_Fung3_Low
- Fcl_HA_Short
- Fcl_HA_Short_Up
- Fcl_HA_Short_Low
MMD models
- 真面目
- 困る
- にこり
- 怒り
- 上
- 下
- まばたき
- 笑い
- ウィンク
- ウィンク２
- ウィンク右
- ｳｨﾝｸ２右
- はぅ
- なごみ
- びっくり
- じと目
- なぬ！
- 瞳小
- 瞳縦
- 瞳縦潰れ
- びっくり
- への字
- 恐ろしい子！
- カメラ目
- はちゅ目
- 星目
- はぁと
- 涙
- 猫 目
- 瞳全消し
- あ
- い
- う
- お
- ▲
- ∧
- ω
- ω□
- はんっ！
- ぺろっ
- えー
- にやり
- ぎゃーす
- がーん
- ギギギ,
- あ２
- ああ
- いい
- おお
- 青ざめ
- д
- 八重歯左
- 八重歯右
- ワ
- 口角上げ
- 口角下げ
- 口横広げ
- 口横狭め
- 頬染め
- 照れ
- 赤面
ARKit-compatible (Perfect Sync) models
- eyeBlinkLeft
- eyeLookDownLeft
- eyeLookInLeft
- eyeLookOutLeft
- eyeLookUpLeft
- eyeSquintLeft
- eyeWideLeft
- eyeBlinkRight
- eyeLookDownRight
- eyeLookInRight
- eyeLookOutRight
- eyeLookUpRight
- eyeSquintRight
- eyeWideRight
- jawForward
- jawLeft
- jawRight
- jawOpen
- mouthClose
- mouthFunnel
- mouthPucker
- mouthLeft
- mouthRight
- mouthSmileLeft
- mouthSmileRight
- mouthFrownLeft
- mouthFrownRight
- mouthDimpleLeft
- mouthDimpleRight
- mouthStretchLeft
- mouthStretchRight
- mouthRollLower
- mouthRollUpper
- mouthShrugLower
- mouthShrugUpper
- mouthPressLeft
- mouthPressRight
- mouthLowerDownLeft
- mouthLowerDownRight
- mouthUpperUpLeft
- mouthUpperUpRight
- browDownLeft
- browDownRight
- browInnerUp
- browOuterUpLeft
- browOuterUpRight
- cheekPuff
- cheekSquintLeft
- cheekSquintRight
- noseSneerLeft
- noseSneerRight
- tongueOut
You may have heard others refer to blendshapes as "expressions." However, in Warudo (as well as other VTubing apps such as VSeeFace), an expression actually consists of multiple blendshape values. For example, the "crying" expression shown below is a specific combination of five blendshape values:
To avoid confusion, we will stick to referring blendshapes and expressions by their respective names.
What are "Perfect Sync" / ARKit blendshapes?
ARKit blendshapes refer to the 52 parameters that are supported by Apple's ARKit face tracking. You can view a list of these blendshapes here. These blendshapes cover a wide range of facial expressions: blinking, smiling, frowning, sneering, etc.
In late 2020, Japanese developer hinzka coined the term "Perfect Sync" for the process of automatically adding the 52 ARKit blendshapes to any VRoid model. This process is now widely used in the VTubing community, and "Perfect Sync" is often used interchangeably with "ARKit blendshapes."
We highly recommend adding ARKit blendshapes to your model, as it greatly improves the expressiveness of your model. If your model is created with VRoid Studio, you can use HANA_Tool to automatically add ARKit blendshapes to your model. Otherwise, you will need to manually add the blendshapes in modeling tools such as Blender or Maya.
If you are not familiar with 3D modeling, many modelers offer the service to add ARKit blendshapes to your model. Feel free to ask in our Discord to find a modeler!
What is a shader?
A shader determines how a model is rendered. For example, the following image shows the same model rendered with different shaders:
Source: https://bibinbaleo.hatenablog.com/entry/2018/09/14/183700
In most 3D VTubing apps, only the Standard and MToon shaders are supported. (MToon shader is the default shader that VRM models use.) However, Warudo supports any shader that is compatible with Unity's built-in (legacy) rendering pipeline, such as lilToon and Poiyomi Shader. For more information, please refer to the Modding section.
What is Inverse Kinematics (IK)?
IK stands for Inverse Kinematics. It can be understood as "making a part of the model rotate towards, or reach a desired position", without requiring an animation made by an animator. See below:
Source：https://medium.com/unity3danimation/overview-of-inverse-kinematics-9769a43ba956
In Warudo, you can adjust the character asset's Body IK and Look At IK options to make the character's limbs follow a target position or look at a target position.