Live2D Virtual Human for Chatting based on Unity

Automatic 3D Character animation using Pose Estimation and Landmark Generation techniques

Web-first SDK that provides real-time ARKit-compatible 52 blend shapes from a camera feed, video or image at 60 FPS using ML models.

CLI tool for recording or replaying Epic Games' live link face capture frames.

Automatic Facial Retargeting

Implementation of Example-Based Facial Rigging by Li, et al. A method for generating a facial blendshape rig from a set of example poses.

A Vtuber web app powered by the latest and great in motion capture tech from MediaPipe.

Use ARkit application to drive face-blendshapes in TouchDesigner.

A blendShape delta transfer tool that preserves local vertex rotations, ensuring more natural deformation propagation compared to traditional world-space methods.

Trybe Rig is a fast and easy 1-click rigging solution for Blender. This add-on allows you to quickly rig characters, add them as blendshapes, and rig cloth objects for realistic simulations. Save time and effort with Trybe Rig's intuitive rigging tools.

A prototype app that controls an iPhone X with face gestures, using Apple's ARKit

Mapping Mediapipe's 52 blendshapes to FLAME's expression coefficients and poses.

Reworks the default Arkit blendshapes and adds them to the CC4 standard profile. Supports ARKIT blendshapes

ARKit-FaceOSC

This is the source code of our 3DRW 2019 paper

NVIDIA Audio2Face Blendshape Implementation with PyTorch. Uses LSTM and CNN (simplified NvidiaNet) models

A machine learning model mapping action unit from OpenFace to Blendshapes from Arkit LiveFace

"Calm —indeed the calmest— reflection might be better than the most confused decisions.", Franz Kafka, The Metamorphosis

Configure IFacialMocap Blend Shapes for your VRM avatar