Current Article:

Runtime MetaHuman Lip Sync (AI for NPCs) (+ CC4, Genesis, ARKit, and more)

Runtime MetaHuman Lip Sync (AI for NPCs) (+ CC4, Genesis, ARKit, and more)<div class="post-tags single-post-tags"><span class="custom-tag">Engine Version: 5.5 - 5.6</span><span class="asset-version-tag">Asset Version: 1.0</span></div>
Categories Animations

Runtime MetaHuman Lip Sync (AI for NPCs) (+ CC4, Genesis, ARKit, and more)

front page Runtime MetaHuman Lip Sync (AI for NPCs) (+ CC4, Genesis, ARKit, and more)

Overview

Transform your digital characters with seamless, real-time lip synchronization that works completely offline and cross-platform! This plugin brings your MetaHuman and custom characters to life with zero-latency, real-time lip sync.

Three Advanced Models for Every Project Need

With three quality models to suit your project requirements, you can bring emotion-aware facial animation to your MetaHuman characters. Choose from:

  • Mood-Enabled Realistic Model – Emotion-aware facial animation with 12 different moods and smart lookahead timing.
  • Realistic Model – Enhanced visual fidelity with more natural mouth movements and 81 facial controls.
  • Standard Model – Broad compatibility with MetaHumans and custom characters, supporting 14 visemes.

Key Features

Real-time Lip Sync from microphone input and any other audio sources, Emotional Expression Control, Dynamic laughter animations, Pixel Streaming microphone support, Offline Processing, Cross-platform Compatibility, Optimized for real-time performance, Works with both MetaHuman and custom characters, Multiple Audio Sources, Works great with Runtime Audio Importer, Runtime Text To Speech, and Runtime AI Chatbot Integrator.

Included Formats

This plugin is compatible with various formats including Unreal Engine, MetaHuman, and custom character models.

Technical Details

The plugin provides real-time lip synchronization by processing audio input to generate visemes. It relies on the onnxruntime library as the cross-platform native machine learning accelerator for lip sync inference.


Click here to view the full details of the resource.:URL

Related Articles:

Audio Sync Pro

Narrative Tales – Node Based Quests and Dialogue



Click the button below to download. 

Download:

Login Required

Please register or log in to your account.

Log in / Register

Prev Runtime Archiver (Zip, Oodle, Tar, LZ4, GZip)<div class="post-tags archive-post-tags"><span class="custom-tag">Engine Version: 4.26 - 4.27,5.0 - 5.5</span><span class="asset-version-tag">Asset Version: 1.0</span></div>
Next Scared – MoCap Animation Pack<div class="post-tags archive-post-tags"><span class="custom-tag">Engine Version: 4.27,5.0+</span></div>

Leave a Reply

Login