Asset Version：1.1 - 2.0 Engine version: 4.26 - 4.27,5.0 - 5.4

Introduction to Local Voice Processing

Offline Speech Recognition offers a powerful solution for developers seeking to integrate voice commands into their games. This tool allows you to recognize speech from more than 15 languages. Moreover, it functions entirely without relying on any cloud service or subscription. This ensures that your project remains functional regardless of internet connectivity.

How the Language Server Operates

The system utilizes a language server that runs as a separate process on your machine. This server communicates directly with your game to process audio data. However, using the language server as a separate application is entirely optional. Your game itself can act as the language server if you prefer an integrated approach.

The language server application is public and highly flexible. Consequently, the developer allows you to fork and customize the server to fit your specific needs. You can distribute it with your game and run it without any user interface. This makes the background process invisible to the end user.

Simple Integration with Unreal Engine

The Unreal Engine client provides a dead simple communication method with the language server. Specifically, the client connects to the server and records the player’s audio. Therefore, it feeds your voice data to the server in real-time. The server then sends the recognized voices back to Unreal Engine as text strings.

This workflow enables streaming voice recognition for dynamic gameplay. You can implement simple conversations with your NPCs without any user input except voice. For example, a player could say, “Ok robot, do this,” or “Ok robot, do that.” This creates a more immersive experience for the player.

Key Features and Benefits

Supports more than 15 different languages.
Operates without cloud dependencies or monthly subscriptions.
Includes a customizable and public language server app.
Provides streaming voice recognition for real-time interactions.
Compatible with Unreal Engine 5.3 through provided example projects.

Conclusion

Overall, this tool simplifies the process of adding voice-driven mechanics to your game. By using a local language server, you maintain control over your data and performance. Whether you are building complex NPC dialogues or simple voice commands, this system provides a reliable offline framework for modern game development.