Ninty is a virtual health coach prototype I built using Unreal Engine MetaHuman and audio-driven lip sync. In this demo, Ninty introduces itself to the user, explains its role, and walks through how it will help people on their journey toward health optimization by creating a personalized digital twin. The focus of this project is to explore how realistic digital characters and AI can make complex health concepts feel more approachable and human.
The core idea behind Ninty is the health digital twin: a virtual representation of a person that brings together genetic data, lifestyle and epigenetic choices (like nutrition, habits, and environment), and ongoing health metrics in one place. By linking this data to a friendly, face-to-face MetaHuman coach, the experience feels less like reading a dashboard and more like talking to someone who understands your health story and can guide you step by step.
On the technical side, this project showcases audio to lip sync integration with MetaHuman Realtime, where spoken audio is automatically synchronized with facial animation for more natural speech and expression. It serves as an early exploration of how AI-driven digital humans and health digital twins can come together to power next generation, personalized wellbeing experiences.
Ninty is my way of putting a friendly face on two big ideas in healthcare technology: digital twins and digital therapeutics (DTx). Instead of showing people only charts, graphs, and dashboards, Ninty lets them “meet” their data as a virtual health coach that talks, listens, and explains things in human language.
From a digital twin perspective, I imagine Ninty sitting on top of a rich virtual model of a person that continuously updates with their genetics, lifestyle choices, environment, and health metrics. In the future, this digital twin could help simulate risks, track changes over time, and suggest personalised strategies, while Ninty becomes the guide that translates all of that complexity into clear, actionable conversations.
In a DTx (Digital Therapeutics) context, I see Ninty as the conversational layer that delivers structured interventions in a way that feels less clinical and more human. Instead of just receiving generic app notifications, a person could check in with Ninty, get feedback based on their digital twin, and be coached through small, evidence-aligned steps that support behaviour change and long-term health goals.
The project in its current form is a small slice of that vision, focusing on natural speech, lip sync, and how a digital human can introduce the idea of a health digital twin. For my portfolio, Ninty represents the intersection of real-time 3D, AI, and healthcare where the ultimate goal is to make powerful digital health systems feel more personal, supportive, and genuinely human to interact with.
