Quick Summary
Nvidia has announced a number of plugins for developers to use its Nvidia Ace digital human technologies in Unreal Engine 5.
This opens up the possibility of photo-realistic human characters in games that can speak to you conversationally, much like a digital assistant.
During Computex in June, Nvidia unveiled its suite of digital humans technologies, which it calls Nvidia Ace. The accompanying video was jaw-dropping, showing how AI and intelligent graphics techniques can create photo-realistic avatars for use across multiple sectors.
The main application noted at the time was for putting a human face to a digital assistant – imagine if you could see Alexa or Gemini while you speak to them. AI would not only power the look of the assistant, but enable it to respond like a real person, with accurate lip sync and movements.
Certainly, Meta seems to be interested, having debuted its own deepfaked human avatar for Meta AI during Meta Connect. It could be a matter of months not years before we see the first fully interactive digital humans launched for everyday use.
Now Nvidia has its sights on gaming – the usual bedrock of the company. It announced during this week's Unreal Fest that it is launching development tools for studios to use Nvidia Ace with Unreal Engine 5.
This is significant as, although we're yet to see more than a handful of Unreal Engine 5 games hit market, they are on their way. And considering the development software allows for photo-realistic backdrops and scenery, why not include human-like characters too?
As 91Mobiles points out, there are a select handful of plugins Nvidia has created to help developers include more realistic avatars, including Audio2Face-3D, which uses AI to make lip sync and facial animations smoother and more accurate.
Perhaps more exciting still, the intriguingly named Nemotron-Mini 4B Instruct plugin will help developers create generative AI-powered dialogue interactions with players. For example, you could talk to NPCs in a game in real-time using normal language and they will respond naturally, no matter what you say.
Sign up to the T3 newsletter for smarter living straight to your inbox
Get all the latest news, reviews, deals and buying guides on gorgeous tech, home and active products from the T3 experts
It's all interesting stuff and, save for Nvidia seeming like the real-world equivalent of Skynet from Terminator, this has the potential to change the world – even beyond the next-generation of PC and console gaming.
Rik is T3’s news editor, which means he looks after the news team and the up-to-the-minute coverage of all the hottest gadgets and products you’ll definitely want to read about. And, with more than 35 years of experience in tech and entertainment journalism, including editing and writing for numerous websites, magazines, and newspapers, he’s always got an eye on the next big thing.
Rik also has extensive knowledge of AV, TV streaming and smart home kit, plus just about everything to do with games since the late 80s. Prior to T3, he spent 13 years at Pocket-lint heading up its news team, and was a TV producer and presenter on such shows as Channel 4's GamesMaster, plus Sky's Games World, Game Over, and Virtual World of Sport.
-
When is Black Friday 2024 – this Friday or next? Here's the official answer
Black Friday is on 29 November in 2024 – a week later than the year previous. But that's not stopped retailers putting on their sales...
By Mike Lowe Published
-
Forget Black Friday, F1 24 is completely free for a limited time
This top racing game has a free weekend
By Max Freeman-Mills Published
-
Nvidia GeForce Now getting a game-changing update that won't please everyone
Affects Performance and Ultimate members of the cloud gaming service
By Rik Henderson Published
-
Nvidia Shield TV gets a surprise free upgrade with a bunch of improvements
Nvidia's Android TV streamer is still one of the best around
By Rik Henderson Published
-
Xbox and Nvidia could turn your console into a high-end PC gaming rig capable of playing 1,000s more games
Your Xbox Series X or Series S could be transformed
By Rik Henderson Published
-
Nvidia GeForce Now gets a free upgrade that makes a big difference to gameplay
Latency and frame rates get a huge boost
By Rik Henderson Published
-
Nvidia GeForce Now to get free upgrade that will leave many undecided
Not all updates are appreciated
By Rik Henderson Published
-
Nvidia GeForce Now free upgrade should settle the argument about cloud gaming forever
New technologies coming to reduce latency even further for super smooth gaming
By Rik Henderson Published
-
How to watch Nvidia's CES 2024 press conference and everything you need to know
Nvidia promises some consumer electronics announcements during its CES 2024 press event
By Rik Henderson Published
-
Nvidia GeForce RTX 4080 suddenly looks like an even more appealing GPU
Pre-launch benchmarks demonstrate that this new RTX is seriously speedy
By Carrie Marshall Published