To build Fugatto, Nvidia says researchers had to put together a dataset with millions of audio samples. They then created instructions “that considerably expanded the range of t

Nvidia's new model was trained on open-source data, and the company said it is still debating whether and how to release it publicly.

"We wanted to create a model that understands and generates sound like humans do," said Rafael Valle, one of the researchers behind the project and a manager of applied audio research at NVIDIA. The company listed some possible real-world scenarios wherein Fugatto could be of use in its announcement.

Fugatto can make music from text prompts, change song instruments, change vocal accents or moods, and create new sounds

Nvidia (NASDAQ:NVDA) unveiled a new AI model called Fugatto for generating music and audio, aimed at people producing music, films and video games. Fugatto (Foundational Generative Audio Transformer Opus) generates or transforms any mix of music,

Nvidia unveiled a new AI model on Monday called Fugatto that can create sounds, music, and clone and modify voices, based on the user's audio and text prompts.

Nvidia has unveiled Fugatto, a cutting-edge AI tool designed to create and modify audio. Announced on Monday, this model is targeted at music producers, filmmakers, and video game developers. Fugatto can generate sound effects and music from text prompts while transforming existing audio in highly innovative ways.