Nvidia's new model was trained on open-source data, and the company said it is still debating whether and how to release it publicly.

To build Fugatto, Nvidia says researchers had to put together a dataset with millions of audio samples. They then created instructions “that considerably expanded the range of t

"We wanted to create a model that understands and generates sound like humans do," said Rafael Valle, one of the researchers behind the project and a manager of applied audio research at NVIDIA. The company listed some possible real-world scenarios wherein Fugatto could be of use in its announcement.

Nvidia on Monday introduced Fugatto, a groundbreaking AI model that transforms voices and generates new sounds from text descriptions. Aimed at revolutionizing audio creation in music, film, and gaming,