OpenAI is engaged on a brand new instrument that will generate music based mostly on textual content and audio prompts, in response to a report in The Info.
Such a instrument might be used so as to add music to present movies, or so as to add guitar accompaniment to an present vocal observe, sources stated. It’s not clear when OpenAI plans to launch such a instrument or whether or not it will be obtainable as a standalone product (versus integrating with OpenAI’s ChatGPT and video app Sora).
One supply informed The Info that OpenAI is working with some college students from the Juilliard College to annotate scores as a approach to offer coaching knowledge.
Whereas OpenAI has launched generative music fashions prior to now, they predate the launch of ChatGPT; extra not too long ago, the corporate has been creating audio fashions centered on text-to-speech and speech-to-text. Different firms with generative music fashions embrace Google and Suno.
TechCrunch has reached out to OpenAI for remark.