Post-717
Barrett Burnworth
☝️ What's up?
Looking for music soundtrack generation also. MusicLM from google https://google-research.github.io/seanet/musiclm/examples/
So the idea is to create layers of audio. Have an underlying soundtrack, have the scene related sounds, and then possibly narration overlaid.
Example prompt from the above link:
The main soundtrack of an arcade game. It is fast-paced and upbeat, with a catchy electric guitar riff. The music is repetitive and easy to remember, but with unexpected sounds, like cymbal crashes or drum rolls.
This can be one shot to the scene generator as an example output.
Also, bookmarking this: https://vcai.mpi-inf.mpg.de/projects/DragGAN/ because it looks amazing!