University of Florida

university

Verified

https://www.ufl.edu/

AI & ML interests

This Organization is setup by UFIT Research Computing for the benefit of our users. We are not responsible for the data/models/projects/content associated with the organization and this is not an official UF site.

ufl's activity

nateraw

posted an update about 1 year ago

Post

4720

I just shared a blogpost on https://nateraw.com explaining the motivation + process of training nateraw/musicgen-songstarter-v0.2 - including training details, WandB logs, hparams, and notes on previous experiments.

Check it out here ⤵️
https://nateraw.com/posts/training_musicgen_songstarter.html

:) still kinda a WIP so if there's anything else you want to see, let me know.

3 replies

nateraw

posted an update about 1 year ago

Post

4515

Turns out if you do a cute little hack, you can make nateraw/musicgen-songstarter-v0.2 work on vocal inputs. 👀

Now, you can hum an idea for a song and get a music sample generated with AI 🔥🔥

Give it a try: ➡️ nateraw/singing-songstarter ⬅️

It'll take your voice and try to autotune it (because let's be real, you're no michael jackson), then pass it along to the model to condition on the melody. It works surprisingly well!

nateraw

authored a paper about 2 years ago

Generative Disco: Text-to-Video Generation for Music Visualization

Paper • 2304.08551 • Published Apr 17, 2023 • 7

AI & ML interests

Team members 295

ufl's activity