Skip to content

Commit

Permalink
📝 update songstarter post
Browse files Browse the repository at this point in the history
  • Loading branch information
nateraw committed May 2, 2024
1 parent 0c058b3 commit 874fd21
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion posts/training_musicgen_songstarter.ipynb
Original file line number Diff line number Diff line change
Expand Up @@ -78,7 +78,7 @@
"\n",
"#### Initial experiments with fine-tuning on artists\n",
"\n",
"After some exploration, I figured out how to get training running using their codebase, and prepared a dataset of samples from a few artists and started training for the text-to-music task, starting from the [musicgen-small](https://huggingface.co/facebook/musicgen-small) checkpoint as that was the largest model I could fit on a Google Colab A100 40gb GPU. For the dataset, since I didn't have text captions for the music, I set the captions to be the same every time: \"an electronic instrumental in the style of <artist>\".\n",
"After some exploration, I figured out how to get training running using their codebase, and prepared a dataset of samples from a few artists and started training for the text-to-music task, starting from the [musicgen-small](https://huggingface.co/facebook/musicgen-small) checkpoint as that was the largest model I could fit on a Google Colab A100 40gb GPU. For the dataset, since I didn't have text captions for the music, I set the captions to be the same every time: \"an electronic instrumental in the style of \\<artist\\>\".\n",
"\n",
"The results were...okay. I had to generate a lot of samples to get some good ones out...most were riddled with artifacts/noise/strange sounds/silence. I also was plagued by a sneaking suspicion that the model was overfitting and just regenerating existing tracks. Here are some clips from the first model I trained, where I used a dataset of songs by [Monte Booker](https://soundcloud.com/montebooker):\n",
"\n",
Expand Down

0 comments on commit 874fd21

Please sign in to comment.