>"Nice, but somehow it feels like I've heard these songs before. Could that be possible?"
According to the paper[0] "We found that only a tiny fraction of examples was memorized exactly, while for 1% of the examples we could identify an approximate match." FWIW I'm pretty sure I heard a fragment of Kalinka (a folk tune in the public domain) in one of the samples I generated.