That said, wow. An end to end FAST architecture that can infer a 4.5 minute song in 10 seconds is a compelling thing. I didn’t see if we got open weights, but my guess is that this is not crazy challenging to train, and some v2/v3 versions of this are likely to be good-to-very-good.
I suppose it might be because it's latent diffusion.
As an amateur musician, I'd like tools that help me be more productive musically - those that complement my skills (whatever they may be). All the things you mentioned above, namely, ability to score a melody via a simple hum, transfer to various instruments, generate proper responses to calls, generate melodies within a framework, etc., all these would be super valuable to me.
I'm an OK guitar + bass + keyboard player, I'd LOVE to have an AI assistant that accompanies along. That would make my own jammin' so much richer.
I dont think we have seen the end of AI-driven tools in music-tech yet. I'm cautiously hopeful.
That said, there is a difference to images in that music also has a "symbolic" level to it that is closer to text than images [1]. There's other work out there that uses LLM-type tools for direct melody generation (no audio). And of course, there's lyrics. I do expect commercial tools to start integrating all these capabilities gradually, it's just a matter of time.
[1] I guess there's also vector images (like SVG) - I've seen work in generating those as well, though it's less mature than directly generating pixels.
Story Jam lets you design chord progressions without needing to know about music theory, instead offering intuitive terms like "lightness", "darkness", "drifting" and "roaming". They mean about what you think they mean.
I'm planning a "Show HN" post for tomorrow morning EST with more details. But you can get the sneak peek here :)
“Pop punk with prog rock time signatures“ is a funny idea, but it’s not interesting to listen to when there’s obviously zero intention behind it.
Lots of sour grapes comments from folks. Too bad. Not what I expect out of Hacker News. Glad people are pushing the technological envelope and exploring this space despite the strong negative emotions.
absolutely crazy
Ty it don’t think peasants were listening t to Bach, do you? Only the extraordinarily wealthy could afford to have music as anything like an every day thing.
We've done these things ourselves for hundreds of thousands of years. As we are increasingly convinced to buy them for convenience we loose the very things that make us know our connectedness.
So ya, there are real problems caused by the convenience of technology
Granted, many people are benefiting from these tools (myself included) but at some point a lot of us are going to have to find a new job (assuming the progression continues unabated), and I'm not sure what new jobs are going to exist when LLM coders replace many or most of us.
If you don't enjoy composing music, just don't do it, and give it to someone who does, and has the experience/knowledge/culture/practice/gut to do it.
Well it has the benefit of being true.
Tell me one example how music gen in any way benefits anybody to the level that is worth putting out of business the last few artists that make ends meet?
We've created machines to replace humans doing things humans enjoy doing. Leaving the drudgery machines were supposed to eliminate to be done by humans.
There's at least an order of magnitude more people who enjoy making music than there are people with the actual skill/talent to make music. Music generation AI is an absolute blessing to the untalented among us who'd love to make a song in a certain style or with certain lyrics but lack the time, talent or ability to do it ourselves.
But don't mistake one thing for the other: how is it different than, say, being Emperor Joseph II asking Mozart in Vienna to write an opera for him?
Mozart wrote the music, not Joseph.
Similarly, you can hike across France, from South to Britain for several days. Or you can take the train. Or a car, alone, or with a driver. Or a plane, in the pilot or the passenger seat.
You'll get in the same place in the end. The experience will be totally, fundamentally different for you, as well as for others.
I'm a musician myself, but I sadly suspect that most music made today "benefits humanity" very little... Is music making always a net positive? If nothing else, these tools will allow more music will be made.
Yes because the act of making music, even not very good music, is what has value. Music generated without human input has no discernible value.
> If nothing else, these tools will allow more music will be made.
By machines that, as far as we can tell, take no enjoyment from making it. And eliminates any possibility of emotional connection between the artist and the listener. Which is the entire source of music's value.
I wonder what the hyper-capitalist's end game looks like. One giant company that covers everything with one man sitting at a dashboard, tweaking parameters? Is that one man even necessary?
I wonder what our plans are for when "the economy" prefers to do it's thing without us. Writing poems all day? What capitalist instrument will provide "money" for us to spend in this giant machine?
So they just hate humanity in general then.
If you think I’m being harsh, I have my reasons as a professional musician to critique these things in an unflattering light because they are my competition. Thankfully actually “generated” AI music is trash. Copyright is problematic in the US, I admit, but tech bros using copyrighted material to train programs to put us out of business - without paying a penny which even Spotify doesn’t per stream - yeah, I’ll have some disdain about this scenario and I feel it’s justified.
Just because you can doesn’t mean you should.