The archive · AI & Models · Product decision · 2022–2024
Riffusion turns Stable Diffusion into a music generator; HN 2,421 points, $4M seed
Two hobbyists fine-tune Stable Diffusion to draw spectrograms that sound like music; the demo tops Hacker News and becomes a $4M-funded startup.
Riffusion
What the business is
Riffusion generates music by running Stable Diffusion on spectrogram images — the model is fine-tuned to draw spectrograms that, when played back, sound like coherent music, served as a free web app.
Starting capital：$4M seed led by Greycroft with South Park Commons and Sky9, announced 2023-10-17 (TechCrunch).
How it started
Seth Forsgren and Hayk Martiros, friends from Princeton, fine-tuned Stable Diffusion on pairs of audio spectrograms during a weekend hack in late 2022. They posted the result to Hacker News on 2022-12-15; it hit the front page with 2,421 points and 465 comments.
What happened
The viral wave crashed the demo's single GPU, so Riffusion moved inference to Baseten, which absorbed 4M+ requests in two days. In October 2023 Riffusion announced a $4M seed led by Greycroft and launched a fuller product with lyrics and voice; TechCrunch reported a team of about six.
How it ended up
Still live as of September 2026: riffusion.com keeps generating music with the product expanded beyond spectrogram-only output; no further funding or revenue figures have been published.
Background
Riffusion is an AI music generator that treats sound as an image. Two Princeton friends, Seth Forsgren and Hayk Martiros, fine-tuned Stable Diffusion on spectrograms — pictures of audio — so the model could draw new spectrograms that, when played back, sound like coherent music. Users type a prompt and get a track, all in the browser.
The bet was that music could be generated as images: instead of training a music model from scratch, the pair adapted an image model to a different modality and shipped it as a free web app. They posted the demo to Hacker News on 2022-12-15, where it drew 2,421 points and 465 comments — the twelfth-most-upvoted post of the year, per its inference partner Baseten.
The viral wave was measurable: Baseten served 4M+ Riffusion requests in two days, peaking at ~34 requests/second across 50 A10G replicas at roughly $1,000/day in GPU cost, and TechCrunch covered the app the same week. On 2023-10-17 TechCrunch reported a $4M seed round led by Greycroft with South Park Commons and Sky9, plus a fuller product with lyrics and voice and a team of about six.
Riffusion's journey shows the fastest AI startup path of 2022: an open-weights model, a weekend hack, a front-page community reaction, and a funded company before any monetization. As of September 2026 the product remains live on riffusion.com.
What has to be true
- The bet is explicit and falsifiable: music generation reframed as spectrogram drawing, so an image model fine-tune stands in for a music-model build.
- Traction is concrete and dated: 2,421 HN points on 2022-12-15, 4M+ requests in two days, ~$1,000/day GPU cost — all from sources read directly.
- It is the cleanest early example of community-as-distribution: no marketing budget, one HN post, then venture capital.
- It documents how a two-person hobby project can become a product with a name-brand investor syndicate.
What can be applied
A hobby demo becomes a company when the demo is the distribution: Hacker News proved demand at a scale no deck could, and the crowd's reaction justified a real round.
Aftermath
As of September 2026 Riffusion is still operating, with the product expanded beyond the original spectrogram demo into a consumer app that adds lyrics and voice, after a $4M seed led by Greycroft in October 2023. The company has not published revenue or a further round; its significance is the pattern it set — a viral model hack converting open-weights releases into a funded startup in days, a template many 2023-2025 AI music startups followed.
Sources
- Try Riffusion, an AI model that composes music by visualizing it
- AI-generating music app Riffusion turns viral success into $4M in funding
- Serving four million Riffusion requests in two days
spotted an error? The archive wants to know.
Your turn
You just read one. Describe what you are building, and see who is betting on the same thing.
Free account · 3 free questions · no card