Kokoro WebGPU: Real-time text-to-speech 100% locally in the browser (opens in new tab)

It took some time, but we finally got Kokoro TTS (v1.0) running in-browser w/ WebGPU acceleration! This enables real-time text-to-speech without the need for a server. Looking forward to your feedback!

Brave browser and Samsung Galaxy S22 ultra - gives horrible screeching noises

Crashes the iPad Safari tab

Sounds horribly in chrome with an amd gpu, why is that?

Isn’t this already built into browsers?

https://developer.mozilla.org/en-US/docs/Web/API/Web_Speech_...

Brilliant job! Love how fast it is, I'm sure if the rapid pace of speech ML continues we'll have Speech to Speech models directly running in our browser!

Sounds terrible on Chrome with an AMD 5700XT.

Sounds great on Chrome with an Nvidia 1650Ti.

Sounds great on Chrome on a Pixel 6.

Sound like being bitcrushed. Maybe a 64 vs 32 bit error? Solid results when working.

Kokoro gives pretty good voices and is quite light...making it useful despite its lack of voice cloning capability. However, I haven't figured out how to run it in the context of a tts server without homebrewing the server...which maybe is easy? IDK.

Fyi I tried this on my Galaxy S21 with both Brave and Chrome browsers and just got screeching noises in the audio

Any luck with getting this running on iOS 18.2.1 running Safari? I have tfe WebGPU feature flag turned on (Settings -> Safari -> Advanced) and I’ve tried a few other WebGPU demos successfully

How do I download this and run it actually offline?

Incredible work! I have listened to several tts and to have this be free and in complete control of the customer is absolutely incredible. This will unlock new use cases

I made https://app.readaloudto.me/ as a hobby thing and now it could be enhanced with a local tts option!

This is great but far from real-time.

(I get the joke that for some definition of real-time this is real-time).

The reason why I use an API is because time to first byte is the most important metric in the apps I'm working on.

That aside, kudos for the great work and I'm sure one day the latency on this will be super low as well.

Fantastic work. My dream would be to use this for a browser audiobook generator for epubs. I made a cli audiobook generator with Piper [0] that got some traction and I wanted to port it to the browser, but there were too many issues. [1]

Is there source anywhere? Seems the assets/ folder is bundled js. In my opinion, there's a ton of opportunity for private, progressive web apps with this while WebGPU is still relatively newly implemented.

Would love to collaborate in some way if others are also interested in this

[0] https://github.com/C-Loftus/QuickPiperAudiobook/ [1] https://github.com/rhasspy/piper/issues/352

Amazing ! This is my first time witnessing a model of such prowess run in browser. Curious about quantization and webml

holy cow, how did they get the OpenAI voices like Alloy and Echo, generated in-browser and sounding 99% the same?

this is astounding

Generating audio takes a bit, but wow, 92MB model for really decent sounding speech. Is there a way to plug this thing into speech dispatcher on Linux and use for accessibility?

Does anybody know if the results can be saved to file, or the results somehow retrieved?

Sounded perfect for me. Brave/Win11/3090

Crashes on iPhone safari