Hacker Newsnew | past | comments | ask | show | jobs | submit | quickthoughts's commentslogin

I've also been focusing on ultra efficient local ASR models (for real time transcription) that can run comfortably on a web browser on low end phones/devices. it's actually crazy how capable it is already (https://starbright.quickthoughts.ca/) WER is like ~5 and it works on old phones that I've tested.

I've been interested in ASR models specifically for transcribing low-bandwidth low-quality radio recordings, are there any specifically focused on this angle in particular around?

looks nice! what languages does it support?

rn just english but I have a welsh (cy) asr model cooking as well, though its still unusable (~25 WER). these tiny models are actually really cool example of distilling but also really really focusing on the engine in a way that takes advantage of crazy compression, decoding etc strategies

Agreed theres a lot between "editing raw weights" via LLM and a bunch of code/programming. But in my case, the technique itself was new to me, and worked for a small ASR model I've been training based on moonshine + claude being able to actually reason about what was causing loops. This is something I sure couldn't/wouldn't do manually.

https://quickthoughts.ca/projects/welsh-asr/ (scroll down to the project updates to read how much impact it had)


Ha just wrote a post[1] about a sort of 4th option - max out cheap compute to create more tangible things that can be used/run locally.

1: https://news.ycombinator.com/item?id=48519181


what does this actually do? claude output -> drop -> app that you can't really change?


Seems like it. Perhaps the use case is for non-engineering folks to share AI generated prototypes?

We're starting to get asked by product managers how they can share/deploy their prototypes they made with Claude/Cursor.


Are most corporations preformative? (yes)


I use small models like Gemma to improve transcriptions from ASR models amongst other micro-tasks. I actually built out a fine-tuning whisper pipeline with all local (smaller) models meaning no cloud/big-tech co is able to train/sell my (private) data.

Repo is https://github.com/Rebreda/listenr - mainly geared toward Whisper fine-tuning, AMD hardware and local inference


I don't think this will be the case, image and video processing typically is more computation hungry, especially in realtime contexts. Apple already pegged Google as their cloud-provider of choice when it comes to LLMs/AI compute.

https://www.business-standard.com/technology/tech-news/apple...


It's everyone. Especially google, but all the big tech companies play in the same pool. Amazon, Google, Apple, Meta etc make money selling ads, which ultimate enables the tools that result data harvesting from everyone across the internet. I wrote a little data investigation [1] (mostly finished) that show cases how every major news organization across the globe I scanned had some level of data collection integrated. This is just one industry, but its important (as it connects back to the incentives these media organizations have, which is to make money by selling ads at any cost). The eff also released an angle in how the bidding process to buy ads is itself a massive privacy nightmare[2]

[1] https://quickthoughts.ca/autotracko/ [2] https://www.eff.org/deeplinks/2026/03/targeted-advertising-g...


I've been working on the flip side of this with ASR models, but the problem space is the same, conversational/real-world data is needed. Whisper often mistook actual words I say and hallucinate all the time when speaking technical jargon. The solution is to fine-tuning whisper with my own data. Hardest part imo was getting the actual data, which in turn got me to build listenr (https://github.com/rebreda/listenr).It's an always-on VAD-based audio dataset builder. Could be used for building conversational/real-world voice datasets for TTS models too?

After getting it working i was get motivation to actually able to build out the full fine-tuning pipeline. I wrote a little post about it all https://quickthoughts.ca/posts/listenr-asr-training-data-pro...


Plus one for the IKEA pour over. Its cheap and functional, perfect for travel too.


Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: