Follow-up on the mentioned live-transcription tools.
HushScribe ended up eating ~4GB RAM, probably keeping Whisper loaded in memory. Gophy had enough compile/runtime issues that I never got it working cleanly (even with Codex doing the heavy lifting).
Maybe I should build this thing after all. Or try other tools.