feat: live macOS dictation — push-to-talk mic into the realtime ASR session #1

Open
iulianp wants to merge 3 commits from feat/macos-live-dictation into main
pull from: feat/macos-live-dictation
3 Commits
Author SHA1 Message Date
Iulian ecd686073e wip: incremental ASR outputs in realtime, few bugs 2026-09-10 22:00:20 +03:00
Iulian 65855ace6c wip: incremental ASR 2026-09-09 20:31:03 +03:00
Iulian 0b44d7e1bf feat: live macOS dictation — push-to-talk mic into the realtime ASR session
- /dictate + ctrl+shift+d toggle one shared session: press to start, press again
  to stop, flush and paste into the prompt (a terminal gives no key-release event
  for hold-to-talk without the Kitty keyboard protocol)
- client.recordMic(): spawns ffmpeg AVFoundation capture and appends s16le frames
  as they arrive (no pacer — the mic is already 1x paced); stop() = commit + the
  same quiescence drain transcribe() uses, since is_last_result never flips true
- enumerates mics by slicing the "AVFoundation audio devices:" block off stderr
  (ffmpeg prints the table there, then fails opening the dummy input)
- --device takes an index or name, --lang / ASR_DICTATE_LANGUAGE, --submit sends
  instead of pasting; asr_health now reports the mic inputs it enumerated
- capture death surfaces via the emptyGraceMs path with the TCC hint (System
  Settings → Privacy & Security → Microphone) when ffmpeg exits non-zero at 0 bytes
- env.sh sources the gitignored .env so a shell gets ASR_NIM_URL / ASR_API_KEY
2026-09-09 19:06:06 +03:00