chanora

30 Commits 17 Branches 3 Tags

2 Commits

Include renames

Author	SHA1	Message	Date
EdisonJwa	fd181c014c	feat(audio): A.5 — surface mobile voice-preset + effects toggles in AudioEngineConfig The Beta scope for mobile DSP is OS-source-driven (Android `MediaRecorder.AudioSource.VOICE_COMMUNICATION`, iOS `AVAudioSession.Mode.voiceChat`) — letting the platform's built-in AEC / NS engage instead of shipping our own DSP chain on constrained devices. Linux desktop stays a deliberate no-op: PipeWire / ALSA's default source is correct for desktop voice and adding a software AEC there would regress against an already-good baseline. This commit lands the config surface through every layer: * `AudioEngineConfig` gains `effects: AudioEffects` (mirrors the DEC-007/008/009/010 toggles) and `mobile_voice_preset: bool` (default `true`). * On Android, `AudioEngine::start` logs the preset + effects requests so a future cpal / Oboe upstream switch can be observed via the redacted diagnostic export. * On iOS, the same log line documents the binding gap — Chanora iOS audio is documented-only for Beta per the release notes. * On Linux desktop, the flags are honoured by name but the engine continues to use the default ALSA / PipeWire source. No behaviour change. RISK-AUDIO-MOBILE-001 (new) tracks the actual preset switch. The follow-up work either pulls in an Oboe-based input host or waits for cpal upstream to expose `set_input_preset`. Either way the config flag is forward-compatible — callers do not need to change when the binding lands.	2026-05-15 01:28:23 +08:00
EdisonJwa	9790005c3e	feat(beta): wire voice in/out end-to-end with push-to-talk (v0.2.0-beta.1) Reaches the Internal Beta milestone of DEC-001's release sequence the same day as Alpha. Adds voice capture and playback through the full Flutter UI → FRB → Rust core → tsclientlib → server path. Promotions from PoC: poc/audio-capture-playback-spike → crates/chanora_audio/ New product code: crates/chanora_audio/src/engine.rs — cpal capture and playback, audiopus Opus VoIP encoder (48 kHz mono 20 ms frames), tsclientlib AudioHandler for decode + jitter buffer + mix on playback, push-to-talk gate, graceful playback-only fallback when capture is unavailable. crates/chanora_protocol/src/adapter.rs — extended with voice_out_tx (clonable mpsc::Sender<OutPacket>) and take_voice_in() (one-shot mpsc::Receiver<InboundVoice>); main loop now interleaves outbound voice drain, event pumping, and control-request handling. crates/chanora_protocol/src/lib.rs — re-exports the few tsproto_packets types (OutAudio, OutPacket, InAudioBuf, AudioData, CodecType, Direction) that chanora_audio legitimately needs. Documented as the single deliberate cross-crate type re-export per SAD-067, justified by the performance cost of a parallel type hierarchy on the 20 ms voice frame. core/chanora_core/src/lib.rs — ChanoraSession::start_audio, set_ptt, audio_stats; disconnect now stops the engine first. crates/chanora_bridge/src/api.rs — startAudio, setPtt, audioStats commands and BridgeAudioStats DTO. apps/chanora_flutter/lib/main.dart — "Start audio" button + hold-to-talk PTT button with pressed/released visual state + live stats line (TX/RX/PTT). Stats polled every 500 ms. ARB: Both en and zh-Hans gain startAudioAction, pttHoldToTalk, pttTransmitting, audioStatsLine. Banner updated to "Beta build — voice in/out wired; not production ready." FRB config: flutter_rust_bridge.yaml gains local: true so codegen resolves the workspace member's library stem to "chanora_bridge" instead of falling back to "UNKNOWN". Empirical verification (2026-05-14, against cn.teamspeak.app): cargo check + cargo test --workspace: all green. flutter analyze: 0 issues. flutter test: 4/4 passing including: - test/alpha_e2e_test.dart (regression: Alpha still works) - test/beta_e2e_test.dart (Beta: connect → startAudio → PTT cycle → disconnect against cn.teamspeak.app). Live smoke (cargo test alpha_smoke -- --ignored): 49 channels, 37 clients retrieved. Capture stream open against the host PipeWire auto_null source refused (snd_pcm_hw_params); engine correctly logged the warning and continued in playback-only mode. TX=0 frames, RX=0 frames reflects the headless null-source environment; on a real mic host the encoder produces ~50 frames/second while PTT is held. Honest Beta scope (NOT in this release): - AEC / AGC / NS / HPF DSP (DEC-007..010): AudioEffects exists as a struct but the filters are no-ops. Beta+ work. - Production-quality resampler: current code is linear interpolation. Beta+ work. - Identity persistence via chanora_storage: still ephemeral. - Push-to-Dart event stream: UI polls instead. - chanora_diagnostics tracing-layer wiring: still scaffold. - Mobile (Android) cdylib + UI: PoC-proven, not yet in product. - Reconnect / network-loss recovery for the voice path. Docs updates: - docs/governance/product-decision-register.md bumped to v0.9.7 (Beta-milestone change-history entry; no row changes). - docs/governance/poc-results-summary.md bumped to v0.6.0 (RISK-PoC-005 updated with Beta progress).	2026-05-14 22:43:57 +08:00

Author

SHA1

Message

Date

EdisonJwa

fd181c014c

feat(audio): A.5 — surface mobile voice-preset + effects toggles in AudioEngineConfig

The Beta scope for mobile DSP is OS-source-driven (Android
`MediaRecorder.AudioSource.VOICE_COMMUNICATION`, iOS
`AVAudioSession.Mode.voiceChat`) — letting the platform's built-in
AEC / NS engage instead of shipping our own DSP chain on
constrained devices. Linux desktop stays a deliberate no-op:
PipeWire / ALSA's default source is correct for desktop voice and
adding a software AEC there would regress against an already-good
baseline.

This commit lands the *config surface* through every layer:

* `AudioEngineConfig` gains `effects: AudioEffects` (mirrors the
  DEC-007/008/009/010 toggles) and `mobile_voice_preset: bool`
  (default `true`).
* On Android, `AudioEngine::start` logs the preset + effects
  requests so a future cpal / Oboe upstream switch can be observed
  via the redacted diagnostic export.
* On iOS, the same log line documents the binding gap — Chanora
  iOS audio is documented-only for Beta per the release notes.
* On Linux desktop, the flags are honoured by name but the engine
  continues to use the default ALSA / PipeWire source. No
  behaviour change.

RISK-AUDIO-MOBILE-001 (new) tracks the actual preset switch. The
follow-up work either pulls in an Oboe-based input host or waits
for cpal upstream to expose `set_input_preset`. Either way the
config flag is forward-compatible — callers do not need to change
when the binding lands.

2026-05-15 01:28:23 +08:00

EdisonJwa

9790005c3e

feat(beta): wire voice in/out end-to-end with push-to-talk (v0.2.0-beta.1)

Reaches the Internal Beta milestone of DEC-001's release sequence the
same day as Alpha. Adds voice capture and playback through the full
Flutter UI → FRB → Rust core → tsclientlib → server path.

Promotions from PoC:
  poc/audio-capture-playback-spike  →  crates/chanora_audio/

New product code:
  crates/chanora_audio/src/engine.rs — cpal capture and playback,
    audiopus Opus VoIP encoder (48 kHz mono 20 ms frames), tsclientlib
    AudioHandler for decode + jitter buffer + mix on playback,
    push-to-talk gate, graceful playback-only fallback when capture
    is unavailable.
  crates/chanora_protocol/src/adapter.rs — extended with
    voice_out_tx (clonable mpsc::Sender<OutPacket>) and
    take_voice_in() (one-shot mpsc::Receiver<InboundVoice>); main
    loop now interleaves outbound voice drain, event pumping, and
    control-request handling.
  crates/chanora_protocol/src/lib.rs — re-exports the few
    tsproto_packets types (OutAudio, OutPacket, InAudioBuf,
    AudioData, CodecType, Direction) that chanora_audio
    legitimately needs. Documented as the single deliberate
    cross-crate type re-export per SAD-067, justified by the
    performance cost of a parallel type hierarchy on the 20 ms
    voice frame.
  core/chanora_core/src/lib.rs — ChanoraSession::start_audio,
    set_ptt, audio_stats; disconnect now stops the engine first.
  crates/chanora_bridge/src/api.rs — startAudio, setPtt,
    audioStats commands and BridgeAudioStats DTO.
  apps/chanora_flutter/lib/main.dart — "Start audio" button +
    hold-to-talk PTT button with pressed/released visual state +
    live stats line (TX/RX/PTT). Stats polled every 500 ms.

ARB:
  Both en and zh-Hans gain startAudioAction, pttHoldToTalk,
  pttTransmitting, audioStatsLine. Banner updated to
  "Beta build — voice in/out wired; not production ready."

FRB config:
  flutter_rust_bridge.yaml gains local: true so codegen resolves
  the workspace member's library stem to "chanora_bridge" instead
  of falling back to "UNKNOWN".

Empirical verification (2026-05-14, against cn.teamspeak.app):
  cargo check + cargo test --workspace: all green.
  flutter analyze: 0 issues.
  flutter test: 4/4 passing including:
    - test/alpha_e2e_test.dart (regression: Alpha still works)
    - test/beta_e2e_test.dart (Beta: connect → startAudio →
      PTT cycle → disconnect against cn.teamspeak.app).
  Live smoke (cargo test alpha_smoke -- --ignored): 49 channels,
  37 clients retrieved.
  Capture stream open against the host PipeWire auto_null source
  refused (snd_pcm_hw_params); engine correctly logged the warning
  and continued in playback-only mode. TX=0 frames, RX=0 frames
  reflects the headless null-source environment; on a real mic
  host the encoder produces ~50 frames/second while PTT is held.

Honest Beta scope (NOT in this release):
  - AEC / AGC / NS / HPF DSP (DEC-007..010): AudioEffects exists
    as a struct but the filters are no-ops. Beta+ work.
  - Production-quality resampler: current code is linear
    interpolation. Beta+ work.
  - Identity persistence via chanora_storage: still ephemeral.
  - Push-to-Dart event stream: UI polls instead.
  - chanora_diagnostics tracing-layer wiring: still scaffold.
  - Mobile (Android) cdylib + UI: PoC-proven, not yet in product.
  - Reconnect / network-loss recovery for the voice path.

Docs updates:
  - docs/governance/product-decision-register.md bumped to v0.9.7
    (Beta-milestone change-history entry; no row changes).
  - docs/governance/poc-results-summary.md bumped to v0.6.0
    (RISK-PoC-005 updated with Beta progress).

2026-05-14 22:43:57 +08:00