aodhan/homeai
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

feat(phase-04): Wyoming Satellite integration + OpenClaw HA components

Browse Source 
## Voice Pipeline (P3)
- Replace openWakeWord daemon with Wyoming Satellite approach
- Add Wyoming Satellite service on port 10700 for HA voice pipeline
- Update setup.sh with cross-platform sed compatibility (macOS/Linux)
- Add version field to Kokoro TTS voice info
- Update launchd service loader to use Wyoming Satellite

## Home Assistant Integration (P4)
- Add custom conversation agent component (openclaw_conversation)
  - Fix: Use IntentResponse instead of plain strings (HA API requirement)
  - Support both HTTP API and CLI fallback modes
  - Config flow for easy HA UI setup
- Add OpenClaw bridge scripts (Python + Bash)
- Add ha-ctl utility for HA entity control
  - Fix: Use context manager for token file reading
- Add HA configuration examples and documentation

## Infrastructure
- Add mem0 backup automation (launchd + script)
- Add n8n workflow templates (morning briefing, notification router)
- Add VS Code workspace configuration
- Reorganize model files into categorized folders:
  - lmstudio-community/
  - mlx-community/
  - bartowski/
  - mradermacher/

## Documentation
- Update PROJECT_PLAN.md with Wyoming Satellite architecture
- Update TODO.md with completed Wyoming integration tasks
- Add OPENCLAW_INTEGRATION.md for HA setup guide

## Testing
- Verified Wyoming services running (STT:10300, TTS:10301, Satellite:10700)
- Verified OpenClaw CLI accessibility
- Confirmed cross-platform compatibility fixes
This commit is contained in:
Aodhan Collins
2026-03-08 02:06:37 +00:00
parent 9eb5633115
commit 6a0bae2a0b
119 changed files with 780808 additions and 64 deletions
Download Patch File Download Diff File Expand all files Collapse all files

21
PROJECT_PLAN.md
View File

@@ -90,20 +90,26 @@ All repos live under `~/gitea/homeai/` on the Mac Mini and are mirrored to the s
**Sub-components:**
```
[Mic] → openWakeWord → Wyoming STT (Whisper.cpp) → [text out]
[text in] → Wyoming TTS (Kokoro) → [audio out]
[Mic] → Wyoming Satellite (port 10700) → Home Assistant Voice Pipeline → Wyoming STT (Whisper)
↓
[Speaker] ← Wyoming TTS (Kokoro) ← OpenClaw Agent ← transcribed text
```
*Note: The original openWakeWord daemon has been replaced by the Wyoming satellite approach, which handles wake word detection through Home Assistant's voice pipeline.*
**Key decisions:**
- Whisper.cpp runs as a Wyoming STT provider (via `wyoming-faster-whisper` or native Wyoming adapter)
- Whisper.cpp runs as a Wyoming STT provider (via `wyoming-faster-whisper`)
- Kokoro is primary TTS; Chatterbox used when voice cloning is active (P5)
- openWakeWord runs as a launchd service
- Wyoming server port: `10300` (STT), `10301` (TTS) — standard Wyoming ports
- Wyoming satellite runs on port `10700` — handles audio I/O and connects to HA voice pipeline
- openWakeWord daemon disabled — wake word detection now handled by HA via Wyoming satellite
- Wyoming server ports: `10300` (STT), `10301` (TTS), `10700` (Satellite) — standard Wyoming ports
**Interface contract:**
- Wyoming STT: `tcp://localhost:10300`
- Wyoming TTS: `tcp://localhost:10301`
- Wyoming STT: `tcp://localhost:10300` (Whisper large-v3)
- Wyoming TTS: `tcp://localhost:10301` (Kokoro ONNX)
- Wyoming Satellite: `tcp://localhost:10700` (Mac Mini audio I/O)
- Direct Python API for P4 (agent bypasses Wyoming for non-HA calls)
- OpenClaw Bridge: `homeai-agent/skills/home-assistant/openclaw_bridge.py` (HA integration)
---
@@ -302,6 +308,7 @@ P5 (character) ──────┐ │ │ │
| Ollama API `localhost:11434/v1` | HTTP (OpenAI compat) | P2 | P3, P4, P7 |
| Wyoming STT `localhost:10300` | TCP/Wyoming | P3 | P6, HA |
| Wyoming TTS `localhost:10301` | TCP/Wyoming | P3 | P6, HA |
| Wyoming Satellite `localhost:10700` | TCP/Wyoming | P3 | HA |
| OpenClaw API `localhost:8080` | HTTP | P4 | P3, P7, P8 |
| Character JSON `~/.openclaw/characters/` | JSON file | P5 | P4, P3, P7 |
| `character.schema.json` v1 | JSON Schema | P5 | P4, P3, P7 |