openclaw - 💡(How to fix) Fix DGX Spark voice-local: STT/TTS を GPU 対応にしてターン遅延を数秒化する [1 participants]

TL;DR

Switching to GPU-supported STT and TTS engines is likely to reduce the latency in the voice prototype.

Guidance

• Identify suitable GPU-supported STT and TTS engines that can be integrated with the existing prototype.
• Modify the prototype to use the selected GPU-supported engines, ensuring that the CPU fallback option is still available.
• Update the README to include instructions for running the prototype on DGX Spark with Linux arm64 and NVIDIA GPU.
• Implement logging to measure the latency of each stage (STT, LLM, TTS) in a single turn.

Example

No specific code snippet can be provided without more details on the current implementation.

Notes

The solution may require significant changes to the prototype's architecture and dependencies. Ensuring compatibility with the DGX Spark environment and maintaining the localhost-only constraint are crucial considerations.

Recommendation

Apply workaround: Switch to GPU-supported STT and TTS engines to reduce latency while maintaining the existing prototype's constraints. This approach is likely to achieve the desired reduction in latency without requiring significant changes to the OpenClaw core.