chat-mate-tts

Prototype for text-to-speech integration with ChatMate using Coqui TTS. Livestream chat messages are converted to audio as they come in, then automatically played to the user.

Dependencies

• Bun
• docker
  • sudo apt install docker.io
• docker-compose
  • sudo curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
  • sudo chmod +x /usr/local/bin/docker-compose
• nvidia-container-toolkit

  • && curl -s -L https://nvidia.github.io/libnvidia-container/stable/deb/nvidia-container-toolkit.list | \
      sed 's#deb https://#deb [signed-by=/usr/share/keyrings/nvidia-container-toolkit-keyring.gpg] https://#g' | \
      sudo tee /etc/apt/sources.list.d/nvidia-container-toolkit.list
    

  • sudo apt-get install -y nvidia-container-toolkit
  • sudo nvidia-ctk runtime configure --runtime=docker
  • sudo systemctl restart docker
  • A running instance of Coqui TTS
    • sudo docker pull ghcr.io/coqui-ai/tts
    • Run the container: sudo docker run --rm -it -p 5002:5002 --gpus all --entrypoint /bin/bash ghcr.io/coqui-ai/tts
    • Check the list of models: python3 TTS/server/server.py --list_models
    • Start the REST API server: python3 TTS/server/server.py --model_name tts_models/en/vctk/vits --use_cuda true
  • Ollama
    • ollama run gemma3:4b to download the model
    • ollama create tts-filter -f ./Modelfile to create the custom chat filter. This needs to be run whenever the Modelfile is changed.

To install Node dependencies:

bun install

Running chat-mate-tts

To run:

bun run index.ts