English | 中文
Real-time voice interaction for Tron robots, supporting chat, action execution, etc.
- Voice input : Accurate voice recognition through FunASR.
- Speech Activity Detection : Use silero-vad to filter out invalid audio to enhance recognition efficiency.
- Intelligent Dialogue Generation : Rely on the powerful language understanding capabilities provided by LLMS to generate natural text responses.
- Voice output : Convert text to voice through edge-tts and other means to provide users with realistic auditory feedback.
- Support for interruption : Flexibly configure interruption strategies, capable of identifying keyword and voice interruptions, ensuring immediate feedback and control from users during conversations, and enhancing interaction smoothness.
- Supports memory function: It has the ability to continuously learn, can remember users' preferences and historical conversations, and provide personalized interactive experiences.
- Support for Tool Invocation: Flexibly integrate external tools, allowing users to directly request information or perform operations through voice commands, enhancing the practicality of the assistant. It can be expanded at any time
- Support for task Management: Efficiently manage user tasks, capable of tracking progress, setting reminders, and providing dynamic updates to ensure that users do not miss any important matters.
- Ultra-lightweight application: This code can be easily run on Jeston Orin NX.
- Basic voice dialogue function
- Supports Tron hardware communication
- supports Tron action execution calls
- Supports batch action execution and exception termination on Tron
- Supports both Chinese and English versions of Agent input and response
- Memory
- supports voice wake-up and sleep
- Preset prompt word template
- Offline operation
- Multiple tool calls
- Rag & Agent
- interrupted
- Cloning Project Repository
git clone
cd Tron-Agent- Installation dependencies
conda create -n tronagent
conda activate tronagent
pip install -r requirments.txt -i https://pypi.tuna.tsinghua.edu.cn/simple
pip install pynini==2.1.5 -i https://pypi.tuna.tsinghua.edu.cn/simple #x86
pip install WeTextProcessing==1.0.3 -i https://pypi.tuna.tsinghua.edu.cn/simple #x86- Local deployment of llm
curl -fsSL https://ollama.com/install.sh | sh
ollama run modelscope.cn/unsloth/Qwen3-1.7B-GGUF- Download the relevant model
mkdir models && cd models
modelscope download --model iic/SenseVoiceSmall --local_dir SenseVoiceSmall
modelscope download --model BAAI/bge-small-zh --local_dir rag/bge-small-zh
modelscope download --model BAAI/bge-small-en --local_dir rag/bge-small-en
modelscope download --model iic/speech_fsmn_vad_zh-cn-16k-common-pytorch --local_dir fsmn_vad
git lfs install
mkdir -p translation/Helsinki-NLP && cd translation/Helsinki-NLP
git clone https://huggingface.co/Helsinki-NLP/opus-mt-zh-en
git clone https://huggingface.co/Helsinki-NLP/opus-mt-en-zh
cd ../.. && mkdir -p tts/piper && cd tts/piper
#Relevant model https://huggingface.co/rhasspy/piper-voices/tree/v1.0.0
wget https://huggingface.co/rhasspy/piper-voices/resolve/v1.0.0/en/en_US/amy/medium/en_US-amy-medium.onnx
wget https://huggingface.co/rhasspy/piper-voices/resolve/v1.0.0/en/en_US/amy/medium/en_US-amy-medium.onnx.json
wget https://huggingface.co/rhasspy/piper-voices/resolve/v1.0.0/zh/zh_CN/huayan/medium/zh_CN-huayan-medium.onnx
wget https://huggingface.co/rhasspy/piper-voices/resolve/v1.0.0/zh/zh_CN/huayan/medium/zh_CN-huayan-medium.onnx.json- Reliance on arm architecture
mkdir /home/guest/tron/tron1-agent/tools/pynini && cd /home/guest/tron/tron1-agent/tools/pynini
wget https://www.openfst.org/twiki/pub/FST/FstDownload/openfst-1.8.2.tar.gz && tar -zxvf openfst-1.8.2.tar.gz && cd openfst-1.8.2
./configure --enable-grm --enable-static --enable-shared --host=arm-linux-gnueabihf && make -j$(nproc) && make install && sudo ldconfig
echo 'export CPLUS_INCLUDE_PATH="/usr/local/include:$CPLUS_INCLUDE_PATH"' >> ~/.bashrc
echo 'export LIBRARY_PATH="/usr/local/lib:$LIBRARY_PATH"' >> ~/.bashrc
echo 'export LD_LIBRARY_PATH="/usr/local/lib:$LD_LIBRARY_PATH"' >> ~/.bashrc
source ~/.bashrc
pip install Cython==3.1.2 setuptools==62.3.4 wheel==0.45.1
pip install pynini==2.1.5 -i https://pypi.tuna.tsinghua.edu.cn/simple
pip install WeTextProcessing==1.0.3 --no-deps -i https://pypi.tuna.tsinghua.edu.cn/simple
mkdir /home/guest/tron/tron1-agent/tools/torch && cd /home/guest/tron/tron1-agent/tools/torch
# jetpack6 and cuda12.6
wget https://github.com/limxdynamics/tron1-agent/releases/download/v1.0.0/torch-2.8.0-cp310-cp310-linux_aarch64.whl
wget https://github.com/limxdynamics/tron1-agent/releases/download/v1.0.0/torchaudio-2.8.0-cp310-cp310-linux_aarch64.whl
wget https://github.com/limxdynamics/tron1-agent/releases/download/v1.0.0/torchvision-0.23.0-cp310-cp310-linux_aarch64.whl
pip install torch-2.8.0-cp310-cp310-linux_aarch64.whl
pip install torchaudio-2.8.0-cp310-cp310-linux_aarch64.whl
pip install torchvision-0.23.0-cp310-cp310-linux_aarch64.whl
mkdir /home/guest/tron/tron1-agent/tools/spacy && cd /home/guest/tron/tron1-agent/tools/spacy
wget https://github.com/limxdynamics/tron1-agent/releases/download/v1.0.0/en_core_web_trf-3.8.0-py3-none-any.whl
wget https://github.com/limxdynamics/tron1-agent/releases/download/v1.0.0/zh_core_web_trf-3.8.0-py3-none-any.whl
pip install en_core_web_trf-3.8.0-py3-none-any.whl
pip install zh_core_web_trf-3.8.0-py3-none-any.whl -i https://pypi.tuna.tsinghua.edu.cn/simple
pip install scipy --upgrade -i https://pypi.tuna.tsinghua.edu.cn/simple- Run the project
python main.py- Auto-start upon startup
sudo cp tools/auto_start/tronagent.service /etc/systemd/system/tronagent.servce
sudo systemctl enable tronagent.service
sudo systemctl daemon-reloadThe relevant configuration is under config/, and can be modified by yourself.
The development of this project's code is based on the Bailing framework. We would like to express our special gratitude to the Bailing team for their technical support and open-source foundation. Additionally, sincere thanks go to other models and relevant contributors that have provided assistance in the development of this Agent.