SoleSense: A Shoe-Based Wearable for Sound Event Localization and Detection in Urban Environments
This repository contains the implementation and hardware resources for SoleSense, a shoe-based platform with microphone arrays attached to the soles of both shoes, for sound event localization and detection (SELD).
This repository is organized into two major components.
This directory contains the hardware implementation of SoleSense, including:
- Hardware overview
- Hardware photos
- Firmware
This directory contains the implementation of SoleFormer, a transformer-based model architecture used for sound event detection and sound source localization.
It includes:
- Model architecture
- Source code
SoleSense explores shoe-based acoustic sensing by leveraging near-ground microphones for robust environmental sound perception.
The system supports:
- Sound Event Detection (SED)
- Sound Source Localization (SSL)
- SoleFormer transformer-based audio understanding
If you find this work useful in your research, please cite:
Citation will be added after publication.For questions regarding this project, please contact:
Will be added after publication.