real-time sound processing and playback system based on location tracking hand heartbeats detection.
(it is a work in progress)
(it is a work in progress)
toolkits: raspberry pi | UWB kits | esp32
source code upon request ︎︎︎
project requirement
build a system that takes user’s 3D location and peek heartrate data to manipulate a soundtrack, and stream it in a spatial sound system
hardware system diagram
system highlight
1. use modified Pan-Tompkins algorithm to get heartbeat peaks
2. use UWB sensors to support multiple (60 tags total) 3D location tracking in large space
next step
access and group location data and heartbeat peaks from Rpi for each wearable devices