1. Gesture Detection
You place your hand over a note area on either side of the device. The VL53L1X laser sensors measure the exact distance from your hand in real time.
2. Bluetooth Transmission
An Arduino Nano reads the distance values and sends them via HM-10 Bluetooth module to your phone, tablet, or PC using Bluetooth Low Energy (BLE).
3. Web App Interpretation
The Distanzuino web application receives the distances and converts them into tones based on pre-defined tone maps and instrument profiles.
4. Realistic Sound Generation
The web app plays tones using measured harmonics and attack-phase timing to match real instruments like the piano, flute, or cello. You hear the result through your device or other connected speakers.
5. Customization
You can adjust tones, volume, and instruments right in the browser. The app also shows which notes are playing real-time.