Fugue States (FS)
An experiment in mapping motion sensor data to music/sound.
Design
FS leverages MBIENTLAB/MetaWear sensors (MMS and MMRL) and API.
The FS project contains high level mappings to intialize and access MMS data:
- Accelerometer
- Gyrometer
- Magnometer
- Temperature
...as well as processed data, sent from the sensor to a client over Bluetooth.
Note: The MBIENTLAB API is only supported in Linux.
On the sound side, this project is being programmed in PlugData, an IDE for PureData. This is free and open source software, and the developers welcome your support!
/fugue-states
+ /sense
+ /patch
The sense directory contains custom abstractions for the configuration
and usage of the MetaWear sensor. These structures call the MBIENTLAB API,
manage the Bluetooth LE (BLE) connection, parse the sensor data, and send
it over network via the Open Sound Control (OSC) protocol. They can also
receive OSC control messages to start and stop data streaming or, in the
future, configure the sensors remotely.
The patch directory contains abstractions in PlugData (PureData) for
receiving sensor data via the BLE/OSC pathway discussed above; parsing
multiplexed sensor data; graphical control interfaces; and mapping data
to arbitrary outputs. Aside from ingesting data, the patch aspect of
the project also hopefully explores creative and musical instrumentation
using the input data.
For a detailed roadmap, see this page. I will update the repository with more tidbits (diagrams, videos, and usable demonstrations) as they develop.