DETUNE: face expressions Music Experience for iOS
The AudioKit Blog
"detune is an amazing new open-source project built with AudioKit that allows creators to build face-centric interactive experiences using Apple’s True Depth technology."
View article on audiokitpro.com/blog/
detune uses Apple's ARKit and the TrueDepth camera (currently available only on iPhone X) to trigger music events, and to allow users to play music using face impressions.
The motivation behind the project, was to make Apple's TrueDepth camera more accessible for creative coders.
This app is the second part of the serious of works about body motion sensing and deep learning, in collaboration with Or Fleisher.