DETUNE: face expressions Music Experience for iOS
Press
The AudioKit Blog
"detune is an amazing new open-source project built with AudioKit that allows creators to build face-centric interactive experiences using Apple’s True Depth technology."
View article on audiokitpro.com/blog/
detune uses Apple's ARKit and the TrueDepth camera (currently available only on iPhone X) to trigger music events. This app is the second part of the serious of works about body motion sensing and deep learning by Or Fleisher and Dror Ayalon. Many thanks to Djordje Jovic, who collaborated with us on this project.
About
detune uses Apple's ARKit and the TrueDepth camera (currently available only on iPhone X) to trigger music events, and to allow users to play music using face impressions.
The motivation behind the project, was to make Apple's TrueDepth camera more accessible for creative coders.
This app is the second part of the serious of works about body motion sensing and deep learning, in collaboration with Or Fleisher.
ingredients
AR Framework - ARKit + ARFaceAncors
Sound and music - AudioKit
