FaceOSC

FaceOSC is a Mac tool that lets you use facial expressions detected by a webcam as a MIDI controller. It was created by Kyle McDonald and relies on the Osculator system, designed to connect various types of controllers to audio and video programs.

Here is what the author reports, with links to download the software (FaceOSC and Osculator), as well as a short video.

FaceOSC is a tool for prototyping face-based interaction. It’s built on non-commercial open source FaceTracker code from Jason Saragih.

FaceOSC comes as an example app with the ofxFaceTracker addon for openFrameworks. You can download an OSX/Win binary at github.

OSCulator is an excellent program for routing OSC and MIDI. Download it at osculator.net/

Some of the “face gestures” (or metrics) are more stable than others. Lighting can also have a huge influence on the stability of your values: even lighting from the front coupled with a dark background can give the best results.

Other demos on Youtube

Back