SentiMask SDK

3D face tracking for augmented reality apps and digital characters control

SentiMask is designed for development of augmented reality applications, which use real-time 3D face tracking technologies for motion capture and controlling 3D digital character's facial expressions or mapping animated avatars on user's face. The technology works with regular cameras and common PC or smartphones.

Available as a software development kit that provides for the development of 3D face tracking systems for Microsoft Windows, Android and Linux.

Features and Capabilities

  • Real-time face detection and tracking.
  • Facial pose, landmarks, shape and expression estimation.
  • 3D facial mesh generation.
  • Works with regular webcams and smartphone cameras.
  • Easy integration with other software like 3D modelling software or game engines.
  • Reasonable prices, flexible licensing and free customer support.
Face animation SentiMask based character animation rendered in Blender 3D
Click to zoom

SentiMask provides real-time 3D face tracking and facial expression estimation using video from a regular webcam or smartphone camera. The possible applications of the SentiMask technology include:

  • Motion capture for 3D characters' face animation in entertainment applications, like computer games, communication apps etc.;
  • Augmented reality applications, like virtual makeup, appearance changes evaluation, etc.
  • Facial expression analytics for interactive applications.

The SentiMask technology has these capabilities for 3D face tracking applications:

  • Real time performance. SentiMask technology performs facial features detection and tracking from live video in real time. The technology provides fast performance on a regular PC or smartphone.
  • Facial features estimation. SentiMask algorithm is able to recognize facial pose, landmarks, shape and expression from a video.
  • 3D facial mesh generation. The algorithm reconstructs a 3D facial mesh (wireframe model) from a facial image. A custom texture can be applied to the mesh, or the mesh points can be used as a reference for changing the appearance of an animated character.
  • Common camera required. A video for the 3D face model reconstructions can be captured with an off-the-shelf camera or a smartphone. No depth sensors or other advanced hardware needed. The recommendations and specifications contain more detailed information about camera setup.
  • Easy integration with other software. SentiMask generates 3D point cloud, facial rotation angles (roll, pitch, yaw) and estimations of facial expression. This data can be used in a custom application or easily passed to a 3D modelling software like Blender, as well as game engines.
Neurotechnology Distributors Map Ex-Cle S.A - representative in Argentina FingerSec do Brasil - distributor in Brazil (web site in Portuguese) Distributors in Chile Neurotechnology's Chinese Office (web site in Chinese) Security Systems Ltda - distributor in Colombia (web site in Spanish) Data6terms - distributor in Congo D.R. General Security El Salvador - distributor in El Salvador (web site in Spanish) Infokey Software Solutions - distributor in Greece (web site in Greek and English) Fulcrum Biometrics India Pvt. Ltd. - distributor in India Accent e Technology - distributor in India Biometric srl - distributor in Italy (web site in Italian) Software Sources Ltd - distributor in Israel Tegara Corporation - distributor in Japan (web site in Japanese) Bruce and Brian Co., LTD. - distributor in Korea (web site in Korean) Digital Data Systems - distributor in Pakistan Ex-Cle S.A - distributor in Paraguay Digital Works - distributor in Peru Fingerprint i.t. - distributor in South Africa Intuate Biometrics - distributor in Spain (web site in Spanish) Sri Lanka Division - Neurotechnology Lab Delaney Biometrics - distributor in the UK Fulcrum Biometrics - representative in the USA Unifyia, Inc - distributor in the USA Distributors in Venezuela
Follow us
Facebook icon   LinkedIn icon   Twitter icon
Google+ icon   Youtube icon
Copyright © 1998 - 2017 Neurotechnology | Terms & Conditions | Privacy Policy | Career