Reliability Tests

The identification reliability is important for large-scale systems. MegaMatcher SDK includes a fused algorithm for fast and reliable identification using several biometric records taken from the same person.

As we do not have any single database with all supported biometric modalities, separate tests with selected modalities were performed for the MegaMatcher biometric engines to demonstrate their reliability and performance with single biometric modalities and combinations of several modalities:

• Fingerprint, face and iris engines tests with internal multi-modal database
• Voiceprint and face engines tests with XM2VTS database
• Palm print engine test

The tests with MegaMatcher biometric fingerprint, face and iris matching engines and fused template matching algorithm were performed using Neurotechnology internal multi-biometric database:

• The database had 7,500 sets of biometric records; each set contained 1 face, 2 irises and 10 fingerprints representing a unique person.
• 1,500 unique persons were represented in the database.
• 5 capture sessions were performed for each person.

The tests were performed with these biometric template types:

• 1 fingerprint record extracted from left index fingerprint image.
• 1 face record.
• 1 iris record extracted from left eye image.
• 2 fingerprint records extracted from same person's left and right index fingerprint images.
• 2 iris records extracted from same person's different eye images.
• 1 fingerprint + 1 face records – left index fingerprint and face taken from the same person.
• 1 face + 1 iris records – left iris and face taken from the same person.
• 1 fingerprint + 1 iris records – left index fingerprint and left iris taken from the same person.
• 1 fingerprint + 1 face + 1 iris records – left index fingerprint, left iris and face taken from the same person.

The biometric engines had these parameters set:

• ±90 degrees fingerprint rotation tolerance value was used for template matching;
• ±15 degrees iris rotation tolerance value was used for template matching.

Two tests were performed with each template type:

• Test 1 maximized matching accuracy. MegaMatcher 13.1 fused algorithm reliability in this test is shown as blue curves on the ROC charts.
• Test 2 maximized matching speed. MegaMatcher 13.1 fused algorithm reliability in this test is shown as red curves on the ROC charts.

The tests with templates. which contained 1 fingerprint + 1 face + 1 iris records, resulted with 0 % FRR for all FAR values

Receiver operation characteristic (ROC) curves are usually used to demonstrate the recognition quality of an algorithm. ROC curves show the dependence of false rejection rate (FRR) on the false acceptance rate (FAR).

Note that the tests with these biometric template types resulted with 0 % FRR for all FAR values, thus their charts are not shown:

• 2 fingerprint records
• 2 iris records
• 1 fingerprint + 1 face records
• 1 fingerprint + 1 iris records
• 1 face + 1 iris records
• 1 fingerprint + 1 face + 1 iris records

These tests show that a large-scale automated biometric identification system based on MegaMatcher provides high identification reliability when using fingerprints, using fused same-biometric (different fingerprints or irises from the same person) matching significantly reduces FRR, and using multi-biometric identification results in a significant reliability increase.

Receiver operation characteristic (ROC) curves are usually used to demonstrate the recognition quality of an algorithm. ROC curves show the dependence of false rejection rate (FRR) on the false acceptance rate (FAR).