13
Mobile Touchless Fingerprint Recognition: Implementation, Performance and Usability Aspects Jannis Priesnitz a,c,* , Rolf Huesmann b , Christian Rathgeb a , Nicolas Buchmann c , Christoph Busch a a da/sec – Biometrics and Internet Security Research Group, Hochschule Darmstadt, Sch¨ offerstraße 8b, 64295 Darmstadt, Germany b UCS – User-Centered Security Research Group, Hochschule Darmstadt, Sch¨ offerstraße 8b, 64295 Darmstadt, Germany c Freie Universit¨ at Berlin, Takustraße 9, 14195 Berlin, Germany Abstract This work presents an automated touchless fingerprint recognition system for smartphones. We provide a comprehensive description of the entire recognition pipeline and discuss important requirements for a fully automated capturing sys- tem. Also, our implementation is made publicly available for research purposes. During a database acquisition, a total number of 1,360 touchless and touch-based samples of 29 subjects are captured in two different environmental situations. Experiments on the acquired database show a comparable performance of our touchless scheme and the touch-based baseline scheme under constrained environmental influences. A comparative usability study on both capturing device types indicates that the majority of subjects prefer the touchless capturing method. Based on our experimental results we analyze the impact of the current COVID-19 pandemic on fingerprint recognition systems. Finally, implementation aspects of touchless fingerprint recognition are summarized. Keywords: Biometrics, Fingerprint Recognition, Touchless Fingerprint, Usability, Biometric Performance 1. Introduction Fingerprints are one of the most important biometric characteristic due to their known uniqueness and persis- tence properties. Fingerprint recognition systems are not only used worldwide by law enforcement and forensic agen- cies, they are also deployed in the mobile devices as well as in nation-wide applications. The vast majority of finger- print capturing schemes requires contact between the finger and the capturing device’s surface. These systems suffer from distinct problems, e.g. low contrast caused by dirt or humidity on the capturing device plate or latent finger- prints of previous users (ghost fingerprints). Especially in multi-user applications hygienic concerns lower the accept- ability of touch-based fingerprint systems and hence, limit their deployment. In a comprehensive study, Okereafor et al. [1] analyze the risk of an infection by touch-based fin- gerprint recognition schemes and the hygienic concerns of their users. The authors conclude that touch-based fin- gerprint recognition carries a high risk of an infection if a previous user has contaminated the capturing device sur- face, e.g. with the SARS-CoV-2 virus. To tackle these shortcomings of touch-based schemes, touchless fingerprint recognition systems have been re- searched for more than a decade. Touchless capturing schemes operate without any contact between the finger and the capturing device. Several contributions to the research area paved the way for a practical implementa- tion of touchless capturing schemes. Specialized stationary capturing devices based on multi-camera setups combined * Corresponding author Email address: [email protected] (Jannis Priesnitz) URL: dasec.h-da.de (Jannis Priesnitz) with a powerful processing have already been implemented in a practical way [16]. However, to the best of the au- thors’ knowledge no approach to mobile touchless recog- nition scheme based on of-the-shelf components has been documented so far. In this work, we propose a mobile touchless fingerprint recognition scheme based for smartphones. We provide a fully automated capturing scheme with integrated quality assessment in form of an Android app. All components of the processing pipeline will be made publicly available for research purposes. The rest of the recognition pipeline is composed of open source algorithms for feature extraction and comparison. To benchmark our proposed recognition pipeline we ac- quired a database under real life conditions. A number of 29 subjects have been captured by two touchless capturing devices in different environmental situations. Moreover, touch-based samples have been acquired as baseline and to measure the interoperability between both schemes. A usability study, which has been conducted after the captur- ing, reviews the users’ experiences with both capturing de- vice types. This paper details on every implementation step of the processing pipeline and summarizes our database acquisition setup in detail. Further, we evaluate the bio- metric performance of our acquired database and discusses the outcomes of our usability study. Based on our exper- imental results we elaborate on the impact of the current COVID-19 pandemic on fingerprint recognition in terms of biometric performance and user acceptance. Further we summarize implementation aspects which we consider as beneficial for mobile touchless fingerprint recognition. The rest of the paper is structured as follows: Section 2 gives an overview on touchless end-to-end schemes pro- posed in the scientific literature. In Section 3, the proposed Preprint submitted to Elsevier March 5, 2021

Mobile Touchless Fingerprint Recognition: Implementation

  • Upload
    others

  • View
    9

  • Download
    0

Embed Size (px)

Citation preview

Page 1: Mobile Touchless Fingerprint Recognition: Implementation

Mobile Touchless Fingerprint Recognition:Implementation, Performance and Usability Aspects

Jannis Priesnitza,c,∗, Rolf Huesmannb, Christian Rathgeba, Nicolas Buchmannc, Christoph Buscha

ada/sec – Biometrics and Internet Security Research Group, Hochschule Darmstadt, Schofferstraße 8b, 64295 Darmstadt, GermanybUCS – User-Centered Security Research Group, Hochschule Darmstadt, Schofferstraße 8b, 64295 Darmstadt, Germany

cFreie Universitat Berlin, Takustraße 9, 14195 Berlin, Germany

Abstract

This work presents an automated touchless fingerprint recognition system for smartphones. We provide a comprehensivedescription of the entire recognition pipeline and discuss important requirements for a fully automated capturing sys-tem. Also, our implementation is made publicly available for research purposes. During a database acquisition, a totalnumber of 1,360 touchless and touch-based samples of 29 subjects are captured in two different environmental situations.Experiments on the acquired database show a comparable performance of our touchless scheme and the touch-basedbaseline scheme under constrained environmental influences. A comparative usability study on both capturing devicetypes indicates that the majority of subjects prefer the touchless capturing method. Based on our experimental resultswe analyze the impact of the current COVID-19 pandemic on fingerprint recognition systems. Finally, implementationaspects of touchless fingerprint recognition are summarized.

Keywords: Biometrics, Fingerprint Recognition, Touchless Fingerprint, Usability, Biometric Performance

1. Introduction

Fingerprints are one of the most important biometriccharacteristic due to their known uniqueness and persis-tence properties. Fingerprint recognition systems are notonly used worldwide by law enforcement and forensic agen-cies, they are also deployed in the mobile devices as wellas in nation-wide applications. The vast majority of finger-print capturing schemes requires contact between the fingerand the capturing device’s surface. These systems sufferfrom distinct problems, e.g. low contrast caused by dirtor humidity on the capturing device plate or latent finger-prints of previous users (ghost fingerprints). Especially inmulti-user applications hygienic concerns lower the accept-ability of touch-based fingerprint systems and hence, limittheir deployment. In a comprehensive study, Okereafor etal. [1] analyze the risk of an infection by touch-based fin-gerprint recognition schemes and the hygienic concerns oftheir users. The authors conclude that touch-based fin-gerprint recognition carries a high risk of an infection if aprevious user has contaminated the capturing device sur-face, e.g. with the SARS-CoV-2 virus.

To tackle these shortcomings of touch-based schemes,touchless fingerprint recognition systems have been re-searched for more than a decade. Touchless capturingschemes operate without any contact between the fingerand the capturing device. Several contributions to theresearch area paved the way for a practical implementa-tion of touchless capturing schemes. Specialized stationarycapturing devices based on multi-camera setups combined

∗Corresponding authorEmail address: [email protected] (Jannis Priesnitz)URL: dasec.h-da.de (Jannis Priesnitz)

with a powerful processing have already been implementedin a practical way [16]. However, to the best of the au-thors’ knowledge no approach to mobile touchless recog-nition scheme based on of-the-shelf components has beendocumented so far.

In this work, we propose a mobile touchless fingerprintrecognition scheme based for smartphones. We provide afully automated capturing scheme with integrated qualityassessment in form of an Android app. All components ofthe processing pipeline will be made publicly available forresearch purposes. The rest of the recognition pipeline iscomposed of open source algorithms for feature extractionand comparison.

To benchmark our proposed recognition pipeline we ac-quired a database under real life conditions. A number of29 subjects have been captured by two touchless capturingdevices in different environmental situations. Moreover,touch-based samples have been acquired as baseline andto measure the interoperability between both schemes. Ausability study, which has been conducted after the captur-ing, reviews the users’ experiences with both capturing de-vice types. This paper details on every implementation stepof the processing pipeline and summarizes our databaseacquisition setup in detail. Further, we evaluate the bio-metric performance of our acquired database and discussesthe outcomes of our usability study. Based on our exper-imental results we elaborate on the impact of the currentCOVID-19 pandemic on fingerprint recognition in terms ofbiometric performance and user acceptance. Further wesummarize implementation aspects which we consider asbeneficial for mobile touchless fingerprint recognition.

The rest of the paper is structured as follows: Section 2gives an overview on touchless end-to-end schemes pro-posed in the scientific literature. In Section 3, the proposed

Preprint submitted to Elsevier March 5, 2021

arX

iv:2

103.

0303

8v1

[cs

.CV

] 4

Mar

202

1

Page 2: Mobile Touchless Fingerprint Recognition: Implementation

Table 1: Overview on selected recognition workflows with biometric performance. (Device type: P = Prototypical hardware, S = Smartphone,W = Webcam)

Authors YearDevicetype

Mobile /

StationaryAmount

of fingersAutomaticcapturing

Free finger

positioningOn-deviceprocessing

BiometricPerformance

Hiew et al. [2] 2007 P S 1 N N N EER: 5.63%Piuri et al. [3] 2008 W S 1 N N N EER: 0.04%Wang et al. [4] 2009 P S 1 N N N EER: 0.0% 1

Kumar and Zhou [5] 2011 W S 1 N N N EER: 0.32%Derawi et al. [6] 2011 S S 1 N N N EER: 4.5%

Noh et al. [7] 2011 P S 5 Y N N EER: 6.5%Stein et al. [8] 2013 S M 1 Y Y Y EER: 1.2%

Raghavendra et al. [9] 2014 P S 1 N Y N EER: 6.63%Tiwari et al. [10] 2015 S M 1 N Y N EER: 3.33%

Sankaran et al. [11] 2015 S M 1 Y N N EER: 3.56%

Carney et al. [12] 2017 S M 4 Y N YFAR = 0.01% @

FRR = 1%

Deb et al. [13] 2018 S M 1 Y Y YTAR = 98.55% @

FAR = 1.0%

Weissenfeld et al. [14] 2018 P M 4 Y Y YFRR 1.2% @FAR 0.01%

Birajadar et al. [15] 2019 S M 1 Y N N EER: 1.18%Our method 2021 S M 4 Y Y Y EER: 5.36%

Figure 1: Overview on the most relevant steps of our proposed method.

processing pipeline is presented. In Section 4, we describeour experimental setup and provide details about the cap-tured database and the usability study. The results of ourexperiments are reported in Section 5. The influence of theCOVID-19 pandemic on fingerprint recognition is discussedin Section 6. Section 7 discusses implementation aspects.Finally, Section 8 concludes.

2. Related Work

In this section, we present an overview on touchless fin-gerprint end-to-end solutions along with reported biomet-ric performance. Table 1 summarizes most relevant relatedworks and their properties. For a comprehensive overviewon the topic of touchless fingerprint recognition the readeris referred to [17].

The research on touchless fingerprint recognition hasevolved from bulky single finger devices to more conve-nient multi-finger capturing schemes. First end-to-end ap-proaches with prototypical hardware setups were presentedby Hiew et al. [2] and Wang et al. [4]. Both works em-ployed huge capturing devices for one single finger acquisi-tion within a hole-like guidance.

For remote user authentication, Piuri et al. [3] and Ku-mar et al. [5] investigated the use of webcams as finger-print capturing device. Both schemes showed a very lowEER in experimental results. However, the database cap-turing process was not reported precisely. In addition, theusability and user acceptance of such an approach shouldbe further investigated.

More recent works use smartphones for touchless finger-print capturing. Here, a finger image is taken by a photo

1The authors only report the EER on a score level fusion of 8sequentially acquired fingerprints.

app and manually transferred to a remote device where theprocessing is performed [10, 11]. The improvement of thecamera and processing power in current smartphones hasmade it possible to capture multiple fingers in in a singlecapture attempt and process them on the device. Stein etal. [8] showed that it is feasible for the automated captur-ing of a single finger image using a smartphone. Carneyet al. [12] presented the first four-finger capturing scheme.Weissenfeld et al. [14] proposed a system with a free po-sitioning of four fingers in a mobile prototypical hardwaresetup.

In summary, it can be observed that the evolution oftouchless fingerprint technologies has moved towards out-of-the-box device and a more convenient and practicallyrelevant recognition process. Table 1 also indicates thatboth an accurate recognition and a convenient capturingare hard to achieve. It should be further noted that thelevel of constraints during the capturing has a major influ-ence on the recognition performance.

3. Mobile Touchless Recognition Pipeline

An unconstrained and automated touchless fingerprintrecognition system usually requires a more elaborated pro-cessing compared to touch-based schemes. Figure 1 givesan overview on the key processing steps of the proposedrecognition pipeline. Our method features an on-devicecapturing, pre-processing, and quality assessment whereasthe biometric identification workflow is implemented on aback-end system. This section describes each componentof the recognition pipeline in detail.

The proposed method combines three implementationaspects seen as beneficial for an efficient and convenientrecognition:

2

Page 3: Mobile Touchless Fingerprint Recognition: Implementation

Figure 2: Overview of the segmentation of connected components from a continuous stream of input images.

Figure 3: Overview of the coarse rotation correction, separation of fingerprint images from each other, fine rotation correction, fingertipcropping and normalization of the fingerprint size.

• A smartphone as hardware platform which capturesthe finger image and obtains a fingerprint images fromit.

• A free positioning of the fingers without guidelines orframing.

• A fully automated capturing and processing with anintegrated quality assessment and user feedback.

The whole capturing and processing pipeline discussedin this section is made publicly available2.

3.1. Capturing

The vast majority of mobile touchless recognitionschemes rely on state-of-the-art smartphones as capturingdevices. Smartphones offer a high-resolution camera unit, apowerful processor, an integrated user feedback via displayand speaker, as well as a mobile internet connection foron-demand comparison against centrally stored databases.

In our case, the capturing as well as the processing isembedded in an Android App. Once the recognition pro-cess is started the application analyzes the live-view imageand automatically captures a finger image if the quality pa-rameters fit the requirements. During capturing the user isable to see his/her fingers through a live-view on the screenand is able to adjust the finger position. In addition, thecapturing progress is displayed.

3.2. Segmentation of the Hand Area

Proposed strategies for the segmentation mainly rely oncolor and contrast. Many works use color models for seg-menting the hand color from the background. Here an

2Source code will be made available at: https://gitlab.com/

jannispriesnitz/mtfr

Otsu’s adaptive threshold is preferable over static thresh-olding. Combinations of different color channels also showsuperior results compared to schemes based on one channel[18, 19, 20, 21].

Figure 2 presents an overview of the segmentation work-flow. We adopt this method and analyze the Cr componentof the yCbCr color model and the H component of the HSVcolor model. As first step we normalize the color channelsto the full range of the histogram. Subsequently, the Otsu’sthreshold determines the local minimum in the histogramcurve. A binary mask is created where all pixel values be-low the threshold are set to black and all pixels above thethreshold are set to white.

Additionally, our algorithm analyzes the largest con-nected components within the segmentation mask. Ide-ally the segmentation mask should only contain one to fourdominant components: from one hand area up to four fin-ger areas, respectively. The method also checks the sizeand shape of segmented areas.

3.3. Rotation Correction, Fingertip Detection and Normal-ization

The rotation correction transforms every finger imagein a way that the final fingerprint image is oriented in anupright position.

Figure 3 presents an overview of the rotation correction,fingertip detection and normalization. Our method fea-tures two rotation steps: First a coarse rotation on the fullhand and second a fine rotation on the separated finger. Arobust separation and identification of the fingers requiresthat the hand is rotated to an upright position. Here theimage border of the binary segmentation mask is analyzed.Many white border pixels indicate that the hand is placedinto the sensor area from this particular direction. For thisreason, we search for the border area with the most white

3

Page 4: Mobile Touchless Fingerprint Recognition: Implementation

Figure 4: Detailed workflow of the coarse rotation correction.

Figure 5: Overview of gray-scale conversion, application of CLAHE and cropping of the fingerprint Region Of Interest (ROI). This process isexecuted on every separated finger.

pixels and calculate a rotation angle from this coordinate.Figure 4 illustrates this method.

After the coarse rotation the fingertips are separated.To this end, the amount of contours of considerable sizeis compared to a pre-configured value. If there are fewercontours than expected it is most likely that the fingerimages contain part of the palm of the hand. In this casepixels are cut out from the bottom of the image and thesample is tested again. In the case of more considerablecontours, the finger image is discarded in order to avoidprocessing wrong finger-IDs.

An upright rotated hand area does not necessarily meanthat the fingers are accurately rotated because fingers canbe spread. A fine rotation is computed on every finger im-age to correct such cases. Here, a rotated minimal rectan-gle is placed around every dominant contour. This minimalrectangle is then rotated into an upright position.

Additionally, the hight of each finger image needs to bereduced to the area which contains the fingerprint impres-sion. Other works have proposed algorithms which searchfor the first finger knuckle [22, 23]. We implemented a sim-pler method which cuts the hight of the finger image tothe double of its width. In our use case this method leadsto slightly less accurate result but is much more robustagainst outliers.

Touchless fingerprint images captured in different ses-sions or processed by different workflows do not necessarilyhave the same size. The distance between sensor and fingerdefines the scale of the resulting image. For a minutiae-based comparison it is crucial that both samples have thesame size. Moreover, in a touchless-to-touch-based inter-operability scenario the sample size has to be aligned tothe standardized resolution, e.g. 500dpi. Therefore, wenormalize the fingerprint image to a width of 300px. Thissize approximately corresponds to the size touch-based fin-gerprints captured with 500dpi.

Together with the information which hand is captured,an accurate rotation correction also enables a robust iden-tification of the finger ID, e.g. index, middle, ring or pinky

finger.

3.4. Fingerprint Processing

The pre-processed fingerprint image is aligned to resem-ble the impression of a touch-based fingerprint. Figure 5presents the conversion from a finger image to a touchlessfingerprint. We use the Contrast Limited Adaptive His-togram Equalization (CLAHE) on a gray scale convertedfingerprint image to emphasize the ridge-line characteris-tics.

Preliminary experiments showed that the used featureextractor detects many false minutiae at the border regionof touchless fingerprint samples. For this reason, we cropapprox. 15 pixel of the border region. That is, the seg-mentation mask is dilated in order to reduce the size of thefingerprint image.

3.5. Quality Assessment

Quality assessment is a crucial task for touch-basedand touchless fingerprint recognition schemes. We distin-guish between two types of quality assessment: An inte-grated plausibility check at certain points of the processingpipeline and a quality assessment on the final sample.

The integrated plausibility check is an essential precon-dition for a successful completion of an automated recog-nition scheme. It ensures that only samples which passedthe check of a processing stage are handed over to the nextstage. In the proposed pre-processing pipeline we imple-ment three plausibility checks:

• Segmentation: Analysis of the dominant componentsin the binary mask. Here the amount of dominantcontours as well as their shape, size and position areanalyzed. Also, the relative positions to each other areinspected.

• Capturing: Evaluation of the fingerprint sharpness. ASobel filter evaluates the sharpness of the processedgray scale fingerprint image. A square of 32×32 pixelsat the center of the image is considered. A histogramanalysis then assesses the sharpness of the image.

4

Page 5: Mobile Touchless Fingerprint Recognition: Implementation

(a) Box setup (b) Tripod setup (c) Touch-based capturing device

Figure 6: Capturing device setups during our experiments.

Table 2: Overview on selected recognition workflows with biometric performance.Type Setup Device Subjects captured Rounds Samples

Touchless Box Google Pixel 4 28 2 448Touchless Tripod Huawei P20 Pro 28 2 448

Touch-based – Crossmatch Guardian 100 29 2 464

• Rotation, Cropping: Assessment of the fingerprintsize. The size of the fingerprint image after the crop-ping stage shows if the fingerprint image is of sufficientquality.

The combination of these plausibility checks has shown tobe robust and accurate in our processing pipeline. Everysample passing all three checks is considered as a candi-date for the final sample. For every finger ID five samplesare captured and processed. All five samples are finally as-sessed by NFIQ2.0 and the sample with the highest qualityscore is considered as the final sample. An assessment onthe applicability of NFIQ2.0 on touchless fingerprint pre-sented is shown in [24]. Especially for selecting the bestsample from a series of the same subject, NFIQ2.0 is well-suited.

3.6. Feature Extraction and Comparison

As mentioned earlier, the presented touchless fingerprintprocessing pipeline is designed in a way that obtained fin-gerprints are compatible with existing touch-based minu-tiae extractors and comparators. This enables the appli-cation of existing feature extraction and comparator mod-ules within the proposed pipeline and facilitates a touch-based-to-touchless fingerprint comparison. Details of theemployed feature extractor and comparator are providedin Section 5.

4. Experimental Setup

To benchmark our implemented app we conducted a dataacquisition along with a usability study. Each volunteeringsubject first participated in a data acquisition session andthen was asked to answer a questionnaire.

4.1. Database Acquisition

For the capturing of touchless samples two different se-tups were used: Firstly, a box-setup simulates a predictabledark environment. Nevertheless, the subject was still able

Age0

5

10

15

20

25Amou

ntof

subjects

20 – 24 25 – 29 30 – 3435 – 39 > 40

(a) Age distribution

Skin color types0

5

10

15

20

25

Amou

ntof

subjects

1 2 34 5 6

(b) Skin color distribution

Figure 7: Distribution of age and skin color according to Fitzpatrickmetric [25] of the subjects.

to place their fingers freely. Secondly, a tripod-setup sim-ulates a fully free capturing setup where the instructor orthe subject holds the capturing device 3.

For the touchless database capturing we used two differ-ent Smartphones: the Huawei P20 Pro (tripod setup) andthe Google Pixel 4 (box setup). The finger images are cap-tured with the highest possible resolution. The flashlightwas turned on during the capturing process by default.

Also, touch-based samples were captured to compare theresults of the proposed setup against an established system.On every capturing device the four inner hand fingers (fin-ger IDs 2 – 5 and 7 – 10 according to ISO/IEC 19794-4[26])were captured. The capturing of with three capturing de-vices shown in Figure 6 was conducted in two rounds.

To measure the biometric performance of the proposedsystem, we captured a database of 29 subjects. The ageand skin color distribution can be seen in Figure 7. Ta-ble 2 summarizes the database capturing method. Duringthe capturing of one subject, Failure-To-Acquire (FTA) er-rors according to ISO/IEC 19795-1 [27] occurred on both

3The capture subjects handled the capturing devices without in-teraction of the instructor. This simulates an unattended capturingprocess and fulfilled the hygienic regulations during the database ac-quisition.

5

Page 6: Mobile Touchless Fingerprint Recognition: Implementation

Table 3: Overview on the NFIQ2.0 quality scores and the EER of allcaptured fingers (finger IDs 2 – 5 and 7 – 10) separated by sensors.

Capturing device SubsetAvg. NFIQ2.0

scoreEER (%)

Touchless Box all fingers 44.80 (± 13.51) 10.71Touchless Tripod all fingers 36.15 (± 14.45) 30.41

Touch-based all fingers 38.15 (± 19.33 ) 8.19

0 0.2 0.4 0.6 0.8 1

0

0.2

0.4

0.6

0.8

1

FMR

FNMR

Touchless BoxTouchless TripodTouch-based

(a) DET curves

0 20 40 60 80 1000

1

2

3

4

5·10−2

NFIQ2.0 score

prob

ability

Touchless BoxTouchless TripodTouch-based

(b) Probability density functionsof NFIQ2.0 scores

Figure 8: NFIQ2.0 score distribution and biometric performance ob-tained from single finger comparisons.

touchless capturing devices. Interestingly, this was mostlikely caused by the length of the subject’s fingernails. Formore information the reader is referred to Section 7.6. Intotal, we captured and processed 1,360 fingerprints.

4.2. Usability Study Design

A usability study was conducted with each subject afterthey had interacted with the capturing devices. Each sub-ject was asked about their individual preferences in termsof hygiene and convenience during the capturing process.Parts of our usability study are based on [28, 14]. We en-sured that the questionnaire is as short and formulated asclearly as possible such that the participants understoodall question correctly [29].

The questionnaire is provided as supplemental material.It contains three parts: The first part contains questionsabout the subject’s personal preferences. The Question1.2b and 1.2c are aligned with Furman et al. [28]. Here thedifferent perceptions for personal hygiene before and duringthe COVID-19 pandemic were asked. The answer optionsof Question 1.5 were rated by the capture subjects using theRohrmann scale [30] (strongly disagree, fairly disagree, un-decided, fairly agree, strongly agree). The questions wereintended to find out the subjects’ perception regarding hy-gienic concerns during the fingerprint capturing process.

The second part of the questionnaire contains questionsabout the dedicated usability of a capturing device. Thesame questions were answered by the subject for both de-vices. This part was designed so that the same ques-tions for both capturing devices were asked separately fromeach other in blocks. The intention behind this is to con-duct comparisons between the different capturing devices.Again, the Rohrman scale was used and sub-questions werearranged randomly. In the last part of the questionnaire,the subjects were asked about the personal preference be-tween both capturing devices. Here, the subjects had tochoose one preferred capturing device.

Table 4: Overview on the NFIQ2.0 quality scores and the EER ofindividual fingers: index fingers (IDs 2, 7), middle fingers (IDs 3, 8),ring fingers (IDs 4, 9) and little fingers (IDs 5, 10).

Capturingdevice

FingersAvg. NFIQ2.0

scoreEER(%)

Touchless Box index fingers 53.16 (± 11.27) 7.14Touchless Box middle fingers 45.59 (± 11.06) 8.91Touchless Box ring fingers 41.57 (± 12.89) 7.14Touchless Box little fingers 38.88 (± 14.21) 21.43

Touchless Tripod index fingers 41.38 (± 14.29) 21.81Touchless Tripod middle fingers 36.68 (± 13.01) 28.58Touchless Tripod ring fingers 34.68 (± 14.28) 29.62Touchless Tripod little fingers 31.79 (± 14.63) 38.98

Touch-based index fingers 44.06 (± 17.53 ) 8.62Touch-based middle fingers 41.08 (± 19.71 ) 1.72Touch-based ring fingers 37.68 (± 17.08 ) 6.90Touch-based little fingers 29.78 (± 19.94 ) 13.79

Table 5: Overview on the EER in a fingerprint fusion approach: Fu-sion over the 4 inner-hand fingers of the left hand (IDs 2 – 4) andright hand (IDs 7 – 10) fusing and fusion over 8 fingers of both innerhands (IDs: 2 – 4, 7 – 10).

Capturing device Fusion approach EER (%)Touchless Box 4 fingers 5.36Touchless Box 8 fingers 0.00

Touchless Tripod 4 fingers 21.42Touchless Tripod 8 fingers 14.29

Touch-based 4 finger 2.22Touch-based 8 finger 0.00

5. Results

This section presents the biometric performance achievedby the entire recognition pipeline and the outcome of ourusability study.

5.1. Biometric Performance

In our experiments, we first estimate the distributions ofNFIQ2.0 scores for the captured data set. Additionally, thebiometric performance is evaluated employing open-sourcefingerprint recognition systems. The features (minutiaetriplets – 2-D location and angle) are extracted using aneural network-based approach. In particular, the featureextraction method of Tang et al. [31] is employed. For thisfeature extractor pre-trained models are made available bythe authors. To compare extracted templates, a minutiaepairing and scoring algorithm of the sourceAFIS system ofVazan [32] is used4.

In a first experiment, we compare the biometric perfor-mance on all fingers between the different sub data sets.From the Table 3 we can see that the touchless box setupobtains an Equal Error Rate (EER) of 10.71% which iscomparable to the touch-based setup (8.19%). Figure 8(a) presents the corresponding Detection Error Trade-Off(DET) curve whereas Figure 8 (b) shows the probabilitydensity functions of NFIQ2.0 scores. In contrast, the per-formance of the open setup massively drops to an EER of30.41%. The corresponding NFIQ2.0 scores do not reflect

4The original algorithm uses minutiae quadruplets, i.e. addition-ally considers the minutiae type (e.g. ridge ending or bifurcation).Since only minutiae triplets are extracted by the used minutiae ex-tractors, the algorithm has been modified to ignore the type informa-tion.

6

Page 7: Mobile Touchless Fingerprint Recognition: Implementation

0 0.2 0.4 0.6 0.8 1

0

0.2

0.4

0.6

0.8

1

FMR

FNMR

IndexMiddleRingLittle

(a) Touchless box setup

0 0.2 0.4 0.6 0.8 1

0

0.2

0.4

0.6

0.8

1

FMR

FNMR

IndexMiddleRingPinky

(b) Touchless tripod setup

0 0.2 0.4 0.6 0.8 1

0

0.2

0.4

0.6

0.8

1

FMR

FNMR

IndexMiddleRingLittle

(c) Touch-based setup

Figure 9: DET curves obtained from individual finger comparisons: index fingers (IDs 2, 7), middle fingers (IDs 3, 8), ring fingers (IDs 4, 9)and little fingers (IDs 5, 10).

Crossmatch Google Pixel 4 Huawei P20 Pro0

10

20

30

40

50

60

avg

.NF

IQ2.

0S

core

all fingers index fingers middle fingersring fingers little fingers

Figure 10: Averaged NFIQ2.0 scores obtained from the considereddatabases: average over all fingers (IDs 2 – 4, 6 – 10), index fingers(IDs 2, 7), middle fingers (IDs 3, 8), ring fingers (IDs 4, 9) and littlefingers (IDs 5, 10).

0 0.2 0.4 0.6 0.8 1

0

0.2

0.4

0.6

0.8

1

FMR

FNMR

Touchless BoxTouchless TripodTouch-based

(a) Fusion over 4 fingers

0 0.2 0.4 0.6 0.8 1

0

0.2

0.4

0.6

0.8

1

FMR

FNMR

Touchless BoxTouchless TripodTouch-based

(b) Fusion over 8 fingers

Figure 11: DET curves obtained in a fingerprint fusion approach:Fusion over the 4 inner-hand fingers of the left hand (IDs 2 – 4) andright hand (IDs 7 – 10) fusing (a) and fusion over 8 fingers of bothinner hands (IDs: 2 – 4, 7 – 10) (b).

this drop in terms of EER. Here, all three data sets have acomparable average score.

In a second experiment, we compute the biometric per-formance for every finger separately5. From Table 4 andFigure 9 we can see that on all subsets the performance ofthe little finger drops compared to the other fingers. Onthe touch-based sub data set the middle finger has a muchlower EER (1.72%) than the rest. This could be becauseit might be easiest for users to apply the correct pressureto the middle finger. From Figure 10 it is observable thatthere is only a small drop of NFIQ2.0 quality scores on thelittle finger.

Further we applied a score level fusion on 4 and 8 fingers.Obtained EERs are summarized in Table 5. As expected,

5In this experiment we consider only the same finger IDs from adifferent subject as false match.

Table 6: Overview on the interoperability of different subset of thecollected data: Comparison of fingerprints captured with different se-tups. All captured fingers (finger IDs 2 – 5 and 7 – 10) are considered.

Device A Device B EER (%)Touchless Box Touchless Tripod 27.27Touchless Box Touch-based 15.71

Touchless Tripod Touch-based 32.02

0 0.2 0.4 0.6 0.8 1

0

0.2

0.4

0.6

0.8

1

FMR

FNMR

Touchless Tripod – Touch-basedTouchless Box – Touchless TripodTouchless Box – Touch-based

Figure 12: DET curves obtained from the interoperability of differentsubset of the collected data: Comparison of fingerprints captured withdifferent setups. All captured fingers (finger IDs 2 – 5 and 7 – 10) areconsidered.

the fusion improves the EER on all sub data sets. In partic-ular, the fusion of 8 fingers shows a huge performance gain(see Figure 11). The box setup and the touch-based sensorshow an EER of 0% which means that matches and non-matches are completely separated. The open setup alsoachieves a considerably high performance gain trough thefusion. Here, the inclusion of all fingers makes the processmuch more robust especially in challenging environmentalsituations.

In our last experiment we analyze the interoperabilitybetween the different subsets of the collected data. Table 6summarizes the EERs achieved by comparing the samplesof different setups and Figure 12 presents the correspond-ing DET curves. The touchless box setup shows a goodinteroperability to the touch-based setup (15.71%). TheEER of the open setup again significantly drops (27.27%to touchless box and 32.02% to touch-based).

It should be noted, that all data sets, touchless as well astouch-based show a biometric performance which is inferiorcompared to the state-of-the-art. This is caused mainly bytwo reasons: On the one hand, all data sets were capturedunder realistic scenarios. The amount of instructions givento the capturing subject were limited to a minimum. Fur-ther, no re-capturing of poor quality samples took place.On the other hand, hygienic measures have an impact on

7

Page 8: Mobile Touchless Fingerprint Recognition: Implementation

(1)

stro

ngly

disagr

ee

(2)

fairl

ydisa

gree

(3)

undecid

ed

(4)

fairl

yag

ree

(5)

stro

ngly

agre

e

No. 1.5a: I am generally skeptical about the finger-print technology.

No. 1.5b: I generally have concerns about touchingsurfaces in public places that are often touched byother people.

No. 1.5c: I have major personal hygienic concernsrelated to the Covid19 situation.

all test persons

Figure 13: General assessment on fingerprint technology and hygienic concerns.

(1)

stro

ngly

disagr

ee

(2)

fairl

ydisa

gree

(3)

undecid

ed

(4)

fairl

yag

ree

(5)

stro

ngly

agre

e

No. 2.1a: I think the fingerprint scanner was tooslow.

No. 2.1b: I found it hard to take the right positionfor the recording process.

No. 2.1c: I found it hard to keep the position for therecording process.

No. 2.1d: I always knew if the recording process wasin progress.

No. 2.1e: I would consider using this capturing devicein public places.

No. 2.1f: I found the recording process comfortable.

No. 2.1g: I have hygienic concerns about using thecapturing device.

touchless capturing device touch-based capturing device

Figure 14: Usability assessment of the touchless and touch-based capturing device in comparison to each other.

biometric performance which is discussed in detail in Sec-tion 6.

5.2. Usability Study

We present the results of our usability study based onthe questionnaire introduced in Section 4.2. The question-naire was answered by 27 subjects (8 female, 19 male).The subjects were between 22 and 60 years old (averageage: 31.22 years, median age: 28 years). The age distribu-tion is presented in Figure 7. The exact result in terms ofmedian and standard deviation is provided as supplementalmaterial. The majority of subjects have used professionalfingerprint scanners before this study. A large proportionof the data subjects also use any type of fingerprint captur-ing device regularly at least once per week, e.g. to unlockmobile devices.

Figure 13 presents the perceptions of the subjects regard-ing general hygiene. The subjects tend to have general con-cerns about touching surfaces in public places (Statement1.5b). Moreover, the majority has personal concerns re-

lated to the COVID-19 pandemic (Statement 1.5c). Fromthe small difference in terms of perception before and dur-ing the COVID-19 pandemic it can be observed that thepandemic has only a small influence on the general hygienicawareness of the tested subjects.

The usability assessment of the touchless and touch-based capturing devices is presented in Figure 14. In moststatements, both capturing devices were rated fairly simi-lar. The touchless capturing device has a slight advantagein terms of capturing speed (Statement 2.1a). The touch-based capturing device tends to be rated better in takingand keeping the capturing position during the whole pro-cess (Statements 2.1b and 2.1c). Also, the subjects found itslightly easier to assess if the capturing process is running(Statement 2.1d). Moreover, it can be observed that thesubjects highly prefer the comfort of the touchless device(Statement 2.1f). Most notably, the subjects have muchless hygienic concerns using the touchless device in publicplaces (Statements 2.1.e and 2.1g). In these cases, a U-Test[33] shows a two-sided significance with a level of α = 5%.

8

Page 9: Mobile Touchless Fingerprint Recognition: Implementation

0 10 20 30 40 50 60 70 80 90 100

No. 3.2: Which type of sensor wouldyou prefer for hygiene reasons?

No. 3.1: Which sensor would you preferregarding its usability?

avg. approval in %

touch based sensor touchless sensor

Figure 15: Comparative assessment of the capturing device type preference.

(a) Before COVID-19 (b) During COVID-19 (c) Finger image (d) Touchless sample

Figure 16: Four samples of the same subject: Sample (a) was captured before the COVID-19 pandemic using a touch-based capturing devicewhereas samples (b – d) were captured during the COVID-19 pandemic. Sample (a) and (b) were captured with the same capturing devicewhereas (c) and (d) are captured and processed using our method.

Figure 15 illustrates the comparative results. In a di-rect comparison of the different capturing device types theadvantage of hygiene outweighs the disadvantages of handpositioning. The slight majority of subjects would preferthe touchless capturing device over a touch-based one interms of general usability (Question 3.1). Considering hy-gienic aspects the vast majority would choose the touchlesscapturing device over the touch-based one (Question 3.2).This highly correlates to the assessment of hygienic con-cerns of the statement 1.5c.

6. Impact of the COVID-19 Pandemic on Finger-print Recognition

The accuracy of some biometric characteristics may benegatively impacted by the COVID-19 pandemic. The pan-demic and its related measures have no direct impact on theoperation of fingerprint recognition. Nevertheless, there areimportant factors that may indirectly reduce the recogni-tion performance and user acceptance of fingerprint recog-nition.

6.1. Impact of Hand Disinfection on Biometric Perfor-mance

The biometric performance drops due to dry and wornout fingertips. Olsen et al. [37] showed that the level of

moisture has a significant impact on the biometric per-formance of touch-based fingerprint recognition systems.The authors tested five capturing devices with normal, wetand dry fingers. Especially dry fingers have been shown tobe challenging. Also, medical studies have shown that afrequent hand disinfection causes dermatological problems[38, 39]. The disinfection liquids dry out the skin and causechaps in the epidermis and dermis.

Thus, we can infer that the regular hand disinfectionleads to two interconnected problems which reduce therecognition performance: Dry fingers show low contrastduring the capturing due to insufficient moisture. In addi-tion, disinfection liquids lead to chaps on the finger surface.Figure 16 shows touch-based fingerprints captured beforethe COVID-19 pandemic (a) and during the COVID-19pandemic (b). Both samples were captured from the samesubject using the same capturing device. It is observablethat the sample (b) exhibits more impairments in the ridge-line pattern compared to sample (a). Moreover, the fingerimage (c) clearly shows chaps in the finger surface which arelikely caused by hygienic measures. The processed touch-less sample (d) shows these impairments, too.

Table 7 summarizes the biometric performance achievedon different databases using the proposed recognitionpipeline. We can see that the biometric performance onthe fingerprint subcorpus of the MCYT bimodal database[34] and the Fingerprint Verification Contest 2006 (FVC06)

9

Page 10: Mobile Touchless Fingerprint Recognition: Implementation

Table 7: Average NFIQ2.0 scores and biometric performance obtained from touchless and touch-based databases including the fingerprintsubcorpus of the MCYT Database [34], the FVC2006 Database [35], the Hong Kong Polytechnic University Contactless 2D to Contact-based2D Fingerprint Images Database Version 1.0 [36].

Database Subset Avg. NFIQ2.0 score EER (%)

MCYTdp 37.58 (±15.17) 0.48pb 33.02 (±13.99) 1.35

FVC06 DB2-A 36.07 (±9.07) 0.15

PolyUContactless Session 1 47.71 (±10.86) 3.91Contactless Session 2 47.08 (±13.21) 3.17

Our databaseTouch-based 38.15 (± 19.33 ) 8.19

Touchless Box 44.80 (± 13.51) 10.71

[35] show a good performance. Moreover, the touchless sub-set of the Hong Kong Polytechnic University Contactless2D to Contact-based 2D Fingerprint Images Database Ver-sion 1.0 (PolyU) [36] shows an competitive performance of3.50% EER. Compared to these baselines the performanceachieved on our database is inferior which is most likely theimpact of the unconstrained acquisition scenario as well asthe use of hand disinfection measures.

6.2. User Acceptance

Viruses, e.g. SARS-CoV-2, have four main transmissionroutes: droplet, airborne, direct contact, and indirect con-tact via surfaces. In the last case an infected individualcontaminates a surface by touching it. A susceptible indi-vidual who touches the surface afterwards has a high risk ofinfection via this indirect transmission route. Otter et al.[40] present an overview on the transmission of differentviruses (including SARS coronaviruses) via dry surfaces.The authors conclude that SARS coronaviruses can sur-vive for extended periods on surfaces and for this reasonform a high risk of infection.

Especially in large scale implementations e.g. the Schen-gen Entry/Exit System (EES) [41] were many individualstouch the surface of a capturing device, the users are ex-posed to a major risk of infection. The only way of a safetouch-based fingerprint recognition in such application sce-narios is to apply a disinfection of the capturing device afterevery subject.

Nevertheless, the requirement of touching a surface canlower the user acceptance of touch-based fingerprint recog-nition. The results of our usability studies in Subsection 5.2show that the asked individuals are fairly skeptical abouttouching capturing device surfaces in public places andthat (in a direct comparison) they would prefer a touchlesscapturing device. For this reason the touchless capturingschemes could lead to a higher user acceptance. However,it should be noted that our tested group was very smalland user acceptance is dependent to the capturing devicedesign.

7. Implementation Aspects

This section summarizes aspects which are consideredbeneficial for a practical implementation.

7.1. Four-Finger Capturing

As it has been shown in previous works, our proposedrecognition pipeline demonstrates that it is possible to pro-cess four fingerprints from a continuous stream of input im-

ages. This requires a more elaborated processing but hastwo major advantages:

• Faster and more accurate recognition process: Due toa larger proportion of finger area in the image, focusingalgorithms work more precisely. This results in lessmiss-focusing and segmentation issues.

• Improved biometric performance: The direct captur-ing of four fingerprints in one single capturing attemptis highly suitable for biometric fusion. As show in Ta-ble 5 this lowers the EER without any additional cap-turing and very little additional processing.

However, a major obstacle for touchless schemes is tocapture the thumbs accurately and conveniently. In mostenvironments, the best results are achieved with the inner-hand fingers facing upwards. This is ergonomically hard toachieve with thumbs.

7.2. Automatic Capturing and On-Device Processing

State-of-the-art smartphones feature powerful processingunits which are capable to execute the described processingpipeline in a reasonable amount of time. We have shownthat a robust and convenient capturing relies on an auto-matic capturing with integrated plausibility checks. Also,the amount of data which has to be transferred to a remoterecognition workflow is reduced by an on-device processingand the recognition workflow can be based on standardcomponents.

Especially in a biometric authentication scenario, it canbe beneficial to integrate the feature extraction and com-parison into the mobile device. In this case, an authenti-cation of a previously enrolled subject can be implementedon a stand-alone device.

7.3. Environmental Influences

Touchless fingerprint recognition in unconstrained envi-ronmental situations may be negatively affected by vary-ing and heterogeneous influences. In our experiments, weshowed that our touchless setup performs rather good un-der a semi-controlled environment. The performance ofthe same recognition pipeline drastically drops in an un-controlled environment. Here, it is observable that differ-ent stages of the processing pipeline suffer from challengingenvironments:

• Focusing of the hand area needs to be very accurateand fast in order to provide sharp finger images. Here,a focus point which is missed by a few millimeterscauses a blurred and unusable image. Figure 17(a, d)

10

Page 11: Mobile Touchless Fingerprint Recognition: Implementation

(a) Sharpness assessment input (b) Segmentation input (c) CLAHE input

(d) Sharpness assessment result (e) Segmentation result (f) CLAHE result

Figure 17: Illustration of accurate and challenging input images and corresponding result images for sharpness assessment (a, d), segmentation(b, e) and contrast adjustment (c, f). The left images of each block represent an accurate images the right one a challenging one.

illustrate the difference between a sharp finger imageand a slightly de-focused image with help of a Sobelfilter. Additionally, the focus has to follow the handmovement in order to achieve a continuous stream ofsharp images. The focus of our tested devices tend tofail under challenging illuminations which was not thecase in the constrained environment.

• Segmentation, rotation and finger separation rely ona binary mask in which the hand area is clearly sepa-rated from the background. Figure 17(b, e) show ex-amples of a successful and unsuccessful segmentation.Impurities in the segmentation mask lead to connectedareas between the fingertips and artifacts at the borderregion of the image. This causes inaccurate detectionand separation of the fingertips and incorrect rotationresults. Because of heterogeneous background this inmore often the case in unconstrained setups.

• Finger image enhancement using the CLAHE algo-rithm normalizes dark and bright areas on the fingerimage. From Figure 17(c, e) we can see that this alsoworks on samples of high contrast. Nevertheless, theresults on challenging images may become more blurry.

The discussed challenges lead to a longer capturing timeand for this reason lower the usability and user acceptance.Further, the recognition performance in unconstrained en-vironments is limited. Here, a weighing between usabilityand performance should be done based on the intended usecase of the capturing device. The quality assessments im-plemented in our scheme detect these circumstances anddiscard finger images with said shortcomings. More elabo-rated methods could directly adapt to challenging images,

Figure 18: Illustration of a minutiae-based comparison of two touch-less fingerprint samples. The features are extracted using the methoddescribed in Section 4. The blue lines indicate mated minutiae.

e.g. by changing the focusing method or segmentationscheme. This approach could lead to more robustness andhence improved usability in different environments.

7.4. Feature Extraction Strategies

Feature extraction techniques are vital to achieve a highbiometric performance. In our experiments, we used anopen-source feature extractor which is able to processtouch-based and touchless samples. Figure 18 shows anexample of this minutiae-based feature extraction and com-parison scheme. With this method we were able to test theinteroperability between capturing device types. Neverthe-less, the overall performance may be improved by more so-

11

Page 12: Mobile Touchless Fingerprint Recognition: Implementation

phisticated methods, e.g. commercial of-the-shelf-systemslike the VeriFinger SDK [42].

Touchless fingerprint images do not correspond to thestandardized 500dpi resolution of touch-based capturingdevices because of a varying distance between capturingdevice and finger. Here a feature extractor which is robustagainst these resolution differences or a dedicated process-ing step is beneficial.

Also, dedicated touchless feature extraction methods canincrease the performance as shown in [11, 43]. Here the au-thors are able to tune their feature extractor to their cap-turing and processing and propose an end-to-end recogni-tion system.

7.5. Visual Instruction

According to the presented results in Subsection 5.2, thevisual feedback of the touchless capturing device have alsobeen rated to be inferior compared to the touch-based one.Here the smartphone display is well-suited to show furtherinformation about the capturing process. Additionally, anactionable feedback can be given on the positioning of thefingers, as suggested in [12].

7.6. Robust Capturing of different Skin Colors and FingerCharacteristics

An important implementation aspect of biometric sys-tems is that they must not discriminate certain user groupsbased on skin color or other characteristics. During ourdatabase capturing subjects of different skin color typeswere successfully captured. Nevertheless, it must be notedthat the amount of subjects is too small to make a generalstatement about the fairness of the presented approach.

As already mentioned in Section 4.1, we observed onesingle failure to acquire (FTA) during our database acqui-sition. Most likely the cause for this was that the subjecthad very long fingernails which were segmented as fingerarea. Here the plausibility check during the segmentationfailed and a capturing of the subject was not possible. Toovercome this flaw a fingernail detection could be imple-mented in the segmentation workflow.

8. Conclusion

In this work, we proposed a fingerprint recognition work-flow for state-of-the-art smartphones. The method is ableto automatically capture the four inner-hand fingers of asubject and process them to separated fingerprint images.With this scheme we captured a database of 1,360 finger-prints from 29 subjects. Here we used two different setups:a box setup with constrained environmental influences anda tripod setup. Additionally, we captured touch-based fin-gerprints as baseline. During a usability study after thecapturing the subjects were asked about their experiencewith the different capturing device types.

Our investigations show that the overall biometric per-formance of the touchless box setup is comparable to thetouch-based baseline whereas the unconstrained touchlesstripod setup shows inferior results. All setups benefit froma biometric fusion. A further experiment on the interop-erability between touchless and touch-based samples (boxsetup) shows that the performance drops only slightly.

The presented usability study shows that the majorityof users prefer a touchless recognition system over a touch-based one for hygienic reasons. Also, the usability of thetouchless capturing device was seen as slightly better. Nev-ertheless, the user experience of the tested touchless devicescan be further improved.

The COVID-19 pandemic also has an influence on theperformance and acceptance of fingerprint recognition sys-tems. Here hygienic measures lower the recognition perfor-mance and users are more concerned touching surfaces inpublic areas.

Our proposed method forms a baseline for a mobile auto-matic touchless fingerprint recognition system and is madepublicly available. Researchers are encouraged to integratetheir algorithms into our system and contribute to an moreaccurate, robust and secure touchless fingerprint recogni-tion scheme.

Acknowledgments

The authors acknowledge the financial support by theFederal Ministry of Education and Research of Germanyin the framework of MEDIAN (FKZ 13N14798). This re-search work has been partially funded by the German Fed-eral Ministry of Education and Research and the HessianMinistry of Higher Education, Research, Science and theArts within their joint support of the National ResearchCenter for Applied Cybersecurity ATHENE.

References

[1] K. Okereafor, I. Ekong, I. Okon Markson, K. Enwere, Fin-gerprint Biometric System Hygiene and the Risk of COVID-19 Transmission, JMIR Biomedical Engineering 5 (1) (2020)e19623. doi:10.2196/19623.URL http://biomedeng.jmir.org/2020/1/e19623/

[2] B. Y. Hiew, A. B. J. Teoh, Y. H. Pang, Digital camera basedfingerprint recognition, in: International Conference on Telecom-munications and Malaysia International Conference on Commu-nications, 2007, pp. 676–681.

[3] V. Piuri, F. Scotti, Fingerprint Biometrics via Low-cost captur-ing devices and Webcams, in: Second International Conferenceon Biometrics: Theory, Applications and Systems (BTAS), 2008,pp. 1–6.

[4] L. Wang, R. H. A. El-Maksoud, J. M. Sasian, W. P. Kuhn,K. Gee, V. S. Valencia, A novel contactless aliveness-testing (cat)fingerprint capturing device, in: Novel Optical Systems Designand Optimization XII, Vol. 7429, 2009, p. 742915.

[5] A. Kumar, Y. Zhou, Contactless fingerprint identification us-ing level zero features, in: Conference on Computer Vision andPattern Recognition Workshops (CVPRW), 2011, pp. 114–119.

[6] M. O. Derawi, B. Yang, C. Busch, Fingerprint recognition withembedded cameras on mobile phones, in: Security and Privacy inMobile Information and Communication Systems (ICST), 2012,pp. 136–147.

[7] D. Noh, H. Choi, J. Kim, Touchless capturing device capturingfive fingerprint images by one rotating camera, Optical Engi-neering 50 (11) (2011) 113202.

[8] C. Stein, V. Bouatou, C. Busch, Video-based fingerphoto recog-nition with anti-spoofing techniques with smartphone cameras,in: International Conference of the Biometric Special InterestGroup (BIOSIG), 2013, pp. 1–12.

[9] R. Raghavendra, K. B. Raja, J. Surbiryala, C. Busch, A low-costmultimodal biometric capturing device to capture finger vein andfingerprint, IEEE International Joint Conference on Biometrics(2014) 1–7.

[10] K. Tiwari, P. Gupta, A touch-less fingerphoto recognition systemfor mobile hand-held devices, in: International Conference onBiometrics (ICB), 2015, pp. 151–156.

12

Page 13: Mobile Touchless Fingerprint Recognition: Implementation

[11] A. Sankaran, A. Malhotra, A. Mittal, M. Vatsa, R. Singh, Onsmartphone camera based fingerphoto authentication, in: 7th In-ternational Conference on Biometrics Theory, Applications andSystems (BTAS), 2015, pp. 1–7.

[12] L. A. Carney, J. Kane, J. F. Mather, A. Othman, A. G. Simp-son, A. Tavanai, R. A. Tyson, Y. Xue, A multi-finger touchlessfingerprinting system: Mobile fingerphoto and legacy databaseinteroperability, in: 4th International Conference on Biomedicaland Bioinformatics Engineering (ICBBE), 2017, p. 139–147.

[13] D. Deb, T. Chugh, J. Engelsma, K. Cao, N. Nain, J. Kendall,A. K. Jain, Matching fingerphotos to slap fingerprint images,arXiv preprint arXiv:1804.08122 (2018).

[14] A. Weissenfeld, B. Strobl, F. Daubner, Contactless finger andface capturing on a secure handheld embedded device, in:2018 Design, Automation Test in Europe Conference Exhibition(DATE), 2018, pp. 1321–1326.

[15] P. Birajadar, M. Haria, P. Kulkarni, S. Gupta, P. Joshi,B. Singh, V. Gadre, Towards smartphone-based touchless fin-gerprint recognition, Sadhana 44 (7) (2019) 161.

[16] Y. Chen, G. Parziale, E. Diaz-Santana, A. K. Jain, 3d touch-less fingerprints: compatibility with legacy rolled images, in:Biometric Consortium Conference, 2006 Biometrics Symposium:Special Session on Research at the, 2006, pp. 1–6.

[17] J. Priesnitz, C. Rathgeb, N. Buchmann, C. Busch, An overviewof touchless 2d fingerprint recognition, EURASIP Journal onImage and Video Processing 2021 (2021) 25.

[18] B. Y. Hiew, A. B. J. Teoh, D. C. L. Ngo, Automatic Digital Cam-era Based Fingerprint Image Preprocessing, in: InternationalConference on Computer Graphics, Imaging and Visualisation(CGIV), 2006, pp. 182–189.

[19] D. S. Sisodia, T. Vandana, M. Choudhary, A conglomerate tech-nique for finger print recognition using phone camera capturedimages, in: International Conference on Power, Control, Sig-nals and Instrumentation Engineering (ICPCSI), 2017, pp. 2740–2746.

[20] K. Wang, H. Cui, Y. Cao, X. Xing, R. Zhang, A preprocessingalgorithm for touchless fingerprint images, in: Biometric Recog-nition, 2016, pp. 224–234.

[21] A. Malhotra, A. Sankaran, A. Mittal, M. Vatsa, R. Singh, Chap-ter 6 - fingerphoto authentication using smartphone cameracaptured under varying environmental conditions, in: HumanRecognition in Unconstrained Environments, 2017, pp. 119 –144.

[22] R. Raghavendra, C. Busch, B. Yang, Scaling-robust fingerprintverification with smartphone camera in real-life scenarios, in:Sixth International Conference on Biometrics: Theory, Applica-tions and Systems (BTAS), 2013, pp. 1–8.

[23] C. Stein, C. Nickel, C. Busch, Fingerphoto recognition withsmartphone cameras, in: International Conference of BiometricsSpecial Interest Group (BIOSIG), 2012, pp. 1–12.

[24] J. Priesnitz, C. Rathgeb, N. Buchmann, C. Busch, Touchlessfingerprint sample quality: Prerequisites for the applicability ofnfiq2. 0, in: International Conference of the Biometrics SpecialInterest Group (BIOSIG), 2020, pp. 1–5.

[25] T. B. Fitzpatrick, The Validity and Practicality of Sun-ReactiveSkin Types I Through VI, Archives of Dermatology 124 (6)(1988) 869–871.

[26] ISO, ISO/IEC 19794-4:2011: Information technology – Biomet-ric data interchange formats – Part 4: Finger image data, Stan-dard, International Organization for Standardization (2011).

[27] I. ISO, Iec 19795-1: Information technology–biometric perfor-mance testing and reporting-part 1: Principles and framework,ISO/IEC, Editor 1 (3) (2006) 5.

[28] S. M. Furman, B. C. Stanton, M. F. Theofanos, J. M. Lib-ert, J. D. Grantham, Contactless fingerprint devices usabilitytest, Tech. Rep. NIST IR 8171, National Institute of Stan-dards and Technology, Gaithersburg, MD (Mar. 2017). doi:

10.6028/NIST.IR.8171.URL https://nvlpubs.nist.gov/nistpubs/ir/2017/NIST.IR.

8171.pdf

[29] R. Porst, Fragebogen: ein Arbeitsbuch, 4th Edition, Studien-skripten zur Soziologie, Springer VS, Wiesbaden, 2014, oCLC:870294421.

[30] B. Rohrmann, Empirische Studien zur Entwicklung vonAntwortskalen fur die sozialwissenschaftliche Forschung,Zeitschrift fur Sozialpsychologie 9 (3) (1978) 222–245.

[31] Y. Tang, F. Gao, J. Feng, Y. Liu, FingerNet: An unified deepnetwork for fingerprint minutiae extraction, in: InternationalJoint Conference on Biometrics (IJCB), IEEE, 2017, pp. 108–116.

[32] R. Vazan, SourceAFIS – opensource fingerprint matcher,https://sourceafis.machinezoo.com/, last accessed: March 5,2021(2019).

[33] H. B. Mann, D. R. Whitney, On a Test of Whether one of TwoRandom Variables is Stochastically Larger than the Other, TheAnnals of Mathematical Statistics 18 (1) (1947) 50–60.URL www.jstor.org/stable/2236101

[34] J. Ortega-Garcia, J. Fierrez-Aguilar, D. Simon, J. Gonzalez,M. Faundez-Zanuy, V. Espinosa, A. Satue, I. Hernaez, J. .Igarza, C. Vivaracho, D. Escudero, Q. . Moro, Mcyt baselinecorpus: a bimodal biometric database, IEE Proceedings - Vi-sion, Image and Signal Processing 150 (6) (2003) 395–401.

[35] R. Cappelli, M. Ferrara, A. Franco, D. Maltoni, Fingerprint ver-ification competition 2006, Biometric Technology Today 15 (7-8)(2007) 7–9.

[36] A. Kumar, The Hong Kong Polytechnic University Contactless2D to Contact-based 2D Fingerprint Images Database Version1.0 (2017).URL http://www4.comp.polyu.edu.hk/csajaykr/

fingerprint.htm

[37] M. A. Olsen, M. Dusio, C. Busch, Fingerprint skin moisture im-pact on biometric performance, in: 3rd International Workshopon Biometrics and Forensics (IWBF 2015), 2015, pp. 1–6.

[38] K. A. O’Connell, C. W. Enos, E. Prodanovic, Case Report:Handwashing-Induced Dermatitis During the COVID-19 Pan-demic, American Family Physician 102 (6) (2020) 327–328.

[39] S. W. Tan, C. C. Oh, Contact Dermatitis from Hand HygienePractices in the COVID-19 Pandemic, Annals of the Academyof Medicine, Singapore 49 (9) (2020) 674–676.

[40] J. A. Otter, C. Donskey, S. Yezli, S. Douthwaite, S. D. Gold-enberg, D. J. Weber, Transmission of SARS and MERS coron-aviruses and influenza virus in healthcare settings: the possiblerole of dry surface contamination, Journal of Hospital Infection92 (3) (2016) 235–250.

[41] E. Union, Commission implementing decision (eu) 2019/329 of25 february 2019 laying down the specifications for the quality,resolution and use of fingerprints and facial image for biometricverification and identification in the entry/exit system (ees), Of-ficial Journal of the European Union (2019) 18–28.URL http://data.europa.eu/eli/dec_impl/2019/329/oj

[42] S. VeriFinger, Neuro Technology, VeriFinger, SDK Neuro Tech-nology (2010).

[43] R. Vyas, A. Kumar, A Collaborative Approach using Ridge-Valley Minutiae for More Accurate Contactless Fingerprint Iden-tification, arXiv:1909.06045 [cs, eess] (Sep. 2019).

13