Build a Secure Facial ID Application Using the Vonage Video API
In the current global pandemic, many industry verticals have maximized digital adoption to scale productivity and bring effective implementation techniques to serve widespread use cases for their client base. Facial ID has become more prevalent evidencing widespread proliferation of this technology in industry verticals such as:
1.Hospitality (Airlines and hotel management)
- Payment process at hotel check-ins on mobile phone or camera supplied by their vendors
- Flight check-ins and boarding process
- Patient identification where emergency services are needed to help minimize manual paperwork
- Hospital management services, by screening face of doctors, patients and nurse practitioners to avoid miscommunication and provide consistent information to be passed on
- User identification
- Fraud prevention
In all the use cases mentioned above, facial ID can be enabled using the Vonage Video API that will drive contactless services while also protecting your user data and personal information while helping you deliver secure and safe custom solutions.
In this blog post, we will walk you through our Video API using Facial ID. It will only take a few methods and functions for your developers to understand the workflow, including subscribe, detect, identify and match facial ID by personalizing these attributes into their custom solution builds. Our goal is to reduce development time by kicking off with a good head start using our sample code base that is ready to use for facial ID using our opentok platform.
To build a complete facial ID application using our Video API, we use methods and objects as mentioned in our sample code snippet, you can find more information on our opentok reference code integrated with Microsoft face API.
Technologies and Prerequisites
- Opentok JS API
- Microsoft face API
- Requires a developer to have a Vonage Video API account.
Uploading Screenshot of Subscriber Image To the Server
In the appropriate use case mentioned, the customer provides their photograph during the sign up process, which is then stored in the backend. When the customer has joined the video call, we can use the Vonage Video API to grab a screenshot of the customer’s video stream and upload it to the server for face detection.
In the code below, we have used
subscriber.getImgData() to get a screen of the video stream and upload it to the backend.
b64toBlob is a helper method called by sendScreenShot function that converts base64 string into a byte array so we can post it as multipart/form-data to the server.
Identifying FaceID Using Microsoft API To Compare Matched Face ID Results
Detecting FaceID in Opentok
detectFace method runs on the server side. It detects the facial features from a given image and returns an identifier. We call this method twice: first when the image of the customer has uploaded at the time of sign-up (id1) and then with the screenshot from the video stream (id2).
Below is the sample code snippet:
Verifying FaceID in OpenTok
For the last piece of verification, we use the verifyFace() method and pass image IDs id1 and id2 as the inputs. Here, Microsoft face API compares these two faces(id1 & id2), compares the snapshot with the photograph submitted during the sign up process, and provides a result that includes match/mismatch and a score.
The customer solutions team at Vonage API’s primary objective is to enable our developers to cross barriers of innovation by extending development, integration, and support services. We work with our global leaders who share a common goal to achieve sustainable business aiming to become profitable customer-centric enterprises by accelerating your global growth rate.
Part of our accelerated service offering is to minimize your development timeline by providing guided implementation, deployment and best-guided adoption that will help optimize, scale your application and get into the market sooner.
At Vonage, we focus on our core values by placing the customer interest first. With our constant efforts in relentless innovation, we are committed to serving our developer community with the latest and greatest features-enabling you to customize your application to best suit your use case scenarios.
We consistently see an increased spike in our video usage and with our incremental demand for Video, we are more focused on deploying qualified resources to better help and serve you to achieve successful integrations with our partners and us. It is simple to get started with the Vonage Video API, so sign up for your free account and take full advantage of our offering today!