COVID Tools

COVID Tools

Mask and heart beat detector on the web, completely touch free and accurate.

Created on 26th June 2022

COVID Tools

COVID Tools

Mask and heart beat detector on the web, completely touch free and accurate.

The problem COVID Tools solves

We aim to solve the problem of manual mask and heart rate detection with the help of COVID Tools. By making mask and heart beat detection touch-less, we aim to reduce COVID spread.

COVID Tools can detect the heart rate of a person by just the video recording of a person by using Eulerian Magnification Algorithm - data is collected from the forehead over time to estimate the user's heart rate. This is done by measuring average optical intensity in the forehead location in the subimage's green channel alone (a better color mixing ratio may exist, but the blue channel tends to be very noisy) because the forehead and the cheeks have the maximum amount of veins.
Physiological data can be estimated this way thanks to the optical absorption characteristics of (oxy-) haemoglobin (see this paper).
With good lighting and minimal noise due to motion, a stable heartbeat should be isolated in about 15 seconds.

Along with that COVID Tools is fully capable to detect masks and eliminate manual mask checkers in hospitals, stores, malls, etc. preventing COVID spread even further. The 1st model was made to detect face and the 2nd model was made to do binary classification using opencv. Overall, the model was trained on 800 images.

Challenges we ran into

We ran into problems with hosting our models on the web using Flask and passing the webcam data from JavaScript to our Flask backend

Discussion

Builders also viewed

See more projects on Devfolio