The problem Image Recognition Based Passcode Lock(Contactless) solves

As the technology is getting advanced, more and more things are evolving and becoming better and smarter. We have seen lockers and other electronics locks which has keypad on it but in this pandemic situation when no one wants to make contact with the surface or to minimize the contact we have designed such a system that the person has to just show hand gestures and the camera will detect the numbers and according to the passcode it will give the desired output.

Challenges we ran into

The first problem that we encounter was of dataset. There was not much dataset available so for that we have to make our own dataset by taking images. Then training of model was taking a lot of time and as we have to tune many hyperparameters that means we needed to train the model a lot of time and so we decided to train the model on gpu but setting up gpu was not an easy task. After that training was much faster. Then one of the most difficult task was to make connection between python and arduino as arduino works only on C language. For that we searched the net and then found a library of python called PySerial which made this task possible. Apart from that there were many other small issues which we encountered in the coding part but we managed to solve each and every issue.