C

Clickable Mouse using Hand Gestures

ComputerVision based mouse using Mediapipe and Autopy libraries for hand feature detection and click feature.

10

The problem Clickable Mouse using Hand Gestures solves

  1. This tool reduces the hardware cost of using an external mouse.
  2. Moreover, it makes the task of using the mouse even more easier and exciting. With just the wave of your hand, you can control the mouse pointer on your system. Also, you can perform a left-click operation by simply tapping your index finger and middle finger.

PS: More advanced versions of this tool may even help us include right-click and scrolling features.

Challenges I ran into

It was really important for the mouse pointer to hover across the entire screen. I encountered that as soon as the hand went outside the range of the camera, the hand wasn't detected and hence the mouse jittered at that point.
After calibrating the mouse pointer with the offsets values I was able to successfully able to get rid of the jitter.

Technologies used

Discussion