Ever since the onset of covid, the world has heavily been depending on various forms of online communication in order to keep the flow of work going. For the first time ever, we experienced teaching via zoom, Microsoft teams, and various other platforms.
Understanding concepts without visual representation has never been easy and not all teachers or institutions can afford Edupen, iPads, or other annotation software.
Our product aims at building a richer bridge between machines and humans than primitive text user interfaces or even GUIs (graphical user interfaces). It is an alternative user interface for providing real-time data to a computer instead of typing with keys thereby reducing the amount of effort required to communicate over platforms.
When a user opens the Guiding Hand's website they see a button. On clicking the button they are led to our application.
The application uses hand gestures to perform various functions.
a)1 finger to draw on the screen.
b)2 fingers to change pen color or select eraser.
c)3 fingers to take a screenshot.
d)4 fingers to clear the screen.
Our biggest challenge was integrating our Python application with our Reactjs website. To overcome this issue we created a webserver using Flask.
We learned how to create a site in ReactJS, link it to a Flask server that opens up our application that allows a user to draw on the screen using just hand gestures.
Discussion