NoonGil helps visually impaired people to allow them detect object using both the cameras. Read the text for them and also can detect popular places in one go.
NoonGil don't require any button clicks / touches/ swipes on to the frontend. Just the person voice can do the magic.
To solve the problem, we have used NodeJS, Amazon AWS Lambda, AWS API Gateway, Cloud Vision API, ReactJS. At first we have solved the problem of serving the content from the localhost to cloud server by setting up our NodeJS files on serverless. NodeJS files contain API’s to upload images , detect object, and other detections. Then with the help of ReactJS application deployed on Netflify, we can push our payload from camera to cloud and then process the same for our client and the responses are sent back to our frontend in the form of speech that were detected from the camera. This architecture can handle simultaneous requests.
Technologies used
Discussion