The web app can be used by people to create a virtual bookshelf that they can share with their friends and connect over Twitter. It uses image processing to bulk add multiple books from a pic of the bookshelf.
The challenges we ran into are, implementing proper auth, processing QR data in the client, performing image processing to bulk add multiple books, and getting the books data.
We implemented custom OAuth in express to manage auth and used jsqr to process QR data.
For the task of bulk-adding books from a pic of the shelf, we used azure cognitive services to perform ocr and process the result according to the area of the bounding box to extract the titles of books and further pass the titles to google books API to get the appropriate result.
Technologies used
Discussion