H

Hello Music

An AR-based cross-platform app that lets you play music without using an actual instrument and be actually able to press keys created through AR.

H

Hello Music

An AR-based cross-platform app that lets you play music without using an actual instrument and be actually able to press keys created through AR.

The problem Hello Music solves

Everyone wants to enjoy playing music but not everyone can buy expensive instruments or is professional enough to do so. What we have come up with is an app that uses Augmented Reality to let you play music without the need of actual instruments. What the app does is that you can place cards labelled with musical notes on a levelled surface and then use your laptop/mobile camera to get all the cards in the frame which are then detected and pressable keys are placed over these cards using Augmented Reality. The user can then press these keys and the corresponding chord is played by the app.

Challenges we ran into

We all are new to AR, so we had to learn the technology and hence implement the app. To implement our AutoPlay mode and sequencer we had to design our own algorithm which could recognize the relative position of the cards and hence play it accordingly.

Technologies used

Discussion