"AI is the new electricity, "~ Andrew Ng
For the past few days, I have been working on the integration of this "new electricity" and "AR".
Hand tracking only with the camera is one of the most researched fields in the AR world, surprisingly we have many ML models that can track your hand's 3d position just with the camera but not many implementations of them. There are few products for unity like ManoMotion, but they are OpenCV based therefore, they cant leverage the full power of AI.
So, I integrated Google's Handpose model with the help of TF.js in Unity Technologies Game Engine as it is the most used tool for AR-dev.
The results were quite good even for a low-resolution web-camera, will be working on more models soon.
Integrating tf.js in a unity web build and making it work!
Discussion