In the past few years, we have covered plenty of robots that can easily be controlled with a smartphone. With ManoMotion, you can perform all the gestural analysis with your smartphone to interact with robots. This platform delivers precise hand tracking and gesture recognition. You will simply need the RGB camera of your phone to get started.
ManoMotion has a SDK to allow developers to bring gesture recognition into their own apps. Such a technology can be used for mixed and augmented reality applications. The above video shows how you can use a smartphone to control a robot hand with simple gestures.[Source]