Reviewing Mobile Augmented Reality App Interaction Methods

For one of our recent tasks, a mobile AR treasure-hunt type revel in that consisted of a chain of mini-video games, we had been challenged to find a manner of interacting with the app that could be more enticing and amusing than a touchscreen interface. Our goal is to show the solutions we believe hold the most promise for mobile augmented reality interactions. But we idea it makes feel to consist of them as nicely considering as you may see, many of them have the ability to be attainable in destiny or are clearly unmistakably cool.

1. Litho

Litho is a totally promising mobile AR controller the preliminary studies confirmed awesome capability, and, considering we advanced our app in Unity and Litho gives an SDK for it, we determined to take it to spherical of our evaluation. The establishment of the SDK became truthful and the imposition of the prototype took quite a short time. Our application can be installed on mobile devices which can then be rented on the spot to allow users.

2. ManoMotion

ManoMotion’s technology has been reviewed with the aid of using Nortek. Nortek is an innovation-driven software agency delivering apps. A mobile AR treasure-hunt kind experience that consisted of a series of mini-games we had been challenged to find a way of interacting with the app that could be greater enticing and fun than a touchscreen interface. The main one is the powerful control position which is the best because it is wide thanks to the field of view of the camera. Since we’re discussing a mobile use case here, it’s even more significant because the tool in our task could be held in a single hand and you could extend the other one thus far before it will become awkward.

3. Google mediapipe hand tracking

Google mediapipe is an open-supply camera-based hand tracking solution, much like ManoMotion, and as such, it stocks equal limitations. In platforms, it helps Android and iOS at the time it did not provide an officially supported Unity SDK.

4. ClayControl

 It seems to cover a wide variety of platforms, including mobile devices and has Unity on the list of compatible software platforms.ClatControl’s website mentions low latency as one of the key promoting points, that is exciting thinking about that answers primarily based totally on cameras and laptops imaginative and prescient generally contain a few degrees of input lag.

5. FingerTrak

 It allows for a continuous pose of the hand that monitors the use of rather small thermal cameras attached to a wristband. On its very own FingerTrak lets in detecting gestures without the sector of view limitation, which affects the opposite camera-primarily based totally solutions. It doesn’t seem like a completed product yet, however it appears to be an interesting technique that would flip out nicely withinside the future.

So is there a way to interact without a touchscreen? Ready for mobile augmented reality production?

Although they’re outside gadgets that keep the user’s hand occupied, they appear to paintings as an accurate entry method that may be very intuitive after a few preliminary being used periods. They already provide this and can be used to control real applications. Using hand detection as the number one input method on your app, plan to spend more time designing the UX. Wearable motion tracking answers like Polhemus and Xsens DOT aren’t designed for mobile interactions, but if sooner or later they evolve in that direction, they could emerge as a feasible alternative to the camera-primarily based totally hand tracking approach, addressing its essential limitations.


Methods of accessing mobile AR technologies are still evolving we imagine it could be over a year before an answer emerges that will replace the touchscreen due to the default interface.