User interfaces present one of the most interesting quandaries of modern computing: we’ve moved from big monitors and keyboards to touchscreens, but now we’re heading into a world of connected everyday objects and wearable computing — how will we interact with those? Metaio, the German augmented reality outfit, has an idea.
Augmented reality (AR) involves overlaying virtual imagery and information on top of the real world — you may be familiar with the concept of viewing a magazine page through your phone’s camera and seeing a static ad come to life. Metaio has come up with a way of creating a user interface on pretty much any surface, by combining traditional camera-driven AR with thermal imaging.
Essentially, what Metaio is demonstrating with its new “Thermal Touch” interface concept is an alternative to what a touchscreen does when you touch it — there, capacitive sensors know you’ve touched a certain part because they can sense the electrical charge in your finger; here, an infrared camera senses the residual heat left by your finger. So, for example, you could use smart glass to view a virtual chess board on an empty table, then actually play chess on it:
“Our R&D department had a few thermal cameras that they’d just received and kind of on a whim they started playing around,” Metaio spokesman Trak Lord told me. “One researcher noticed that every time he touched something, it left a very visible heat signature imprint.”
To be clear, a normal camera can do a lot of tracking if it has sufficiently powerful brains behind it – some of the theoretical applications shown off by Metaio on Thursday may be partly achievable without yet another sensor for your tablet or smart glass or whatever. But there’s a limit to what normal cameras can do when it comes to tracking interaction with three-dimensional surfaces. As Lord put it, “the thermal camera adds another dimension of understanding. If you have a [normal] camera it’s not as precise. The thermal imaging camera can very clearly see where exactly you’re touching.”
Metaio has a bunch of fascinating use cases to hand: security keypads that only the user can see; newspaper ads with clickable links; interactive car manuals that show you what you need to know about a component when you touch it. But right now this is just R&D – nobody is putting thermal imaging cameras into their smartphones and wearables just yet, and Lord reckons it will take at least 5 years before this sort of thing comes to market, if it ever does.
For now, this is the equipment needed to realize the concept:
Still, when modern mobile devices are already packing tons of sensors, why not throw in another if it can turn anything into a user interface? Here’s Metaio’s video, showing what Thermal Touch could do: