Crunchfish, a Swedish app company, has built software for mobile phones that turns the phone’s camera into a mouse. It’s one of several efforts to bring gesture-control to phones, and an example of how far motion control technology has come in the last few years.


Crunchfish, a Swedish app company, has built software for mobile phones that turns the phone’s camera into a mouse. It allows the phone’s front-facing camera to track a person’s hand movements so he or she doesn’t have to touch the screen. As someone who surfs the web on her handset while eating Chex Mix, this might come in handy (and keep my phone cleaner). It’s also useful for folks wearing gloves.

The Crunchfish gesture control engine also allows for 3-D manipulation of content, although I’m not really able to picture how that works on a flat screen. The software is just a prototype at the moment, and it sounds like handset manufacturers will have to elect to integrate the gesture control with Crunchfish’s existing 3-D rendering engine for cell phones, in order to give developers a chance to take advantage of the motion-control (especially the 3-D part).

Crunchfish isn’t the only one trying to figure out a gesture-controlled UI, and its decision to go after phones seems a bit off. However, as phones get front-facing cameras and have more processing power, the ability to track movements and turn them into commands for the phone could be useful. Samsung has also filed a patent on the topic and a company called Eyesight is trying to bring gesture-controls to tablets.

Mobile tech isn’t the only place motion-control research is targeting; televisions are another popular device. GestureTek, Softkinetic and Canesta (which was purchased by Microsoft) are all working in the television space to enable lazy bums like myself to control our TVs from the couch even if we can’t find a remote.

It may have started with Nintendo’s Wii and graduated all the way up to Microsoft’s Kinect, but gesture controls are moving beyond consoles to help us control the myriad devices around us. Crunchfish may sink or swim, but it’s not alone in its ambitions.

Related content on GigaOM Pro (subscription required):

  1. kudos 2 crunchfish and company 4 trying to make life easier. i am aspiring to establishing a more sensitive company than that in africa(Nigeria).

  2. [...] we can get the better, and this has been a great week for it. First the sdk for Kinect and now more gesture UI badness from Crunchfish. via GigaOm This entry was posted in Uncategorized. Bookmark the permalink. Comments are closed, [...]

  3. Rumor has it that Nokia’s MeeGo related device will have some gestures like you mentioned. I think it brings a whole new range of possibilities to smartphones and applications for them.

  4. I love experimentation with gesture in the user interface. Over the next 2-4 years there will be an explosion of innovation around the user experience including concepts around input methods, interaction and user feedback. We can draw on all of our senses – visual, touch, sounds. Maybe even smell.

    I predict the next 2 years will be focused on 3D and who knows what after that.

  5. [...] Gesture Control Tech For Phones Our member company Crunchfish has built an application for controlling mobile phones with gestures. It’s a prototype at the moment but soon you’ll be able to eat cheese doodles and browse your phone at the same time. (via Hampus Jakobsson) View Comments Omvärld [...]


Comments have been disabled for this post