Palm-based Remote Control

Leveraging the Hand Surface as an Eyes-free TV Remote Control

User input on television typically requires a mediator device such as a handheld remote control. While being a well-established interaction paradigm, a handheld device has serious drawbacks: it can be easily misplaced due to its mobility and in case of a touch screen interface, it also requires additional visual attention. Emerging interaction paradigms like 3D mid-air gestures using novel depth sensors such as Microsoft's Kinect aim at overcoming these limitations, but are known to for instance be tiring. In this work, we propose to leverage the hand as an interactive surface for TV remote control. Our contribution is two- fold: (1) How precisely can people touch their hand landmarks without looking at them? (2) How effectively can they map the on-screen UI elements to their hand and touch them without visual attention? Our results show that the hand has the potential to be leveraged for device-less and eyes-free TV remote interaction without any third-party mediator device.

Teaser

People

  • Niloofar Dezfuli
  • Mohammadreza Khalilbeigi
  • Jochen Huber
  • Max Mühlhäuser

Students

  • Florian Müller
  • Mürat Özkorkmaz
  • Johann Raspasovic