Leveraging the Hand Surface as an Eyes-free TV Remote Control

User input on television typically requires a mediator device such as a handheld remote control. While being a well-established interaction paradigm, a handheld device has serious drawbacks: it can be easily misplaced due to its mobility and in case of a touch screen interface, it also requires additional visual attention. Emerging interaction paradigms like 3D mid-air gestures using novel depth sensors such as Microsoft's Kinect aim at overcoming these limitations, but are known to for instance be tiring. In this work, we propose to leverage the hand as an interactive surface for TV remote control. Our contribution is two- fold: (1) How precisely can people touch their hand landmarks without looking at them? (2) How effectively can they map the on-screen UI elements to their hand and touch them without visual attention? Our results show that the hand has the potential to be leveraged for device-less and eyes-free TV remote interaction without any third-party mediator device.

Recommended external content

We have selected external content from YouTube for you and would like to show it to you right here. To do this, you must reveal it with one click. You can hide the external content at any time with another click.

I agree to external content from YouTube being shown to me. This may result in personal data being transmitted to third-party platforms. You can find more information in our Privacy Policy.


  • Niloofar Dezfuli
  • Mohammadreza Khalilbeigi
  • Jochen Huber
  • Max Mühlhäuser


  • Florian Müller
  • Mürat Özkorkmaz
  • Johann Raspasovic