Technological evolution brought computers into our daily life – our cars, homes and smart-phones surround us with information. Ever decreasing sizes of displays and the fact that mobile computers do not receive our full attention require new concepts to interact with these devices.
Automatic speech recognition and text-to-speech technology offer a promising alternative, to substitute or augment the more conventional user interfaces we grew accustomed to. Multi-touch technology is one of the most interesting graphical interaction concepts, gaining popularity with the newer generation of smart phones. The combination of multi-touch and voice recognition has the potential to dramatically speed-up workflows.
But there are challenges that arise when using the modality of voice, as experienced with more traditional deployments in telephony and desktop environments. Nevertheless, they can be met by a profound knowledge about the design of voice user interfaces on the one hand, and the combination of different modalities on the other. In addition, we are investigating how to support the development of multimodal applications in pervasive environments as they can be found in meeting scenarios, while driving with our car or when controlling our homes. Another important aspect that we are researching includes the social aspects or interaction in our home environments.
Dialog concepts for enabling a smart command & control interface via voice in a house environment. In combination with a semantic background information service for assisting the user during discussions. The goal for the user is that the system gives additional topic-related information, but not disturbing the user. The challenge here is find out possibilities for the design of a smart assistant system at home in the future.
The following research question is addressed in the proposed project: How can appropriate IT based means improve participation of the blind in workplace situations that require intense cooperation with the sighted? We plan scientific contributions in the areas of (a) novel interaction devices and (b) novel interaction techniques, combined with research in the area of (c) eAccessibility. Well matching research labs with considerable experience had to be found for each of the areas (a) – (c); they turned out to be spread over all three countries participating in the ‘lead agency’ cooperation line: Switzerland (ETH Zurich), Germany (TU Darmstadt), and Austria (TU Linz).
Research on social interactive television has been more focused on the creation of communication features. In this work, we show that depending on video content, social television has a greater potential to provide feelings of togetherness if real-life relationships are taken into account.
Dr. Dirk Schnelle-Walka, Post-Doctoral researcher
Stefan Radomski, Doctoral Researcher
Stephan Radeck-Arneth, Doctoral Researcher
Niloo Dezfuli, Doctoral researcher
Sebastian Döweling, Doctoral Researcher