Visualization in Multimodal User Interfaces of Mobile Applications

Abstract

Advanced user interfaces are a crucial factor in the success of mobile information systems employed by different users on a variety of devices. They should provide state-of-the-art visualization and interaction techniques taylored for specific tasks, while at the same time allow flexible deployment of these components on a multitude of (mobile) hardware platforms. Especially visualizations have to adapt to the platform capabilities in order to remain not only effective, but also adequate.
Focus & Context techniques are one way to efficiently make use of displays with
low resolution and size, as are lens techniques. Here, a good tradeoff between
complexity and response time is important. Also, complex inputs are not feasible
on most mobile devices. Simple, straightforward, context-driven interaction
options must be presented to a user. The above can be archieved by integrating a
task model, user (role) and resource models as well as multimodal
interaction facilities such as speech recognition, into the user interface
component of mobile information systems. The talk will report on research on the
above aspects within the M6C project.