Touch-Display Keyboards and their Integration with Graphical User Interfaces

We introduce Touch-Display Keyboards (TDK) that retain the traditional physical key layout and in addition provide dy- namic display and touch-sensing capability for each key. We demonstrate how TDKs can be seamlessly integrated with graphical user interfaces by extending the graphical output as well as three-state input across the keyboard's surface. TDKs allow the graphical interface to be dynamically distributed across keyboard and display, exploiting both the benefits of physical controls and the flexibility of graphical widgets.