Grant: Idea to Innovation

The proliferation of lightweight, low-cost, transparent head-worn displays (HWDs), such as the Oculus Rift, the Epson Moverio or Google Glass, makes it possible for users to view information content at all times. Commercially available systems are capable of giving users access to the same content as on mobile devices, and with hands-free operation, through virtual 2D displays that appear to float in the user's field-of-view. However, the practical scope of these current interfaces is narrow due in part to limitations of display configuration. Content is fixed to a single view location occluding the wearer's immediate frontal view with virtual content. This inhibits task switching which comprises more than 30% of all activity on mobile devices. Unlike their handheld counterpart, HWDs need not be limited by physical display constraints. Instead, designers can leverage the 3D capabilities of such devices to appropriate the abundance of space around the display wearer. Multiple virtual windows can appear to 'float' in surrounding space, remaining easily accessible, and without unwanted occlusion. As in real-world multi-monitor environments, we can use virtual windows to partition information by task and by users' current needs. For instance, an on-the-go multitasker might place a map below her line of sight, looking down to consult it only as directions are required. Later, while waiting for the bus, she may place her calendar and a real-time bus schedule side-by-side, viewing each at her leisure with a turn of the head. We call this mobile and user-configurable arrangement of multiple, floating displays the Ethereal Planes interface. We have developed numerous prototypes based on the Ethereal Planes concept. Empirical evidence demonstrates the significant performance gains and user experience with our proposed interface. This I2I grant proposal is aimed at developing a software development kit (SDK) to make it easier for HWD application developers to exploit the benefits of the Ethereal Planes concept. The timely development of our proposed SDK can open the potential to make our platform widely adopted and standard on all HWD applications.