Hover Widgets – Using the Tracking State to Extend the Capabilities

  • Education
  • June 14, 2022
  • 0

Microsoft

Topics: Widget, Gesture, Tracking, Position, Interface

Transcript Excerpt

We introduce hover widgets, which localize interactive widgets for usage in pen-based computing. The icons can then be selected by bringing the pen in touch with the display surface after making basic gestures with the pen well positioned above the display surface. Our hover widgets do not require the use of supplementary barrel buttons or soft keys, which can be inconvenient or unavailable. Instead, they are implemented using the tracking zone of a pen input system, which is the area above a digitized service that can track the location of the pen in typical user interfaces. 

In most user interfaces, the state is used to display the current position of the cursor, as shown here. However, widgets use the pen information in this tracking state to look for specific gestures, as shown here with a hover widget that can be activated by moving the pen right and then up. If this specific gesture is not made, the widget will remain hidden and cannot be activated. If the cursor hits the tunnel walls, the tunnel origin is reset to the current cursor position, ensuring that the hover widget is not elevated. The only exception to these rules is if the first segment of the gesture is too long, in which case the tunnel drags along with the cursor, allowing for scale independent gestures. Similarly, if the second part of the stroke is too long, the hover widget is elevated. Multiple hover widgets can exist side by side. 

Hover widgets in their associated tunnels, each individual hover widget is updated independently, ensuring that it will be activated when its corresponding gesture is made, we have also explored hover widgets with different activation gestures. we activate different other widgets by quickly moving the pen in the shape of a spike in four different directions we have also explored hover widgets with different activation gestures here we activate different other widgets by quickly moving the pen in the shape A spiral-shaped gesture, is another example. Other widgets can be useful for activating localized user interface elements. For example, rather than travelling to the display’s board to select an item from a toolbar menu, the hover widget can be used to display a marking menu. 

By moving right and then up, a tools marking menu appears, which can be considered of as an alternative for the usual ordering toolbar. By going up and then to the left, you can get an edit marking menu that replaces the usual edit menu. The user engages a scrolling tool by moving down to the left. Without repeatedly moving back and forth between the bordering scroll bar, the user may swiftly switch between inking and scrolling. Finally, by scrolling down to the right, the user can engage a right-click tool. This utility can be used to access features related with the right mouse button in normal desktop applications, such as contact sensitive menus where a user is erasing pen strokes on image.

Opening remarks – Reinforcement Learning

Eye Tracking Study of Web Search by People With And Without Dyslexia