Windows Learns to Recognize Gestures

Microsoft is developing a new version of Windows, called GWindows, for “Gesture Windows,” which makes it possible to use sign language in addition to a mouse and keyboard to operate the system. With two cameras mounted next to the monitor, the system is able to determine emotions and depth.

As a result the detection of objects is improved and the GWindows system can see more precisely what gestures are being made. The user can use the system to move windows, draw lines and interact with the screen solely through gesturing and without the keyboard or mouse.
 
Microsoft Research says: “We address these difficulties with a fast stereo vision algorithm for interacting with the computer at a distance. The system uses two inexpensive video cameras to extract depth information. This depth information enhances automatic object detection and tracking robustness, and may also be used in applications. We demonstrate the algorithm in combination with speech recognition to perform various window management tasks, show preliminary user study results in the use of the system, and discuss the implications of such a system on tomorrow’s user interfaces.” 

Translator - Marion Kriele
 
Source: Tweakers.net