New natural user interface

Author: Rob Knies

Microsoft Research Dr. Desney Tan in 2010 Microsoft technology section on "air play guitar" project

Information technology development of speed stunning, the past five years is a good example: in 2005, the online video for many people is still a weak State, choppy and demoralising experience.

Then, a new social networking site MySpace is just beginning to stir up trouble, "Twitter" in the meaning of this word is also merely refers to the bird calls.

5 years, so long as the rest of your life.

Then the next five years will bring us? today's innovators are trying to find the answer, but there is no place more so than Microsoft research — here, ideas for the next 5 years or 10 years later is part of the job description.

But one thing is certain: in a few years, we will have the right to update, more advanced computer interactive technology.

New user interface — use gestures, machine inference, situation awareness, as well as rich 3-D environment (whether real or virtual) often makes it happens to you, and will make computing easier and more exciting, and more intuitive. Technology will not only provide people with tools, more will use the previously unthinkable nature and seamlessly enhance people's quality of life.

2010 Microsoft technology section (TechFest) is a Microsoft Research annual display of computer science technology revolution of the window, several aimed at facilitating technology transfer projects here and audiences.

March 3 and 4 October, thousands of Microsoft employees will have the opportunity to watch on the display, and the conversations, and try to incorporate them in for millions of people use the new product.

One project that attempt to change the body's own user interface, below the item overview.

Human computation

"M

ankind's evolution has been very mature, you can use very complex manner and environment and communicate", Microsoft's Redmond Institute commercial entertainment of visualization and interaction (Visualization andInteraction for Business and Entertainment, VIBE) research group of senior research fellow (also Microsoft HCI group fellow) DesneyTan doctor said: "but, unfortunately, we currently used in most computer input device, such as a mouse, keyboard, and so on, just use the potential of very small, but they provide communication channels could have richer. ”

For the time being at least.

Tan and VIBE of the user experience (ComputationalUser Experiences, CUE) Group of colleagues and Microsoft together with other departments, researchers are working to develop natural user interface to narrow this gap. Speech technology, Microsoft Surface (MicrosoftSurface) and Natal program areas work provides us with a window, allows us to a glimpse into the sensor technology computer will inaugurate a new era in human-computer interaction, nevertheless, still insisted that Desney relative to this field, the huge potential, their efforts are fur.

"Our goal is to further develop and provide the user with removable natural user interface," he is in the Microsoft technology section on presentation of the project, said, "in particular, by making the body as input devices, we hope to create a technology that enables us to and ' available when computing ' between the deeper ties.

”

Desney will demonstrate the project called "with the natural physiological-aware user interface (NaturalUser Interfaces with PhysiologicalSensing)".

Presentation is divided into two parts. A partial use of EMG to perceptual current events to infer your finger movements; the second part of the use of acoustic sensors (bio-acousticsensors), to detect human body's energy transfer to the human body into a "based on keystrokes input device" (tap-basedinput device). This two part can be worn with a simple at the top of the forearm, arm ring, thus to computing devices emit radio signals.

Wear on the forearm top simple arm ring can detect muscle activities, as well as bio-acoustic information,

For people with technical equipment for interaction provides a new way

Traditional mouse and keyboard input device is a physical converter, Palm and finger dexterity inherent in allowing input.

While muscle-computer interface (muscle-computerinterface) you make through the wear on the top of a circle of forearm sensors collect muscle signals by EMG for interpreting gestures action, so as to be able to identify the Palm and fingers to click on the skin.

In 2009 the computing machinery user interface software and technology seminar, published a treatise entitled "the use of muscle computer interface, anytime available input (EnablingAlways-Available Input with Muscle-ComputerInterfaces)", from the University of Washington Desney and computer science and Engineering Department of T.

Scott A. Saponas and James Landay, CUE's Dan Morris, Microsoft's Jim Turner, and Toronto University Computer Science Department, together with the RavinBalakrishnan explored in people unable to use a physical device (for example are lifting or no hand comes), how to interact with technology.

An installed projector arm rings direct projection from the user interface to the user's wrist

Another article entitled skin input: enter the body diversion do surface (Skinput: Appropriating the Body as an Input Surface), Desney, Morris and from Carnegie Mellon University's human-computer interaction Institute ChrisHarrison describes how finger percussive and skin produces useful acoustic signal, as well as installation in arm rings of bio-acoustic sensing array c

an "hear" from different parts of the body, the acoustical characteristics of signals, and strength. This arm rings can also be integrated into a projection apparatus, dynamic graphical user interface is displayed in the user's wrist and etc.

These advances could bring to life what change?

Desney gives several examples of real life.

"Remember the phone appears before a period of time?

then you had to make numerous calls to several friends get together to go to the movies. "He said:" even in recently you may have a similar experience: remember, you sit in the bar and people as ' how many professional Rugby star was born in Seattle in ' this wrangling, but not from Wikipedia to verify information. ”

"Just like cell phones and mobile changed the way we run the world, the calculation of the ' Cava ' such a vision would completely change our computer use and dependence.

”

In 2007, the technical review (Technology Review) journals will be appraised under 35 Desney youth innovators (YoungInnovators Under 35), commended his calculation based on the body's efforts, and these efforts will be able to gradually improve increasingly busy people's quality of life.

"Imagine when you rub shoulders with the people on the street, you will be able to know that their intangible, or their child's birthday," he said, "you are in a foreign country, but can see a foreign restaurants and immediately know when its translation could effortlessly learn, people's evaluation of the restaurant;

in this way, you can even keep themselves in two different languages of the world travel to learning a new language. Of course, you can also get on the inside, will soon enjoy food information — it came from, who had been in contact with it, it is beneficial to health, and so on. ”

"It is no exaggeration to say that we are trying to put the world on all the knowledge and the calculations

are placed at your fingertips. ”

The original English text: New, Natural User Interfaces

-----------------------------------------------------------------------------------------------

Related Bowen:

In the clouds — a new cloud computing interactive experience

Computer work for you — simultaneous telephone

Microsoft Senior Vice President Rick • Crest's message Microsoft technology section

More natural interaction — 2010 Microsoft technology festival scene express

Russia square with his tongue Florida

Welcome to concern about Microsoft Research Asia micro-Bo: http://t.sina.com.cn/msra