In China people working for the United States Japan person

This is a "person in China for the United States to work in Japan" story, he used a computer to reproduce the light and shadow, reflection and digestion, motion and stability in the digital world, which is the magic of Microsoft's basic research.

Author: the Internet weekly horse "Reporter:

Why are rendered out of objects, people can see through multiple Visual effects?, the light will be reflected on how to change how let the computer put?

real world physical principle digital show? these are Panasonic Kang in Microsoft Research Asia work to consider issues; cameras out of screen jitter can't see what Panasonic Kang also experienced life's little challenges.

Panasonic Kang "with fellow" exclusive language explained that "the lower Visual research" and "full frame video stabilization technology" is a good way to answer questions and solve the above problem.

"This is exactly what I have been involved in two research directions: one is the photometry and video analysis. " Microsoft Visual Computing Group Manager, researcher, Panasonic Kang says. "There is not very closely, but it is also interesting. ”

Ph.d. from the University of Tokyo to Microsoft research intern, from Japan to Tokyo to Beijing Sigma building, from electrical engineering to physics-based computer vision and video analysis and synthesis.

In fact, this kind of "nothing" by surprise and coincidence also infuse Panasonic Kang experience. As a result, Panasonic Kang to reporters about a chance and necessity, and adhere to the story. Speech, reveals the Japan culture of rigorous, American, and in the same Chinese researcher, Microsoft Research Asia's cordial and easy-going.

Encounter in the future

Microsoft Research Asia Dean hung xiaowen has said: "innovation more accidents".

But Panasonic Kang and Microsoft Research Asia's fate, it is full of this kind of "inevitable surprises".

At Tokyo University, Panasonic Kang undergraduate, master 's, doctoral and professional orientation are electrical engineering.

At that time, Panasonic has studied Kang intelligent transportation systems. "However, I realized that he wanted to do some more research, and hope that these studies can be applied to different things. " Graduated two years ago, Panasonic Kang found himself on the computer vision field of interest. And electrical engineering and computer science contact close, computer architecture and software are learning, so Panasonic Kang, from electrical engineering to computer vision is not a great leap.

In 2002, the then Panasonic Kang also a Ph.d. degree in an International Conference on computer vision, he met the then Vice President of Microsoft Research Asia to and the ocean, "I knew him before, you know he is very famous in the field of computer vision.

I hope to have the opportunity to work with him to learn more. "So, Panasonic Kang volunteered to Shen to ocean," accidentally "became a Microsoft Research Asia's interns, after 4 months of practice after life, Panasonic Kang found herself in love with the research environment and life, in this way, the Microsoft Research Asia work began.

How to use technology to solve practical problems, thereby changing the lives of more people, has been the Microsoft Research Asia in the first place.

Life is also continually to bring inspiration and Panasonic Kang surprise.

Of these, a "full frame video stabilization technology" and "born" from Panasonic Kang's wedding-hand-held cameras wedding picture was shaky, looks very uncomfortable, bride on wedding video effects of unsatisfactory, Panasonic Kang wanted to shiver through the study and solution of video.

"Existing digital mosaic technique can make on the screen, but if the stability of handling objectsmove, this scene will be fixed for the implementation of the method is not feasible. Through the ' full frame video stabilization technology ', missing out of the pixel is a natural supplement. "Similarly, you can remove override text on video, stain on the lens, to make up the missing pixels.

Video anti-shake technology showcase

Technology of light and shadow magic

>

"Video analysis in the near future will become more important as the bounds of the image and video has become increasingly blurred, I believe that eventually all will turn to video.

" Panasonic Kang told reporters.

Microsoft Research Asia computer vision including: high-level vision (such as face recognition technology) and low-vision (e.g., photometry, namely the study of the interaction of light and objects), Panasonic Kang of direction belongs to the latter.

"Photometry is also very important, because if we do not understand the ' lower ' on what happened, not in the ' study on high-rise Visual ' breakthrough on, so the ' Visual ' study on the lower ground floor is very basic.

If the "lower visual development", "top sight" grows. ”

Although it is "naked eye" subtle change, but Panasonic Kang the reporter describes the photometry image of 3D digital restoration and real objects.

But to achieve the above two application, obviously needs more than ordinary special "vision".

"Computer vision has a traditional method, called multi angle stereo vision method (multi-viewstereo), thro

ugh different perspectives to shoot pictures we can reproduce the 3D, but cannot do reproduce details; there is another method that is called stereo optical method (photometricstereo), camera and objects are fixed, but the light is changing, if you move a light source can be objects of different observations, observations can be surface direction (surfaceorientation). ”

3D handheld camera technology showcase

The former can be overall shape, but can't get details;

while the latter does not give you the overall shape, because it can only give you the surface orientation. How to take advantage of the two technologies together to get the most realistic 3D images?

"We consider if a continuous light source is fixed to the camera, so that we can also move the lights and cameras.

" So, Panasonic Kang and his trainee from Tokyo University with a look and ordinary home digital products is not much difference between" 3D camera. " "The 3D camera related accessories in the market on how easy it is to buy the handheld will always be a simple, people won't want to hold a monster. " Panasonic Kang to reporters r the reason behind it.

Cultural melting pot

As the United States Institute of electrical and electronics engineers 2009 computer vision and pattern recognition (CVPR) International Conference and the 2009 International Conference on computer vision (ICCV) region, famous periodical InternationalJournal of Computer Vision (IJCV) and Computer Vision Applications (CVA) Editorial Board, Panasoni

c, Microsoft Research Asia Kang admits to researchers in the field of the free exchange of support, enabling researchers to their research field "see farther, more thorough".

"Through these posts, I research direction more understanding, this vision can help me decide what kind of research in the future even more valuable.

In addition, I can understand the computer vision field of many people, this is another harvest. "Panasonic Kang says with a smile.

"My friends mostly Microsoft colleague.

We have come from different cultural backgrounds, this mixed culture is very interesting. My wife came to Beijing, she also enjoyed the atmosphere and food. "And in other Microsoft Researcher, Panasonic is also accepted at Kang from different cultures," baptism ". In his spare time, Panasonic Kang who love photography, skiing, in addition to the regular and colleagues "search for" Beijing cuisine, also often play badminton and play mahjong.

"In fact, Sigma building culture and the culture outside the building is very different from traditional culture outside of Beijing and the National Institute of culture has inside.

My friend sometimes jokingly said, you are a United States person in China to work in Japan. "Panasonic Kang laughed and said.