Log out
My profile and settings
My bookmarks
Comment history
Please complete your account verification. Resend verification email.
today
This verification token has expired.
today
Your email address has been verified. Update my profile.
today
Your account has been deactivated. Sign in to re-activate your account.
today
View all newsletters in the newsletter archive
today
You are now unsubscribed from receiving emails.
today
Sorry, we were unable to unsubscribe you at this time.
today
0
0
Back to profile
Comment Items
You have not left any comments yet.
title
in reply to
name
description
Saved Posts
You haven’t bookmarked any posts yet.
“I’ve never met anyone who knows how to have as much fun with condoms (in public, anyway) as Mechai Viravaidya.”
read more
Become a Gates Notes Insider
Sign up
Personal Information
Title
Mr
Mrs
Ms
Miss
Mx
Dr
Cancel
Save
This email is already registered
Cancel
Save
Please verify email address. Click verification link sent to this email address or resend verification email.
Cancel
Save
Address
Cancel
Save
Email and Notification Settings
Send me updates from Bill Gates
You must provide an email
On
Off
Send me Gates Notes survey emails
On
Off
Send me the weekly Top of Mind newsletter
On
Off
Email me comment notifications
On
Off
On-screen comment notifications
On
Off
Interests
Select interests to personalize your profile and experience on Gates Notes.
Saving Lives
Energy Innovation
Improving Education
Alzheimer's
Philanthropy
Book Reviews
About Bill Gates
Account Deactivation
Click the link below to begin the account deactivation process.
If you would like to permanently delete your Gates Notes account and remove it’s content, please send us a request here.
Kinect / Connect
The Power of the Natural User Interface
There’s a reason why the Kinect for Xbox 360 holds the record as the fastest-selling consumer electronics device ever. The innovative software underneath the hood is enabling millions of users worldwide, including me and my family, to interact with and immerse ourselves in games in ways never before possible.
|
0

We play some of the Xbox 360 Kinect games in my house and it’s hard to convey just how amazing it is when you find yourself immersed right in the middle of a game, and how much fun it is for the whole family to play games together where we not only control the action in completely natural ways, but we actually are the action.

Kinect is a motion-sensing input device that’s a revolutionary new way to play games using your body and voice instead of a controller. Now, instead of playing a soccer game by mastering a series of button commands that have nothing to do with soccer, you play by using your feet, head, body, and, if you are the goalie, your hands. To play ping pong, you move your hand just the way you would if you were playing in the garage with a ping pong table, a ball, and a paddle.

Kinect is a remarkable technical achievement. The ability to take video cameras, multi-array microphones, and depth sensors and bring them all together in order to recognize people, understand and anticipate how they move, incorporate voice recognition, and insert them into games—all at 30 frames per second—is phenomenal. (It holds the Guinness World Record for the fastest-selling consumer electronics device ever, with 8 million units sold in the first 60 days it was on sale.)

A lot of the advances that make Kinect possible have been under development at Microsoft for years, even decades. For example, computer scientists at Microsoft Research have been working to solve the hard problems in speech recognition and video capture technology for many years.

Kinect is much more than just a cool video game technology—it is the most advanced example of a wave of new advances that are enabling people to interact with technology in entirely new ways.

One of the most important current trends in digital technology is the emergence of natural user interface, or NUI. We’ve had things like touch screen and voice recognition for a while now. But with Kinect, we are seeing the impact when people can interact with technology in the same ways that they interact with each other.

I’m convinced this is a transformational technology. Until now, we have always had to adapt to the limits of technology and conform the way we work with computers to a set of arbitrary conventions and procedures. With NUI, computing devices will adapt to our needs and preferences for the first time and humans will begin to use technology in whatever way is most comfortable and natural for us.

This has profound implications. At the most basic level, it means people will be able to use technology without any special knowledge or training. Advanced computing tools that can only be used by experts with highly specialized skills today will be available to anyone in the not-too-distant future.

Even more important, NUI means people who may not have even the most basic literacy skills will be able to take advantage of some of the benefits of digital technology and the information age for the first time. Kinect’s movement sensor and voice control tech­nologies also have the potential to make computers more accessible to people with physical and cognitive dis­abilities. A surprising number of academic researchers and others are exploring using Kinect in ways we never imagined. In the UK, for example, scientists are developing robots using Kinect’s inexpensive (but so­phisticated) motion-sensing technology to search for survivors in potentially unstable buildings after an earthquake. Researchers in Seattle are exploring how Kinect can give surgeons a “virtual” sense of touch during remote surgi­cal procedures.

Earlier this year, Microsoft Research released a free software development kit for noncommercial applications of Kinect. If you go to the website, you can see dozens of examples of projects—some of them just for fun and others with a more serious purpose.

It’s exciting to think about the many ways a natural user interface will be used, including by people with little knowledge of technology, to tap into the power of computing and the Internet.

Read this next
NEXT
Comments
posting ...
Please verify your email in order to make comments. Click here to resend verification email
Sorry, duplicate comments are not allowed. 
Sorry, that HTML is not allowed. 
Sorry, something went wrong. 
In order to comment you must be a Gates Notes Insider. Please sign up or log in to continue. 
Be the first to leave a comment.
Comment Locked
Comments more than 2 months old are locked. For more information, contact us.
Report
Delete Comment?
Deleting this comment will remove replies to this comment by you and others as well. This action cannot be undone.
Delete Comment
Why do you want to report this comment?
It's annoying or not interesting
It's abusive and/or vulgar
It's spam
Report Comment
Your report has been submitted.
Close
Save
Cancel
Thanks for visiting the Gates Notes.
We'd like your feedback. Yes, I'll take the survey No thanks
Become a Gates Notes Insider
Join the Gates Notes community to access exclusive content, comment on stories, participate in giveaways, and more.
SIGN UP
Already joined?
Log in
Logout:


Become a Gates Notes Insider
Become a Gates Notes Insider
Join the Gates Notes community to access exclusive content, comment on stories, participate in giveaways, and more.
Already joined? Log in
LOG IN
SIGN UP
Use your social account:
Or sign up with email:
Title
Mr
Mrs
Ms
Miss
Mx
Dr
This email is already registered. Enter a new email, try signing in or retrieve your password
Why are we collecting this information? Gates Notes may send a welcome note or other exclusive Insider mail from time to time. Additionally, some campaigns and content may only be available to users in certain areas. Gates Notes will never share and distribute your information with external parties.
Bill may send you a welcome note or other exclusive Insider mail from time to time. We will never share your information.
Sign up
We will never share or spam your email address. For more information see our Sign Up FAQ. By clicking "Sign Up" you agree to the Gates Notes Terms of Use / Privacy Policy.
Street address
City
postal_town
State Zip code
administrative_area_level_2
Country
Data
Gates Notes Insider Sign Up FAQ

Q. How do I create a Gates Notes account?

A. There are three ways you can create a Gates Notes account:

  • Sign up with Facebook. We’ll never post to your Facebook account without your permission.
  • Sign up with Twitter. We’ll never post to your Twitter account without your permission.
  • Sign up with your email. Enter your email address during sign up. We’ll email you a link for verification.

Q. Will you ever post to my Facebook or Twitter accounts without my permission?

A. No, never.

Q. How do I sign up to receive email communications from my Gates Notes account?

A. In Account Settings, click the toggle switch next to “Send me updates from Bill Gates.”

Q. How will you use the Interests I select in Account Settings?

A. We will use them to choose the Suggested Reads that appear on your profile page.

BACK
Forgot your password?
Enter the email you used to sign up and a reset password link will be sent to you.
This email is already registered. Enter a new email, try signing in or retrieve your password
Reset Password
Reset your password.
Set New Password
Your password has been reset. Please continue to the log in page.
Log in
Get emails from Bill Gates
Send me updates from Bill Gates
You must provide an email
On
Off
Email me comment notifications
On
Off
On-screen comment notifications
On
Off
This email is already registered
Finish
We will never share or spam your email address. For more information see our Sign up FAQ. By clicking "Continue" you agree to the Gates Notes Terms of Use / Privacy Policy.
You're in!
You're in!
Please check your email and click the link provided to verify your account.
Didn't get an email from us? Resend verification email
Upload a profile picture
Choose image to upload
Uploading...
Uh Oh!
The image you are trying to upload is either too big or is an unacceptable format. Please upload a .jpg or .png image that is under 25MB.
Ok
Title
Mr
Mrs
Ms
Miss
Mx
Dr
Cancel
Save
This email is already registered
Cancel
Save
Please verify email address. Click verification link sent to this email address or resend verification email.
Email and notification settings
Send me updates from Bill Gates
You must provide an email
On
Off
Email me comment notifications
On
Off
On-screen comment notifications
On
Off
Select your interests
Saving Lives
Energy Innovation
Improving Education
Alzheimer's
Philanthropy
Book Reviews
About Bill Gates
Finish
Confirm Account Deactivation
Are you sure you want to deactivate your account?
Deactivating your account will unsubscribe you from Gates Notes emails, and will remove your profile and account information from public view on the Gates Notes. Please allow for 24 hours for the deactivation to fully process. You can sign back in at any time to reactivate your account and restore its content.
Deactivate My Acccount
Go Back
Your Gates Notes account has been deactivated.
Come back anytime.
Welcome back
In order to unsubscribe you will need to sign-in to your Gates Notes Insider account
Once signed in just go to your Account Settings page and set your subscription options as desired.
Sign In
Request account deletion
We’re sorry to see you go. Your request may take a few days to process; we want to double check things before hitting the big red button. Requesting an account deletion will permanently remove all of your profile content. If you’ve changed your mind about deleting your account, you can always hit cancel and deactivate instead.
Submit
Cancel
Thank You! Your request has been sent