cool microsoft research video

sweetjesus · Post by **sweetjesus** » Fri Jan 19, 2007 5:39 am

http://www.youtube.com/watch?v=AtmwQnUlEmc

genshi · Post by **genshi** » Fri Jan 19, 2007 5:59 am

Interesting, but seems way to limited (at the moment). I wouldn't want to have to make the "OK" symbol with my fingers just to move a cursor around. And this system still seems real buggy (see how many times he had to keep going to his mouse.)

Now I posted this following link yesterday but I don't think anyone noticed it with all the NAMM talk, but imho this is the true future of interfaces. This is the closest thing to "The Minority Report" interface that Ive seen and it works flawlessly, it's inexpensive but it's just not available yet. Watch the whole video and see all the things this can do!

http://www.youtube.com/watch?v=QKh1Rv0PlOQ

Cyberstar · Post by **Cyberstar** » Fri Jan 19, 2007 7:17 am

genshi wrote:Interesting, but seems way to limited (at the moment). I wouldn't want to have to make the "OK" symbol with my fingers just to move a cursor around. And this system still seems real buggy (see how many times he had to keep going to his mouse.)

Now I posted this following link yesterday but I don't think anyone noticed it with all the NAMM talk, but imho this is the true future of interfaces. This is the closest thing to "The Minority Report" interface that Ive seen and it works flawlessly, it's inexpensive but it's just not available yet. Watch the whole video and see all the things this can do!

http://www.youtube.com/watch?v=QKh1Rv0PlOQ

Very cool video

chrisedmo · Post by **chrisedmo** » Fri Jan 19, 2007 8:40 am

Pointless.. why would you want to control your cursor with the OK! sign.. haha. Microsoft.

compositeone · Post by **compositeone** » Fri Jan 19, 2007 10:06 am

Yeah unfortunately he has thought of a way to technically do what he wants so then the "ok sign" was moulded to fit that. Rather than saying "how would people want to control it" then developing the technology.

The other one was cool though, multi touch has to be the future.

SubQ · Post by **SubQ** » Fri Jan 19, 2007 2:17 pm

This is the closest thing to "The Minority Report" interface that Ive seen and it works flawlessly, it's inexpensive but it's just not available yet. Watch the whole video and see all the things this can do!

http://www.youtube.com/watch?v=QKh1Rv0PlOQ

Been there for ages. search the forum for minority report.

That's already the past, once Multitouch technology by Apple (and Multipoint by windows with touchscreen tablets) reaches the market, no need for cameras and complex setups like this.

I'd say a few more years, and goodbye buttons and controllers. Just a keyboard and your screen.

Grobe must be hearing this

mikemc · Post by **mikemc** » Fri Jan 19, 2007 8:03 pm

ok... controlling the pc with the circled thumb and index finger...

Paperclip appears: '*tap tap* it looks like you want to ... uhm... how about I just download some porn and leave you alone?'

Machinate · Post by **Machinate** » Fri Jan 19, 2007 9:04 pm

I think you guys are missing the point a bit here - this is just a RESEARCH EXAMPLE! If you had heard the programmers comments in the video you would know this

The point is that the entire interface is monitoring your keyboard hands, you don't need to touch a screen - what if there was a simple sensor in the palm rest of your keyboard, and once released it would sense the gestures of your hands?

For me this has a lot more potential than the hardware needed for a multi-touch interface. It makes so much sense to have as little hand movement as possible, and direct gesture tracking above the keyboard gives you that. It's as easy as that.

Oh, and if you think video tracking from a webcam is complex you might want to just avoid the whole alternative interfacing side of things and stick with your mouse!

genshi · Post by **genshi** » Fri Jan 19, 2007 9:14 pm

SubQ wrote:
This is the closest thing to "The Minority Report" interface that Ive seen and it works flawlessly, it's inexpensive but it's just not available yet. Watch the whole video and see all the things this can do!

http://www.youtube.com/watch?v=QKh1Rv0PlOQ

Been there for ages. search the forum for minority report.

That's already the past, once Multitouch technology by Apple (and Multipoint by windows with touchscreen tablets) reaches the market, no need for cameras and complex setups like this.

I'd say a few more years, and goodbye buttons and controllers. Just a keyboard and your screen.

Grobe must be hearing this

This multitouch is the past over the iPhone?. I was one of the ones championing the iPhone the day of the keynote, but then I found this. This was being developed concurrently with the iPhone development. The only reason there were "cameras" in that setup is so the audience could see what was going on, (and this table was rear projected) but the multitouch rig itself is completely self-contained within the frame of the screen and as the developer said, it is scalable. It can be as small as an iPhone or as large as a wall (which they just old one to the military, wall sized.)

Jobs will get the iPhone out to the mass market sooner (and I WILL buy one) but when I was envisioning where the iPhone technology could lead, it was exactly this TED example that I imagined and when something like this comes out it will be amazing! Did you see the video? Not the first one by the original poster, but the one I put up? The keyboard was on the screen and scalable, so you don't even need a hardware keyboard!

Machinate · Post by **Machinate** » Fri Jan 19, 2007 9:21 pm

genshi wrote: The keyboard was on the screen and scalable, so you don't even need a hardware keyboard!

heheh... trust me - you DO!

I am a devout Lemur-user, and even I will tell you:
Computer keyboards in their current qwerty configurations NEED tactile feedback - if not then you might as well be using one of the laser-scanning keyboards out there - they suck too!

genshi · Post by **genshi** » Fri Jan 19, 2007 9:25 pm

Machinate wrote:
genshi wrote: The keyboard was on the screen and scalable, so you don't even need a hardware keyboard!
heheh... trust me - you DO!

I am a devout Lemur-user, and even I will tell you:
Computer keyboards in their current qwerty configurations NEED tactile feedback - if not then you might as well be using one of the laser-scanning keyboards out there - they suck too!

Did you watch the video? Do you know about the psychology of tactile feedback? The reason the iPod worked with their click wheel is because it tricked the user into thinking the wheel was real, but it's not. It's just a touchpad with SOUND to simulate a real wheel... and it works. The multitouch (I don't know about the iPhone, but possible) on this TED device can have the same simulated feedback with sound and force feedback (which they are working on.) The Lemur does not have that.

And I'm surprised at you guys not realizing this, because sound alone (like with the iPod clickwheel) is enough to give you the feedback you need. The best example of this is video games. I worked in the video game industry for years and even sound on the Menus were important to give the user the "feel" that they were doing something.

mikemc · Post by **mikemc** » Fri Jan 19, 2007 9:39 pm

Machinate wrote:I think you guys are missing the point a bit here - this is just a RESEARCH EXAMPLE! If you had heard the programmers comments in the video you would know this

The point is that the entire interface is monitoring your keyboard hands, you don't need to touch a screen - what if there was a simple sensor in the palm rest of your keyboard, and once released it would sense the gestures of your hands?

For me this has a lot more potential than the hardware needed for a multi-touch interface. It makes so much sense to have as little hand movement as possible, and direct gesture tracking above the keyboard gives you that. It's as easy as that.

Oh, and if you think video tracking from a webcam is complex you might want to just avoid the whole alternative interfacing side of things and stick with your mouse!

aw, c'mon, we're just funnin'.

It actually is very cool the way the video highlights indicate a recognized feature-- I agree about not needing hardware: imagine that the camera is not pointing down at hand over a keyboard, but a hand over a background of various shaped buttons or bar-like shapes, and the pattern that is being recognized indicates when a hand is moving over those-- like a Lemur, inside out.

Machinate · Post by **Machinate** » Fri Jan 19, 2007 10:05 pm

genshi wrote:
Machinate wrote:
genshi wrote: The keyboard was on the screen and scalable, so you don't even need a hardware keyboard!
heheh... trust me - you DO!

I am a devout Lemur-user, and even I will tell you:
Computer keyboards in their current qwerty configurations NEED tactile feedback - if not then you might as well be using one of the laser-scanning keyboards out there - they suck too!
Did you watch the video? Do you know about the psychology of tactile feedback?

Yes. And yes. I'm doing research on it right now, actually:
http://www.flickr.com/photos/18877453@N00/362854995/

I believe there is a fundamental difference between a click wheel on an ipod and a full 100-and-some key keyboard, and I also don't believe in audio feedback. I believe it is perhaps PART of the solution, but not the whole deal.

If it was to have appropriate feedback it should be tactile - this could be in the shape of minute voltages applied to the tips of the fingers while typing, perhaps?

mikemc · Post by **mikemc** » Fri Jan 19, 2007 10:17 pm

Machinate wrote:
genshi wrote:
Machinate wrote: heheh... trust me - you DO!

I am a devout Lemur-user, and even I will tell you:
Computer keyboards in their current qwerty configurations NEED tactile feedback - if not then you might as well be using one of the laser-scanning keyboards out there - they suck too!
Did you watch the video? Do you know about the psychology of tactile feedback?
Yes. And yes. I'm doing research on it right now, actually:
http://www.flickr.com/photos/18877453@N00/362854995/

I believe there is a fundamental difference between a click wheel on an ipod and a full 100-and-some key keyboard, and I also don't believe in audio feedback. I believe it is perhaps PART of the solution, but not the whole deal.

If it was to have appropriate feedback it should be tactile - this could be in the shape of minute voltages applied to the tips of the fingers while typing, perhaps?

The touch is definitely key, it is more immediate. Maybe there is a device on the hand, like a thin plastic strip on the *underside* of each finger, like a backless glove. The strip protudes a little past the end of the finger, you can press and tap with it?