0:00:12.310,0:00:15.268 I've been intrigued by this question of 0:00:15.283,0:00:18.988 whether we could evolve or develop[br]a sixth sense 0:00:18.988,0:00:23.208 A sense that would give us seamless access 0:00:23.208,0:00:29.656 and easy access to meta information[br]or information that may exist somewhere 0:00:29.656,0:00:34.314 that may be relevant to help us make[br]the right decision about whatever it is 0:00:34.314,0:00:38.686 that we're coming across and[br]some of you may argue, well, 0:00:38.688,0:00:41.730 don't today's cell phones do that already? 0:00:41.730,0:00:43.530 But I would say no. 0:00:43.530,0:00:46.712 When you meet someone here at Ted and this[br] 0:00:46.712,0:00:49.502 is the top Networking place of the year 0:00:49.502,0:00:52.312 you don't shake somebody's hand [br]and then say 0:00:52.312,0:00:56.802 can you hold on for a moment, while I [br]I take out my phone and Google you 0:00:56.802,0:01:00.172 Or when you go to the supermarket and 0:01:00.172,0:01:02.532 you're standing there in that huge isle 0:01:02.532,0:01:04.912 of different types of toilet papers you 0:01:04.912,0:01:07.642 don't take out your cell phone and open 0:01:07.642,0:01:09.932 a browser and go to a website [br]to try to decide 0:01:09.932,0:01:14.972 to try to decide which of these [br]toilet papers is the most ecologically 0:01:14.972,0:01:16.932 responsible purchase to make 0:01:16.932,0:01:19.934 So, we don't really have easy access to 0:01:19.934,0:01:24.292 all this relevant information that[br]can just help us make optimal 0:01:24.292,0:01:27.592 decisions about what to do next[br]and what actions to take 0:01:27.592,0:01:30.342 and so my research group 0:01:30.342,0:01:35.780 at the media lab has been developing[br]a series of inventions to 0:01:35.780,0:01:38.962 give us access to this information 0:01:38.962,0:01:41.902 in a, sort of easy way without requiring 0:01:41.902,0:01:46.382 that the user changes any [br]of their behavior 0:01:46.382,0:01:51.572 and I'm here to unveil our latest effort[br]and most successful effort so far 0:01:51.572,0:01:54.442 which is still very much a work in process 0:01:54.442,0:01:57.322 I'm actually wearing the device right now 0:01:57.322,0:02:02.009 and, we've sort of cobbled it together [br]with, components 0:02:02.009,0:02:04.272 that are, off the shelves [br]and that by the way 0:02:04.272,0:02:08.432 only cost, $350 dollars at [br]this point in time, 0:02:08.432,0:02:13.052 I'm wearing a camera, just [br]a simple web cam 0:02:13.052,0:02:18.667 A portable battery powered[br]projection system, with a little mirror. 0:02:18.667,0:02:24.317 The components communicate to my cell [br]phone in my pocket which acts as the 0:02:24.317,0:02:27.837 communication and computation device 0:02:27.837,0:02:30.247 and in the video here we see my student 0:02:30.247,0:02:32.647 Pranav Mistry who's really the genius 0:02:32.647,0:02:35.297 who's been implementing and designing 0:02:35.297,0:02:37.547 this whole system and we see how this 0:02:37.547,0:02:40.887 system lets him walk up to any surface 0:02:40.887,0:02:43.947 and start using his hands to interact with 0:02:43.947,0:02:47.147 the information that is projected[br]in front of him 0:02:47.147,0:02:49.907 the system tracks the four[br]significant fingers 0:02:49.907,0:02:56.177 in this case he's wearing [br]simple marker caps 0:02:56.177,0:02:58.937 I know you may recognize, but if you want 0:02:58.937,0:03:00.997 the more stylish version, you could also 0:03:00.997,0:03:04.927 paint your nails in different colors[br]the camera basically tracks 0:03:04.927,0:03:09.237 these four fingers and [br]recognizes any gestures 0:03:09.237,0:03:12.927 that he's making so he can just go to, for 0:03:12.927,0:03:16.227 example a map of long beach zoom 0:03:16.227,0:03:20.347 in and out etc, the system also recognizes 0:03:20.347,0:03:24.027 iconic gestures such as the [br]take a picture gesture 0:03:24.027,0:03:27.187 and then takes a picture of [br]whatever is in front of you 0:03:27.187,0:03:30.857 and when he then walks[br]back to the media lab 0:03:30.857,0:03:33.977 he can just go up to any [br]wall and project all 0:03:33.977,0:03:37.427 the pictures that he's taken [br]sort through them 0:03:37.427,0:03:40.177 and organize them and resize them etc 0:03:40.177,0:03:42.897 again using all natural, ah gestures 0:03:42.897,0:03:46.897 so, some of you most likely [br]were here two years ago 0:03:46.897,0:03:50.897 and saw the demo by, Jeff Han or some 0:03:50.897,0:03:53.467 or some of you might think[br]doesn't this looks like the 0:03:53.467,0:03:57.487 microsoft service table and[br]yes, you also interact 0:03:57.487,0:04:01.267 using natural gestures both hands etc. 0:04:01.267,0:04:03.477 but the difference here is that you 0:04:03.477,0:04:07.197 can use any surface. you can [br]walk up to any surface. 0:04:07.197,0:04:10.687 including your hand if [br]nothing else is available 0:04:10.687,0:04:13.697 and interact with this projected data 0:04:13.697,0:04:16.407 the device is completely portable 0:04:16.407,0:04:25.087 and can be, (laughs) thanks (aplause) 0:04:25.087,0:04:27.627 so one importance difference is that 0:04:27.627,0:04:31.227 it is totally mobile another [br]even more important 0:04:31.227,0:04:34.087 difference is that in mass production 0:04:34.087,0:04:37.087 this would not cost more tomorrow than today's 0:04:37.087,0:04:42.087 cell phones and would actually not, um, sort of be a bigger 9:59:59.000,9:59:59.000 package and could look a lot more stylish 9:59:59.000,9:59:59.000 than this ah, ah version that (laughs) I am wearing around my neck 9:59:59.000,9:59:59.000 um, but other than letting some of you live out your 9:59:59.000,9:59:59.000 fantasy of looking as cool asTom Cruise in Minority Report 9:59:59.000,9:59:59.000 um the reason why we're really excited about this device 9:59:59.000,9:59:59.000 is that it um really can act as one of these sixth sense devices 9:59:59.000,9:59:59.000 that gives you relevant information 9:59:59.000,9:59:59.000 about uh whatever is in front of you, so we see Pranav 9:59:59.000,9:59:59.000 here going into the super market and he's ah shopping 9:59:59.000,9:59:59.000 for some paper towels and as he picks up 9:59:59.000,9:59:59.000 a product the system can recognize a product 9:59:59.000,9:59:59.000 that he is picking up using either image recognition 9:59:59.000,9:59:59.000 or marker technology and give him the green light or an orange light. 9:59:59.000,9:59:59.000 Um, he can ask for additional information 9:59:59.000,9:59:59.000 so this particular um (Audience Aplause) (laughs) choice here is a particularly 9:59:59.000,9:59:59.000 good choice given his personal criteria 9:59:59.000,9:59:59.000 some of you may want the toilet paper 9:59:59.000,9:59:59.000 with the most bleach in it rather than the most ecologically 9:59:59.000,9:59:59.000 responsible choice (audience laughter) um but (laughs) if 9:59:59.000,9:59:59.000 he picks up a book in the bookstore he can get 9:59:59.000,9:59:59.000 the Amazon rating, that gets projected right on 9:59:59.000,9:59:59.000 the cover of the book this is, uh Juan's book 9:59:59.000,9:59:59.000 our previous speaker um which gets 9:59:59.000,9:59:59.000 a great rating by the way on Amazon and so Pranav 9:59:59.000,9:59:59.000 turns the page of the book and can then see additional 9:59:59.000,9:59:59.000 information about the book, reader comments 9:59:59.000,9:59:59.000 um, maybe, sort of information by his favorite 9:59:59.000,9:59:59.000 critic etc. If he turns to a particular page 9:59:59.000,9:59:59.000 he finds an annotation by maybe an 9:59:59.000,9:59:59.000 expert of a friend of ours that gives 9:59:59.000,9:59:59.000 him a little bit of additional information 9:59:59.000,9:59:59.000 about whatever is on that particular page. 9:59:59.000,9:59:59.000 Reading the news paper he never has 9:59:59.000,9:59:59.000 to be (audience laughs) updated (laughs). You can get video annotations 9:59:59.000,9:59:59.000 of the events you are reading about. You can get 9:59:59.000,9:59:59.000 the latest sports scores etc. 9:59:59.000,9:59:59.000 This is a more controversial one (audience laughs) 9:59:59.000,9:59:59.000 As you interact with someone at TED 9:59:59.000,9:59:59.000 maybe um you can see a word cloud of the tags 9:59:59.000,9:59:59.000 the words that are associated with the person 9:59:59.000,9:59:59.000 in their blog and personal web pages 9:59:59.000,9:59:59.000 in this case the student is interested in cameras 9:59:59.000,9:59:59.000 etc. on your way to the airport if you 9:59:59.000,9:59:59.000 pick up your boarding pass it can 9:59:59.000,9:59:59.000 tell you that your flight is delayed 9:59:59.000,9:59:59.000 that the gate has changed etc. 9:59:59.000,9:59:59.000 And if you need to know what 9:59:59.000,9:59:59.000 the current time is, it's as simple as 9:59:59.000,9:59:59.000 drawing a watch (audience laughs) (laughs) on your arm 9:59:59.000,9:59:59.000 So, that's where we are at so far 9:59:59.000,9:59:59.000 in uh (laughs) developing this sixth sense that would 9:59:59.000,9:59:59.000 give us seamless access to all this 9:59:59.000,9:59:59.000 relevant information. About the things 9:59:59.000,9:59:59.000 that we may come across 9:59:59.000,9:59:59.000 my student Pranav who's really, like I said 9:59:59.000,9:59:59.000 the genius behind this (roaring applause) 9:59:59.000,9:59:59.000 (continued applause) 9:59:59.000,9:59:59.000 he does deserve a lot of applause because 9:59:59.000,9:59:59.000 I don't think he slept much in the last three 9:59:59.000,9:59:59.000 months actually and his girlfiriend 9:59:59.000,9:59:59.000 is probably not very happy 9:59:59.000,9:59:59.000 about him either 9:59:59.000,9:59:59.000 um, but it's not perfect yet 9:59:59.000,9:59:59.000 it's very much a work in progress 9:59:59.000,9:59:59.000 and who knows maybe in another ten years 9:59:59.000,9:59:59.000 we'll be here with the ultimate um 9:59:59.000,9:59:59.000 sixth sense brain implant, thank you. 9:59:59.000,9:59:59.000 (audience applause)