37156994-sixth-sense-technology.docx

SIXTH SENSE TECHNOLOGY

Everyone is aware of their five basic senses, seeing, feeling, smelling, hearing and tasting. What everyone is not so well aware of is their sixth sense, that sense of otherworldliness, a connection to something more and greater than their physical senses are able to perceive. This is the entrance to the world of the unseen encounter, the unheard communication, the unfelt touch of someone from the spiritual world trying to make a connection with someone in the physical body.

TED (Technology, Entertainment, Design) is a working prototype of a multifunctional device that can become part of our lives in five years to ten. Set named “sixth sense― consists of a camera (it captures the movement of hands), the projector (it produces the image on any surface), the mobile phone (it is in your pocket and need only to communicate with the abstract database server) and four fingers on which to detect movements, wearing colorful caps, perceived by the camera. Sixth Sense Technology is a mini-projector coupled with a camera and a cellphone—which acts as the computer and connected to the Cloud, all the information stored on the web. Sixth Sense can also obey hand gestures. The camera recognizes objects around a person instantly, with the microprojector overlaying the information on any surface, including the object itself or hand. Also can access or manipulate the information using fingers. make a call by Extend hand on front of the projector and numbers will appear for to click. know the time by Draw a circle on wrist and a watch will appear. take a photo by Just make a square with fingers, highlighting what want to frame, and the system will make the photo—which can later organize with the others using own hands over the air.and The device has a huge number of applications , it is portable and easily to carry as can wear it in neck. The drawing application

lets user draw on any surface by observing the movement of index finger. Mapping can also be done anywhere with the features of zooming in or zooming out. The camera also helps user to take pictures of the scene is viewing and later can arrange them on any surface. Some of the more practical uses are reading a newspaper. reading a newspaper and viewing videos instead of the photos in the paper. Or live sports updates while reading the newspaper. The device can also tell arrival, departure or delay time of air plane on tickets. For book lovers it is nothing less than a blessing. Open any book and find the Amazon ratings of the book. To add to it, pick any page and the device gives additional information on the text, comments and lot more add on feature

Sixth Sense allows people to use the internet without a screen or a keyboard It can turn any surface into a touch screen It is made with store-bought components “The software program processes the video stream data captured by the camera and tracks the locations of the colored markers [that you wear on your fingers] usingsimple computer-vision

techniques simple computer-vision techniques― (http://www.pranavmistry.com/projects/six...htm#ABOUT) According to a number of sources, graduate students at MIT have been working on this for the past four months “day and night― Just a few things it can do… “The device recognizes items in stores, and then gathers and projects information about products to the user. It also is able to provide quick signals to let users know what the best products are based on their needs.―  “Another amazing feature is the device’s ability to look at an airplane ticket and let the user know whether the flight is delayed or on time. It is also able to recognize books (based on an image or RFID) in a book store and then project reader reviews or author information from the Internet onto blank pages.― “The device can also recognize articles in newspapers, retrieve the latest related

stories or video from the Internet and then display them on pages for the user. Say goodbye to your dictionary and encyclopedia.―

http://gadgets.tmcnet.com/topics/gadgets...ns-any.htm

Cost of Sixth Sense $350 dollars The interesting thing here is that Sixth Sense can never really be more expensive than its individual components Purpose of Sixth Sense I believe Sixth Sense’s purpose would be to allow K-12 students and teachers to interact with information on a level not experienced before In my opinion, at least initially, its purpose would be to motivate…motivate…motivate Educational Use Engagement Research Collaboration Cost-effectiveness

Engagement Teachers may find that Sixth Sense, because of its unique ability to work with many of Gardner’s multiple intelligences, will be a catalyst for students who might otherwise remain unengaged in learning. Sixth Sense uses the visual, kinesthetic, intrapersonal and interpersonal among others. If this technology does nothing else, the idea that students can simply use their hands to draw images on walls and take pictures with their hands will be (at least initially) quite motivating

Research Sixth Sense will give new meaning to “looking something up.― Since we are essentially talking about the internet, students will be given the opportunity to portably research the world. They can all go on a virtual field trip and project the images on their own desks, for example.

Collaboration Students will be given an opportunity through this technology to feel more connected to others. Although there does seem to be the sense that individuals could walk through life wired and lonely, I like to think the classroom would serve as the environment in which students and teachers using Sixth Sense would want to share. Not only could the sharing take place in the classroom, I suppose since the users are connected online, sharing could take place around the world. Cost-effectiveness As mentioned earlier, this product currently costs only $350. From an educator’s stand point, this is minimum given the amount of money spent on textbooks, computer labs and LCD projectors. For educator’s, Sixth Sense would be a way to put technology (literally) into each student’s hands, because of its size and its cost. Anticipated Time Frame According to a number of sources, the MIT students already have a patent on Sixth Sense. Still it is unclear as to when this device might actually become available for general purchasing. Microsoft Surface does currently exist (which is similar in theory). But Microsoft’s product is not portable like Sixth Sense Even if it came out next week, as educators we may need to wait some time in order to learn of the dangers that are sure to exist with the product. Advantages of Sixth Sense Portable Inexpensive “Cool― Multi-sensory Connectedness between the world and information Critical thinking skills would be somewhat vital here…allowing teachers a fantastic opportunity for interdisciplinary study with critical thinking components Future Implications Students could become too wired…and the element of collaboration I envision might be completely erased by how the individual interacts Availability of inappropriate information (how does this differ from current computer labs....this information is literally at students’ fingertips.)

The technology will cost more because it is packaged and marketed…and they can charge more What type of signal is needed..and might there be issues with getting signals in schools Getting Started My new thing is getting people to “play― with the technology No pressure Give them time Allow students and teachers to play with this together Offer support in the initial weeks/months of use Let Opinion Leaders emerge from their experience Start small!

Relevant Issues from Rogers (2003) Opinion Leaders are key Consider the length of time of the innovation-decision period Think about homophily and heterophily when planning Sixth Sense expansion in a second and third school/classroom Realize that in most cases, “individuals depend mainly on the communicated experience of others much like themselves who have already adopted a new idea― (p. 331). My guinea pigs better be the right ones Sixth Sense is a wearable gestural interface that augments the physical world around us with digital information and lets us use natural hand gestures to interact with that information. It was developed by Pranav Mistry, a PhD student in the Fluid Interfaces Group at the MIT Media Lab. SixthSense bridges the gap by bringing intangible, digital information out into the tangible world, and allowing us to interact with this information via natural hand SixthSense comprises a pocket projector, a mirror and a camera. The hardware components are coupled in a pendant like mobile wearable device

COMPONENTS The hardware components are coupled in a pendant like mobile wearable device. Camera Projector

Mirror Mobile Component Color Markers

Camera Captures an object in view and tracks the user’s hand gestures It sends the data to smart phone It acts as a digital eye, connecting you to the world of digital information

Projector The projector projects visual information enabling surfaces and physical objects to be used as interfaces The project itself contains a battery inside, with 3 hours of battery life. A tiny LED projector displays data sent from the smart phone on any surface in view–object, wall, or person.

Mirror

The usage of the mirror is significant as the projector dangles pointing downwards from the neck.

Smart Phone A Web-enabled smart phone in the user’s pocket processes the video data Other software searches the Web and interprets the hand gestures

Color Markers It is at the tip of the user’s fingers . Marking the user’s fingers with red, yellow, green, and blue tape helps the webcam recognize gestures The movements and arrangements of these makers are interpreted into gestures that

act as interaction instructions for the projected application interfaces.

HOW IT WORKS The hardware that makes Sixth Sense work is a pendant like mobile wearable interface It has a camera, a mirror and a projector and is connected wirelessly to a bluetooth smart phone that can slip comfortably into one’s pocket The camera recognizes individuals, images, pictures, gestures one makes with their hands Information is sent to the Smartphone for processing The downward-facing projector projects the output image on to the mirror Mirror reflects image on to the desired surface Thus, digital information is freed from its confines and placed in the physical world

Make a call You can use the Sixth Sense to project a keypad onto your hand, then use that virtual keypad to make a call.

Call up a map With the map application we can call up the map of our choice and then use thumbs and index fingers to navigate the map

Check the time Draw a circle on your wrist to get a virtual watch that gives you the correct time

Create multimedia reading experiences Sixth Sense can be programmed to project related videos onto newspaper articles you are reading

Drawing application The drawing application lets the user draw on any surface by tracking the fingertip movements of the user’s index finger

Zooming features The user can zoom in or zoom out using intuitive hand movements

Get product information Sixth Sense uses image recognition or marker technology to recognize products we pick up, then feeds us information on those products

Get book information The system can project Amazon ratings on that book, as well as reviews and other relevant information

Get flight updates The system will recognize your boarding pass and let you know whether your flight is on time and if the gate has changed.

Feed information on people The system will project relevant information about a person such as what they do, where they work, and so on.

Take pictures If you fashion your index fingers and thumbs into a square ("framing" gesture), the system will snap a photo. After taking the desired number of photos, we can project them onto a surface, and use gestures to sort through the photos, and organize and resize them.

CONCLUSION Sixth Sense recognizes the objects around us, displaying information automatically and letting us to access it in any way we need The Sixth Sense prototype implements several applications that demonstrate the usefulness, viability and flexibility of the system Allowing us to interact with this information via natural hand gestures The potential of becoming the ultimate "transparent" user interface for accessing information about everything around us http://www.seminarprojects.com/Thread-si...logy--7186 and http://www.seminarprojects.com/Thread-si...e-computer for getting more information about sixth sense technology Basically, Sixth Sense is a mini-projector coupled with a camera and a cellphone—which acts as the computer and your connection to the Cloud, all the information stored on the web. Sixth Sense can also obey hand gestures, like in the infamous Minority Report. However, instead of requiring you to be in front of a big screen like Tom Cruise, Sixth Sense can do its magic— and a lot more—everywhere, even while you are jumping hysteric over Oprah's sofa. The camera recognizes objects around you instantly, with the micro-projector overlaying the information on any surface, including the object itself or your hand. Then, you can access or manipulate the information using your fingers. Need to make a call? Extend your hand on front of the projector and numbers will appear for you to click. Need to know the time? Draw a circle on your wrist and a watch will appear. Want to take a photo? Just make a square with your fingers, highlighting what you want to frame, and the system will make the photo—which you can later organize with the others using your own hands over the air. But those are just novelty applications. The true power of Sixth Sense lies on its potential to connect the real world with the Internet, and overlaying the information on the world itself. Imagine you are at the supermarket, thinking about what brand of soap is better. Or maybe what wine you should get for tonight's dinner. Just look at objects, hold them on your hands, and Sixth Sense will show you if it's good or bad, or if it fits your preferences or not. Now take this to every aspect of your everyday life. You can be in a taxi going to the airport, and just by taking out your boarding pass, Sixth Sense will grab real time information about your flight and display it over the ticket. You won't need to do any action. Just hold it in front of your and it will work. The key here is that Sixth Sense recognizes the objects around you, displaying information automatically and letting you access it in any way you want, in the simplest way possible. Clearly, this has the potential of becoming the ultimate "transparent" user interface for accessing information about everything around us. If they can get rid of the colored finger caps and it ever goes beyond the initial

development phase, that is. But as it is now, it may change the way we interact with the real world and truly give everyone complete awareness of the environment around us. Or just make a few people look like dorks. It can go either way, really. Whatever it is, I want to try it.

Sixth Sense Technology will Revolutionize the World SCIENCE | July 26, 2009 | Share

All of us are aware of the five basic senses – seeing, feeling, smelling, tasting and hearing. But there is also another sense called the sixth sense. It is basically a connection to something greater than what their physical senses are able to perceive. To a layman, it would be something supernatural. Some might just consider it to be a superstition or something psychological. But the invention of sixth sense technology has completely shocked the world. Although it is not widely known as of now but the time is not far when this technology will change our perception of the world. Pranav Mistry, 28 year old, of Indian origin is the mastermind behind the sixth sense technology. He invented ‘ Sixth Sense / WUW ( Wear UR World) ‘ which is a wearable gestural , user friendly interface which links the physical world around us with digital information and uses hand gestures to interact with them. He is a PhD student at MIT and he won the ‘Invention of the Year 2009 ‘- by Popular Science. The device sees what we see but it lets out information that we want to know while viewing the object. It can project information on any surface, be it a wall, table or any other object and uses hand / arm movements to help us interact with the projected information. The device brings us closer to reality and assists us in making right decisions by providing the relevant information, thereby, making the entire world a computer. The Sixth Sense prototype consists of a pocket projector, mirror and a camera. The device is pendant shaped like mobile wearing devices. Both the projector and the camera are connected to the mobile computing device in the user’s pocket. The projector projects visual information enabling surfaces, walls and physical objects around us to be used as interfaces; while the camera recognizes and tracks user’s hand gestures and physical objects using computer-vision based techniques. The software program processes the video stream data captured by the camera and tracks the locations of the colored markers (visual tracking

fiducials) at the tip of the user’s fingers using simple computer-vision techniques. It also supports multi touch and multi user interaction. The device has a huge number of applications. Firstly, it is portable and easily to carry as you can wear it in your neck. The drawing application lets user draw on any surface by observing the movement of index finger. Mapping can also be done anywhere with the features of zooming in or zooming out. The camera also helps user to take pictures of the scene he is viewing and later he can arrange them on any surface. That’s not it. Some of the more practical uses are reading a newspaper. Imagine reading a newspaper and viewing videos instead of the photos in the paper. Or live sports updates while reading the newspaper. The device can also tell you arrival, departure or delay time of your air plane on your tickets. For book lovers it is nothing less than a blessing. Open any book and you will find the Amazon ratings of the book. To add to it, pick any page and the device gives additional information on the text, comments and lot more add on features. While picking up any good at the grocery store, the user can get to know whether the product is eco friendly or not. To know the time, all one has to do is to just gesture drawing circle on the wrist and there appears a wrist watch. The device serves the purpose of a computer plus saves time spent on searching information. Currently the prototype of the device costs around $350 to build. Still more work is being done on the device and when fully developed, it will definitely revolutionize the world.