One of Microsoft’s latest research projects offers gesture controls using a computer’s speakers, microphone and inaudible sounds. The technology is called “SoundWave” and it utilizes the Doppler effect to detect gestures. With the help of a computer’s speakers and microphone, SoundWave can detect the frequency change of a sound wave by using inaudible sounds and measuring the change in feedback as a hand gesture is performed. Even if a user is playing music on his or her laptop or there’s a lot of background noise, SoundWave will still be able to detect gestures. The technology can even detect when a person walks to or away from a computer, and respond by unlocking or locking the device. Microsoft’s video demonstration follows below.

[Via Gizmodo]

Read

A recent patent application from Microsoft reveals that the software giant is looking to bring real-time hand-gestures to tablets, PatentBolt reported on Monday. The patent summary doesn’t provide an extensive overview of the invention — instead, the company states “its sole purpose is to present some concepts disclosed herein in a simplified form as a prelude to the more detailed description that is presented later.” Microsoft goes on to say that there is “a need to provide simple, accurate, fast and computationally inexpensive methods of object and hand pose recognition for many applications.” The application highlights Microsoft’s image processing system, which will be incorporated into the tablet to be used to classify images captured by the camera. The classification information can then be used by the tablet to control software and the user interface.

Read

Some believe a future full of massive, gesture-controlled computer displays like the ones seen in Twentieth Century Fox’s Minority Report are an inevitability, and a prototype PC designed by an intern with the Microsoft Applied Sciences Group may be among the first steps in making that future a reality. Massachusetts Institute of Technology Ph.D student and MIT Media Lab research assistant Jinha Lee recently set out to change the way we interact with desktop computers. While progress has been made with 3D display technology, 3D has not yet proliferated in the personal computing space and Lee wants to change that. The end result of his work is a fascinating desktop computer with a transparent 3D display and a unique gesture-based interface that could change the way we use computers.

“Computer scientist Ivan Sutherland once called a computer display ‘a looking glass into a mathematical wonderland,’ and I have always aspired to walk in this wonderland to interact with those abstract beings,” Lee wrote on his blog. Lee’s creation, built in cooperation with researchers and engineers at the Microsoft Applied Sciences Group, does just that.

Lee’s PC uses a transparent display with 3D technology and gesture recognition. Gestures are performed behind the angled display rather than in front of it as with most gesture-based control systems, and a front-facing camera system tracks the user’s head so the 3D perspective shown on the computer’s display adjusts appropriately when the user shifts his or her position. The machine’s operator can also control the computer with a standard keyboard and trackpad positioned behind the display.

A video showcasing Lee’s 3D computer follows below.

The user interface on Lee’s PC shows stacks of windows in a 3D environment. The computer tracks the user’s hands on all three axes, allowing the operator to grab items shown on the screen and interact with them in all three dimensions by moving virtual objects along the x, y, or z axis. This innovative combination of solutions opens a wide range of possibilities for PC software and is far more advanced and versatile than touchscreen technology, which only provides two dimensions that the user is able to interact with.

“Users can casually open up the See-Through 3D Desktop and Type on the keyboard or use a trackpad as in traditional 2D operating environment,” Lee explains. “Windows or files are perceived to be placed in a 3D space between a screen and the input plane. The user can lift up his hands to reach the displayed windows and arrange them in this 3D space.”

Lee has not addressed the possibility of a production version of his see-through 3D desktop PC.

Swype released the latest version of its popular software keyboard exclusively for Sprint Nexus S 4G users on Tuesday. Swype now supports new app gesture features, shortcuts, dictionary management, automatic noun capitalization and more. Users, for example, can now move from the Swype Key to “t” and then “w” to automatically launch Twitter. The shortcuts feature allows you to select all by moving from the Swype Key to “a,” and cut, copy or paste using similar gestures. We tested all the new additions on a demo Nexus S 4G with the Swype preloaded, and we liked the new features but we still can’t get the hang of typing quickly with it just yet. It’s unclear when the latest Swype iteration will be available for other Android handsets, but Nexus S 4G owners can update immediately. Hit the jump for a quick video of the new features in action.

Today Microsoft’s Larry Hyrb, also known as Major Nelson, announced that Microsoft has added Netflix support to the Xbox 360 Kinect accessory. Using Kinect, you’ll be able to browse your Netflix queue by waving your hands or speaking out loud, which means you won’t have to go searching for your Xbox 360 controller just to watch a movie. Controls include the ability browse, play, pause, fast forward and rewind, and you can perform any of those actions using your voice or gestures. Hyrb said the update is available now and that Kinect users should expect to be prompted to apply the patch the next time they launch Netflix.

Read

Google has announced an update to its Google Mobile App for iOS that adds several new features and gives the application a shorter name. Henceforth to be known simply as Google Search, the new application adds Google Apps shortcuts, gesture support, and a new toolbar, that make hunting down that nugget of Internet gold even easier from your iPhone or iPod touch. The application is available for free in the App Store immediately. There is a video demoing some the new features after the break.

Read

Apple has been testing multitouch gestures for quite a while, and we reported in January that this will likely lead to Apple ultimately ditching the home button on future iPad and iPhone devices. The feature, which simplifies certain tasks such as app switching, still isn’t available to the general public. But as it turns out, anyone can enable multitouch gestures on the iPad or iPad 2 with just a few minutes and $5. As pointed out by Gizmodo, users can simply purchase Apple’s iOS developer software Xcode 4 — available for $5 from the Mac App Store — and enable the nifty feature with a single click. Once enabled, users will be able to use a four-finger swipe from side to side in order to switch open apps, swipe up with four fingers to open the app switcher, and use a five-finger pinch to return to the home screen. Hit the break for the simple instructions.

Before following the steps below, ensure your iPad is updated to iOS 4.3.

1. Purchase Xcode 4 from the Mac App Store [iTunes link] (UPDATE: You can also download the older version of Xcode (v3.2) for free)
2. Launch Xcode and connect your iPad or iPad 2 to your computer
3. Click the “use for development” button
4. Ignore Xcode’s request for developer credentials and disregard the ensuing error
5. Once developer mode is activated, you can enable gestures from within Settings > General on your iPad

[Via Gizmodo]

Read

Today at Mobile World Congress, mobile processor juggernaut Texas Instrument held a press event to offer some additional details about its OMAP 4 and 5 processor lines. Greg Delagi, the company’s senior vice president and general manager, gave the keynote — which took place right on the showroom floor. He emphatically talked about the need to push the capabilities of “smart devices” forward while being mindful of the constraints battery technology puts on the industry. Both RIM and LG were brought on stage — the PlayBook and Optimus 3D both use the OMAP 4 platform — and they too heralded the headway TI is making with its system on a chip (SoC) OMAP processors. The company even has technology in place that will bring cost effective, power efficient gesture recognition and Pico DLP technology to a wider array of smartphones and smart devices; it works just like the Kinect. We have some video of the motion-based gesture recognition, in action running on prototype hardware after the break, along with some of Mr. Delagi’s thoughts on why OMAP is such an effective mobile processor.

Delagi was kind enough to give us 10 minutes of his time to talk about the OMAP platform and, more specifically, how it works in the mobile device arena. Mr. Delagi explained that his company’s chip is superior not because of raw processor clock speed — a common myth — but because of exactly how the chip is designed. OMAP 4 and OMAP 5 processors have six separate engines at their disposal. There is the general purpose processor, which is used for most tasks; the graphics processor, used for image display; a programmable DSP processor, which allows manufactures to keep a phone’s core processing capabilities up to the latest codecs (say H.265 came out, this codec could be flashed to the DSP); a display processor for handling the screen’s needs; an imaging and video accelerator, for doing exactly what its name suggests; and the ABE, or audio back-end.

TI uses some extremely advanced system management to power these systems up and down as your phone demands, to try and efficiently utilize every last bit of juice from your battery. For example, the IVA uses 273 milliwatts when running at full throttle. Delagi also noted that the motion-based gesture recognition technology — which you’ll see in the video below — could be added to LG’s Optimus 3D handset with almost zero impact on battery life and/or added cost to the manufacturer. Mobile processor technology is extremely complex, so it was great to hear someone talk so passionately and eloquently about his company’s solution.

A note about this gesture recognition technology: it has a range of 0-8 meters; it can be included in TVs, mobile phones, gaming systems, etc.; it uses no special sensors, just a camera; it has facial recognition capabilities (the example given was if you were trying to change the channel of your TV using gestures but were on the couch with others); and any device with an OMAP 4 or 5 processor can harness this built-in feature.

BGR exclusively reported on Wednesday that Apple is currently testing a variety of gestures on its iPhone. While the more interesting gestures are still locked away safely on the Apple campus, the task-switching gesture managed to come out to play in Apple’s recent iOS 4.3 beta software. Antoni Nygaard decided to laugh in the face of Apple’s developer agreement on Wednesday and show off these new gestures on camera. As we’ve pointed out in the past, these gestures are currently in place for testing purposes only. Trust us — if and when gesture support is officially added to the iPhone, it won’t involve uncomfortable four-finger swipes. So while we all wait impatiently to see what official gesture support might look like, hit the break for the video demo of Apple’s test gestures in action on an iPhone 3GS.

[Via Engadget]

Read

One of our Apple sources has just sent us over a couple screen shots from what we’re told is an internal test model of the iPhone 4. The shots are interesting because it looks like Apple is testing multitouch gestures on the iPhone in addition to the iPad. While this isn’t shocking, what’s interesting is that internally, the same amount of fingers applies to gestures on both devices. What we mean by this, is that you have to use four finger gestures on the iPhone just like the iPad — kind of difficult such a comparatively tiny screen. It might be easier with say… a multitouch gesture area below the screen, sort of where the home button is? Oh, wait. We imagine things will be refined as testing progresses, but we have to ask in all seriousness — can you handle four fingers? Check out our gallery for a few more images!

We just got some pretty wild information from one of our Apple sources and while it’s hard to believe at first, it does make sense. We have exclusively been told that the reason Apple just added multitouch gestures for the iPad in the latest iOS 4.3 beta is because the iPad will be losing the home button. Yes, we are told that Apple, at some point in time, will remove the home button from the iPad’s design. Instead of button taps, you will use new multitouch gestures to navigate to the home screen and also to launch the app switcher.

That’s not all, however. In addition to the home button disappearing from the iPad, we’re told that this change will make its way over to the iPhone as well. Our source said Apple employees are already testing iPads and iPhones with no home buttons on the Apple campus, and it’s possible we will see this new change materialize with the next-generation iPad and iPhone devices set to launch this year.

Additionally, we’re told Apple’s popular photo-taking application, Photo Booth, will be appearing on the next iPad. It’s also very possible that we’ll see iLife apps for iOS unveiled around the iPad 2 release as well.

It has been said that Steve Jobs didn’t want any physical buttons on the original iPhone at first, and it looks like he may soon get his wish.

Following news that iOS 4.3 beta 1 has been seeded to developers, Apple’s servers are no doubt being hammered by anxious developers looking to explore all the new features. We pinged a few of our dev friends for feedback on new additions they’ve found and here’s what we have so far:

• Personal hotspot capabilities for GSM devices — as we exclusively reported earlier today
• AirPlay support for third-party native apps and third-party Web apps
• Redesigned FaceTime icon
• Multi-touch gesture support for iPad — “This beta release contains a preview of new Multi-Touch gestures for iPad. You can use four or five fingers to pinch to the Home Screen; swipe up to reveal the multitasking bar; and swipe left or right between apps. We are providing this preview before releasing them to the public to understand how these gestures work with your apps.”
• Configurable slide switch for iPad — users can now decide whether the hardware switch above the volume rocker on the iPad controls mute or rotation lock
• iAd full screen banners on the iPad — bigger ads… just what iPad users have been clamoring for

Interestingly, iOS 4.3 appears to also have dropped support for Apple second-generation iPhone — the iPhone 3G — and its second-generation iPod touch. This could make the current build Apple’s final software release for these devices.

UPDATE: Several readers have emailed us to point out that enthusiast blog iSpazio may have uncovered a little gem. References to the following effects have been found in the iOS 4.3 code, and they might be introduced as live video effects for video capture and FaceTime calls:

• Thermal Camera
• X-ray
• Kaleidoscope
• Normal
• Tunnel of Light
• Collapse
• Turbine
• Enlarge

If you’re a BlackBerry fan, there is probably not a single thing you have been looking forward to more than what we have right here — screenshots and full details of RIM’s upcoming operating system, OS 6.0. One of our AT&T sources has not only showed us the brand new OS, but has also given us some screenshots that we could share. Since we have seen OS 6.0 in action first hand, we will break it down for you guys, along with all the other screenshots, after the break!

You can see the new browser that RIM has skinned up, complete with tab switching, new favorites, and multitouch. Yes, multitouch. The browser looks like it’s coming along quite nicely, all WebKit!

Here’s the actual tab switcher view, with nice transparent overlay. No word on how many open tabs you can keep simultaneously.

Finally, a redone media player, and it doesn’t look half bad, right? The navigation in this view is done by using your finger to browse the album art work and then touching the specific album cover to start playing.

Here is what we can tell you about OS 6.0 that we saw in action… RIM has finally implemented system-wide kinetic scrolling with rubberbanding. This makes the experience a bit more fluid when scrolling through lists, web pages, emails, and the like. There is also multitouch system-wide, from the web browser to the photos application, and yes, pinch to zoom is in there.

Looking at the actual message inbox, things look a bit cleaner, and a bit more modern, but it’s obviously not a huge departure from what we have now, just another evolutionary upgrade which is par for the course with RIM. But, we definitely do like the look of the new inbox. It also features larger thumbnails to the left of each message to identify the type of message (Facebook, Twitter, etc.) and we even saw RSS feeds built right in which looked great. We can’t describe this part… but the new inbox feels right. It’s not all work and dry, and it’s not over the top with cheesy graphics or animations, rather a nice compromise of the two.

Something big for OS 6.0 is the homescreen. While we didn’t see any sort of widget support, it appears RIM has made the homescreen completely customizable with pages. You can have your applications on the main page, then slide left or right to another page with different applications and browse that way. In the homescreen screenshot above, you’ll see a sliding field towards the bottom, and you can slide that up, and reveal the first page of applications, and you can then slide that to show the different groups which correspond to the different homescreen page. Favorites, all, home, etc.

Another big thing for OS 6.0 is modal popups with gestures. If you tap and hold (obviously a touchscreen device is required), you’ll get a 9 icon group centered on the screen which is basically a pretty context menu. For instance, you could be composing an email, and instead of pressing Menu + Send, you could tap and hold on the email, see the popup window, and hit the send icon there. Another use would be when emailing photos or videos from your device, just tap and hold on an item there, see the popup, and then just send the item. That way you don’t have to deal with going through the normal menu options which has gotten convoluted with all the various social services/networks available.

The photos application we saw looks quite a bit like the iPhone’s layout, big tiled square photos that appear in thumbnail view with very small borders, that you can flick that list up or down to navigate. Pictures also appeared on screen instantly, not loading one by one by one until you give up. Once you tap a specific photo, you’ll see the picture slide in from the right, sort of like the current animation now when navigating pictures on the BlackBerry. The usual top and bottom UI bars are still here, but if you tap once, just like the iPhone, that view will hide and you’ll have a fullscreen shot of the picture you’re looking at. There was pinch to zoom on the touch screen device we saw (sorry, we can’t comment on the device), but there was absolutely no fluidity when panning around photos. That’s something a lot of manufacturers miss, but, it’s obviously not the end of the world.

Composing an email looks to be a little bit more straight forward. The UI has nice, clean gradients and a very modern web 2.0-feel. Definitely refreshing. There’s also universal search across the system on here… If you haven’t got the point yet, OS 6.0 looks to be a very clean and arguably sexy UI for the BlackBerry platform, let’s just hope there are some under the hood changes as well. Our source says there are many changes we can’t see.

In terms of a release timeframe, we are sure you’ll be pleased as punch to find out that we have been told BlackBerry OS 6.0 will be in market in the June / July timeframe, 100%. I said on Twitter I thought RIM was announcing OS 6.0 at WES (not having heard that at the time), and it looks like I might have been right. RIM needs to knock this one out of the park, and you’ll know we’ll be rooting for them.

We know, we know, you’re sick of future iPhone OS rumors… but one more couldn’t hurt right? The folks over at 9to5Mac have been exploring the new iPhone 3.2 beta 4 SDK, and have found a few files that could indicate more gestures are coming to the next iPhone OS. Something we reported on a pretty decent amount of time ago. The two files, “3Tap.plist” and “LongPress.plist, are located in the “gestures” library folder and, according to 9to5Mac, are not in previous versions of the SDK. Now, we know that “three taps” does not have a defined OS-wide function in the current iPhone OS, but we’re pretty sure that a “long press” will bring up a contextual menu to copy, cut, and paste among other things. For those iPhone haters out there, we’re pretty sure we know what one fingered gesture you want to give the iPhone… but unfortunately the “FlipBird.plist” file was not included in this build of the SDK. Check out the full report at 9to5Mac.

Read

Uh oh. The often accurate Carphone Warehouse has just updated its site to include the LG GD900, tagged as the GD900 Crystal, complete with an expected arrival time frame in mid-May. Yeah, we’re excited. While LG hasn’t yet announced an official release date for any region, we can only hope that other areas are slated for around the same — though we doubt any US availability would fall into that time frame. As you might recall from our brief but entrancing encounter with this sexy little piece of kit, the GD900 is the world’s first handset to feature an illuminated transparent keypad with multitouch gesture support. Coupled with LG’s new S-Class UI under a nice bright touchscreen display, we can’t get our hands on it quickly enough. Everything else — like the slim form and class-topping 8 megapixel camera — is just gravy.

[Via T3]

Read