Piccolo is building a gesture-based smart home ‘vision assistant

Voice assistants may be the hottest thing since sliced bread when it comes to controlling your $60 wifi light bulbs, but Piccolo is launching out of the latest Y Combinator class with a desire to put a camera in every smart home that can translate your physical motions and gestures into commands.

The company’s “Vision Assistant” product works pretty simply, users place the camera in their house and then once they get it fixed in position, they fire up the app and drag boxes over the internet-connected appliances or TVs or lights. From there, the Piccolo camera is basically looking to record your geometry through what’s called skeletal tracking — don’t worry it’s not using an X-ray or anything — which puts your movement into a model that tracks your body position. From there, the device will know where you’re pointing your hand and can interface with the compatible smart home item. It does more than just turn stuff on and off, they’re experimenting with gestures to fast forward through a Netflix show, change modes on the fan, etc. etc.

Founders Marlon Misra and Neil Raina started studying the technologies behind Piccolo through an interest in self-driving cars. The pair of buddies emerged from taking Udacity’s self-driving program in 2016 with an interest in perceptual engines and their far-flung capabilities, an interest which eventually turned to controlling the smart home with body movements.

The team isn’t aiming to replace your Echo or Google Home, this product would very much be sitting in parallel as a camera that can also control your home. This also means that they have to build support for each smart home product they want to control. The startup is currently in the pilot program phase and they’re hoping to launch via a crowdfunding campaign in the future. (You can join a waitlist on their site to get deets on when exactly)

There are definitely limitations from the existing setup, namely that it’s all pretty 2D at the moment and because of this, things seem like they would get pretty wonky if you had a bunch of smart home products stuffed into your casa. The team said that a hefty chunk of what they’re working with is subject to change and that they’re looking at the possibility of adding something like a depth camera.

One of the company’s biggest hurdles is likely getting people to feel comfortable tossing an internet-connected camera in their homes, but while people are skeptical of Google and Amazon because they have a pronounced interest to tailor ads as tightly as possible, the founders tell me they feel like they may have an advantage simply because they are a scrappy upstart that doesn’t have the scale or diverging interests of their competitors.

Other like Leap Motion have attempted (time and time again) to get hand movement controls for tech products to take off. Where Piccolo says its advantage is, is that their technology works from a further distance so you won’t need one of these things attached to every appliance in your home. In an effort to cut down on false positives, the team is currently leading users to raise their hand straight up and then point straight to the object. This is ultimately not that much lower-effort than telling Alexa to kill the lights, but the team’s ultimate ambitions are focused on getting the tracking tight enough that they can tell what you want from minor hand movements.

It’s early days but as computer vision advances bring new functionality to things like smart security cameras, there’s reason to see that the indoor camera could be the key to finding the full potential of the smart home assistant as well.

source:TechCrunch