"We're interested in machine learning algorithms where you don't need to necessarily be an expert in machine learning to interact," said Andrea Thomaz. She, together with her team of researchers, are working on robots that could be installed in our homes and don't need to be preprogrammed with a set of tasks.
Simon only has a "body" from the waist up and can pivot on the platform he rests on. Behind him is a bank of four computer monitors displaying various information about the robot's status. And in case something goes wrong with Simon, there's a large red button next to him to turn him off.
Thomaz said one of the biggest challenges in developing Simon was system integration. "We have Linux boxes, Macs, Windows PCs and basically any kind of machine, we're using it," she said. "We use OpenCV [Open Source Computer Vision] and lots of off-the-shelf things for speech recognition." She said that Simon does "blob detection," facial recognition and sound localization.
Click here to read more about Simon.




















