Robot learns to set the dinner table by watching humans

To nudge the robot toward the right outcome, the team set criteria that helps the robot satisfy its overall beliefs. The criteria can satisfy the formulas with the highest probability, the greatest number of formulas or even those with the least chance of failure. A designer could optimize a robot for safety if it’s working with hazardous materials, or consistent quality if it’s a factory model.

MIT’s system is much more effective than traditional approaches in early testing. A PUnS-based robot only made six mistakes in 20,000 attempts at setting the table, even when the researchers threw in complications like hiding a fork — the automaton just finished the rest of the tasks and came back to the fork when it popped up. In that way, it demonstrated a human-like ability to set a clear overall goal and improvise.

The developers ultimately want the system to not only learn by watching, but react to feedback. You could give it verbal corrections or a critique of its performance, for instance. That will involve much more work, but it hints at a future where your household robots could adapt to new duties by watching you set an example.