Researchers at Google have released a dataset to train robots to understand and follow directions in novel situations. The team created the dataset by showing a robotic arm how to complete novel tasks. They then directed the robot to complete the task autonomously and intervened via teleoperation if the robot was unsuccessful. The dataset contains episodes of successful demonstrations, autonomous movements, and corrected movements for 100 tasks, as well as the robot’s level of awareness during each movement and its corresponding next action.
Image credit: Flickr user Justin Morgan