Microsoft has created a dataset to improve AI assistants. It contains 169 hours of footage of instructors guiding participants through tasks, as well as information on participants’ movements, audio, and annotations describing instructions, participants’ mistakes, and instructors’ corrections. Researchers can use the dataset to train AI assistants to provide proactive or anticipatory assistance, instead of waiting for a command or question.
Image credit: Flickr user Focal Foto