Researchers from Stanford University have released the second edition of the Stanford Question Answering Dataset (SQuAD) to help AI, such as Siri, learn when it lacks enough information to answer a question accurately. The dataset consists of over 50,000 unanswerable questions designed to appear answerable based off information in the accompanying paragraphs. Humans can easily identify when a question is unanswerable, but AI systems have a harder time, which limits the ability of automated assistants and other services to accurately respond to users’ queries. For example, when asked who the King of England is, a human would recognize that England does not have a king, while AI systems are more likely to say the deceased King George VI, who was the last King of the United Kingdom.
Teaching AI to Know When it is Stumped
previous post
