https://qz.com/1305751/new-data-could-help-siri-and-alexa-know-when-theyre-being-unhelpful/

Digital assistants don’t know when to can it. If you’ve asked Siri or Alexa a question, you’ll know the pain of getting a response loosely tied to some Wikipedia article that doesn’t really answer your original question.

A new dataset from Stanford aims to teach AI systems to understand how to answer questions more effectively, by knowing when there isn’t enough information to provide an accurate answer. The dataset is called SQuAD 2.0, short for the Stanford Question Answering Dataset. It’s an update of an earlier, wildly popular dataset used by companies like Microsoft, Google, and Alibaba to show off how accurate their language-understanding AI systems are at answering questions.