openbookqa allenai
Dataset Card for OpenBookQA Dataset Summary OpenBookQA aims to promote research in advanced question-answering, probing a deeper understanding of both the topic (with salient facts summarized as an open book, also provided with the dataset) and the language it is expressed in. In particular, it contains questions that require multi-step reasoning, use of additional common and commonsense knowledge, and rich text comprehension. OpenBookQA is a new kind of… See the full description on the dataset page: https://huggingface.co/datasets/allenai/openbookqa.
- 类型
- dataset
- 许可
- unknown
- 语言
- en
- 下载量
- 246,340
- 点赞
- 136
- 访问
- public
- 文件
- 0
标签
- 摘要
- 问答
- 常识推理
- 评测基准
- 文本数据集
- NLP
摘要
OpenBookQA是艾伦人工智能研究所发布的开放域问答评测数据集，题目包含一个题干和四个选项，需依赖提供的知识点(fact)及外部常识进行多步推理才能作答。该数据集常用于评测大语言模型在常识推理与深层文本理解方面的能力，有助于推动高级问答研究。
README
--- annotations_creators: - crowdsourced - expert-generated language_creators: - expert-generated language: - en license: - unknown multilinguality: - monolingual size_categories: - 1K<n<10K source_datasets: - original task_categories: - question-answering task_ids: - open-domain-qa paperswithcode_…