IFEval google
Dataset Card for IFEval Dataset Summary This dataset contains the prompts used in the Instruction-Following Eval (IFEval) benchmark for large language models. It contains around 500 "verifiable instructions" such as "write in more than 400 words" and "mention the keyword of AI at least 3 times" which can be verified by heuristics. To load the dataset, run: from datasets import load_dataset ifeval = load_dataset("google/IFEval") Supported Tasks and… See the full description on the dataset page: https://huggingface.co/datasets/google/IFEval.
- 类型
- dataset
- 许可
- apache-2.0
- 语言
- en
- 下载量
- 196,608
- 点赞
- 162
- 访问
- public
- 文件
- 0
标签
- 评测基准
- 文本生成
- 大语言模型
- 测试数据
- NLP
- 提示词工程
- 评测面板
- 评估
摘要
IFEval是由Google发布的指令遵循评测基准数据集，包含约500条"可验证指令"（如"写超过400字"、"至少提到关键词AI三次"等），可通过启发式规则自动验证模型是否严格遵守指令。该数据集用于评估经过对话或指令微调的大语言模型的指令遵循能力，是Open LLM Leaderboard的核心评测基准之一，适合用于模型能力评估与对比。
README
--- license: apache-2.0 task_categories: - text-generation language: - en pretty_name: IFEval --- # IFEval 数据集卡片 <!-- 提供数据集的简要概述。 --> ## 数据集描述 - **仓库：** https://github.com/google-research/google-research/tree/master/instruction_following_eval - **论文：** https://huggingface.co/papers/2311.07911 - **排…