Skip to content

修改ifbench/aa_lcr描述 #440

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
jschen069 wants to merge 1 commit into
base: master
Choose a base branch
from
Open

修改ifbench/aa_lcr描述 #440

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
9 changes: 5 additions & 4 deletions ais_bench/benchmark/configs/datasets/aa_lcr/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,12 +11,13 @@ AA-LCR（Artificial Analysis Long Context Retrieval）是一个用于评估语
## 数据集部署

- 可以从 ModelScope 的数据集链接 🔗 [https://modelscope.cn/datasets/evalscope/AA-LCR](https://modelscope.cn/datasets/evalscope/AA-LCR) 中获取数据集。
- AA-LCR 数据集为压缩包格式，建议部署在 `{tool_root_path}/ais_bench/datasets/aa_lcr/` 目录下。
- AA-LCR 数据集为压缩包格式，建议部署在 `{tool_root_path}/ais_bench/datasets/AA-LCR/` 目录下。

- 在 `{tool_root_path}/ais_bench/datasets/aa_lcr/` 目录下执行 `ls -la` 检查目录结构。如果目录结构如下所示，则数据集部署成功：
- 在 `{tool_root_path}/ais_bench/datasets/` 目录下执行 `tree AA-LCR/` 检查目录结构。如果目录结构如下所示，则数据集部署成功：
```
{tool_root_path}/ais_bench/datasets/aa_lcr/
└── extracted_text/AA-LCR_extracted-text.zip
AA-LCR/
└── extracted_text/
└── AA-LCR_extracted-text.zip
```


Expand Down
9 changes: 5 additions & 4 deletions ais_bench/benchmark/configs/datasets/aa_lcr/README_en.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,12 +11,13 @@ AA-LCR (Artificial Analysis Long Context Retrieval) is a benchmark for evaluatin
## Dataset Deployment

- The dataset can be obtained from the ModelScope dataset link: 🔗 [https://modelscope.cn/datasets/evalscope/AA-LCR](https://modelscope.cn/datasets/evalscope/AA-LCR).
- The AA-LCR dataset is in compressed archive format and is recommended to be deployed in the `{tool_root_path}/ais_bench/datasets/aa_lcr/` directory.
- The AA-LCR dataset is in compressed archive format and is recommended to be deployed in the `{tool_root_path}/ais_bench/datasets/AA-LCR/` directory.

- Execute `ls -la` in the `{tool_root_path}/ais_bench/datasets/aa_lcr/` directory to check the directory structure. If the directory structure is as shown below, the dataset has been deployed successfully:
- Execute `tree AA-LCR/` in the `{tool_root_path}/ais_bench/datasets/` directory to check the directory structure. If the directory structure is as shown below, the dataset has been deployed successfully:
```
{tool_root_path}/ais_bench/datasets/aa_lcr/
└── extracted_text/AA-LCR_extracted-text.zip
AA-LCR/
└── extracted_text/
└── AA-LCR_extracted-text.zip
```


Expand Down
9 changes: 5 additions & 4 deletions ais_bench/benchmark/configs/datasets/ifbench/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,12 +13,13 @@ IFBench 是一个用于评估 AI 模型在遵循新颖、具有挑战性且多
## 数据集部署

- 可以从 Hugging Face 的数据集链接 🔗 [https://huggingface.co/datasets/allenai/IFBench_test](https://huggingface.co/datasets/allenai/IFBench_test) 中获取数据集。
- IFBench 数据集为 Parquet 格式，建议部署在 `{tool_root_path}/ais_bench/datasets/ifbench/data/` 目录下。
- IFBench 数据集为 Parquet 格式，建议部署在 `{tool_root_path}/ais_bench/datasets/IFBench_test/data/` 目录下。

- 在 `{tool_root_path}/ais_bench/datasets/ifbench/data/` 目录下执行 `ls -la` 检查目录结构。如果目录结构如下所示，则数据集部署成功：
- 在 `{tool_root_path}/ais_bench/datasets/` 目录下执行 `tree IFBench_test/` 检查目录结构。如果目录结构如下所示，则数据集部署成功：
```
{tool_root_path}/ais_bench/datasets/ifbench/data/
└── train-00000-of-00001.parquet
IFBench_test/
└── data/
└── train-00000-of-00001.parquet
```


Expand Down
9 changes: 5 additions & 4 deletions ais_bench/benchmark/configs/datasets/ifbench/README_en.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -13,12 +13,13 @@ IFBench is a benchmark for evaluating the reliability of AI models in following
## Dataset Deployment

- The dataset can be obtained from the Hugging Face dataset link: 🔗 [https://huggingface.co/datasets/allenai/IFBench_test](https://huggingface.co/datasets/allenai/IFBench_test).
- The IFBench dataset is in Parquet format and is recommended to be deployed in the `{tool_root_path}/ais_bench/datasets/ifbench/data/` directory.
- The IFBench dataset is in Parquet format and is recommended to be deployed in the `{tool_root_path}/ais_bench/datasets/IFBench_test/data/` directory.

- Execute `ls -la` in the `{tool_root_path}/ais_bench/datasets/ifbench/data/` directory to check the directory structure. If the directory structure is as shown below, the dataset has been deployed successfully:
- Execute `tree IFBench_test/` in the `{tool_root_path}/ais_bench/datasets/` directory to check the directory structure. If the directory structure is as shown below, the dataset has been deployed successfully:
```
{tool_root_path}/ais_bench/datasets/ifbench/data/
└── train-00000-of-00001.parquet
IFBench_test/
└── data/
└── train-00000-of-00001.parquet
```


Expand Down
Loading