关于GCU、沐曦GPGPU、MLU、0卡V100资源4月7日恢复上架的公告>>> 关于共建具身智能开源数据集的倡议>>> 关于云脑任务中统一路径访问方式的公告>>> 关于将启智集群GPU资源迁移至智算集群的公告>>>
PCL-Platform.Intelligence
/
PanGu-Alpha
Not watched
51
114
Fork 66
Code
Releases 0 Wiki Activity
Issues 7 Pull Requests 1 Datasets Cloudbrain
Issues
/
Detail
Labels Milestones
New Issue

#27 PANGU-α 论文中 DuReader任务处理细节

Open
created 2 years ago by houking · 0 comments
houking commented 2 years ago

您好，论文在用评测PANGU-α的能力时，没有说明各个任务的处理细节。比如DuReader这个数据集，论文中庸的是zhidao这个subset用于评测，有如下几个问题：

  1. 论文中提到DuReader采用的prompt是：“阅读文章：$Document\n问：$Question\n答” 这里是Document是全部的每个样本中全部的paragraphs，还是只选用了 is_select=True的paragraphs
  2. answers 可能是多个，在算Rouge-1分数时是如何选取的
  3. Rouge-1中 1-gram是指的单个中文字符（char），还是分词后 一个词(word)的粒度。如果是词的粒度，分词是用的什么工具。
  4. 计算rouge指标用的工具是什么，pyrouge还是dureader提供的脚本
您好，论文在用评测PANGU-α的能力时，没有说明各个任务的处理细节。比如DuReader这个数据集，论文中庸的是zhidao这个subset用于评测，有如下几个问题： 1. 论文中提到DuReader采用的prompt是：“阅读文章：$Document\n问：$Question\n答” 这里是Document是全部的每个样本中全部的paragraphs，还是只选用了 is_select=True的paragraphs 2. answers 可能是多个，在算Rouge-1分数时是如何选取的 3. Rouge-1中 1-gram是指的单个中文字符（char），还是分词后 一个词(word)的粒度。如果是词的粒度，分词是用的什么工具。 4. 计算rouge指标用的工具是什么，pyrouge还是dureader提供的脚本
Sign in to join this conversation.
No Branch/Tag Specified
Clear branch or tag
Branches Tags
Labels
Apply labels
Clear labels
No items
No Label
Milestone
Set milestone
Clear milestone
No items
No Milestone
Assignees
Assign users
Clear assignees
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Write Preview
Loading…
Cancel
Save
There is no content yet.
Delete Branch '%!s(MISSING)'

Deleting a branch is permanent. It CANNOT be undone. Continue?

No
Yes
Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit