关于GCU、沐曦GPGPU、MLU、0卡V100资源4月7日恢复上架的公告>>> 关于共建具身智能开源数据集的倡议>>> 关于云脑任务中统一路径访问方式的公告>>> 关于将启智集群GPU资源迁移至智算集群的公告>>>
OpenModelZoo
/
feedback
Not watched
363
0
Code
Wiki
Issues 5
Issues
/
Detail
Labels Milestones
New Issue

#1 数据拉取时间过长

Open
opened 3 years ago by Ghost · 1 comments
Ghost commented 3 years ago

训练过程中，从OBS拉取数据花费时间较长，影响开发效率

训练过程中，从OBS拉取数据花费时间较长，影响开发效率
Ghost commented 3 years ago
Poster

经沟通了解到，任务使用的数据大多如图片类的小文件，会影响OBS效率，建议将数据集打包zip上传，训练过程中拉取zip解压后使用，会大大缩减数据拉取时间。

经沟通了解到，任务使用的数据大多如图片类的小文件，会影响OBS效率，建议将数据集打包zip上传，训练过程中拉取zip解压后使用，会大大缩减数据拉取时间。
Sign in to join this conversation.
No Branch/Tag Specified
Clear branch or tag
Branches Tags
Labels
Apply labels
Clear labels
mindspore-assistant modelArts平台问题
使用平台过程中，发生错误 其他 平台功能优化
平台使用流程不符合逻辑，或平台缺少某些通用功能 技术 社区平台问题
使用平台过程中，发生错误
No Label
mindspore-assistant
modelArts平台问题
其他
平台功能优化
技术
社区平台问题
Milestone
Set milestone
Clear milestone
No items
No Milestone
Assignees
Assign users
Clear assignees
No Assignees
1 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Write Preview
Loading…
Cancel
Save
There is no content yet.
Delete Branch '%!s(MISSING)'

Deleting a branch is permanent. It CANNOT be undone. Continue?

No
Yes
Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit