Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
Wh1isper b73655c8b5 | 1 year ago | |
---|---|---|
davincirunsdk | 1 year ago | |
tests | 1 year ago | |
.gitignore | 1 year ago | |
LICENSE | 1 year ago | |
MANIFEST.in | 1 year ago | |
README.md | 1 year ago | |
README.rst | 1 year ago | |
requirements.txt | 1 year ago | |
setup.cfg | 1 year ago | |
setup.py | 1 year ago |
为类Jupyter交互式环境提供Notebook友好的Ascend分布式训练SDK
以MindSpore1.5分布式训练教程 为例,使用本SDK可改造为
import os
os.environ['DATA_PATH'] = '/cache/cifar-10-batches-bin'
from davincirunsdk import start_distributed_train, wait_distributed_train
cmd = ['python', 'resnet50_distributed_training.py']
manager = start_distributed_train(cmd, output_notebook=True)
wait_distributed_train(manager)
以下命令将等价于python davincirun.py train.py
$davincirun train.py
或在python文件中使用:
from davincirunsdk import init_rank_table, start_distributed_train, wait_distributed_train
init_rank_table()
manager = start_distributed_train(['python', 'train.py'])
wait_distributed_train(manager)
同调试环境(开发环境),不需要额外修改
更多细节见案例
MIT License
$git clone https://git.openi.org.cn/Wh1isper/davincirunsdk.git
$cd davincirunsdk
$pip install -e ./
$pytest .
notebook
文件夹下是针对notebook运行环境修改的davincirun文件,以及sdk入口
davincirunsdk
目录下,除了notebook
外的文件,是原有davincurun代码,进行了python包改造,并按需启用了moxing对obs文件的支持
感谢华为云、鹏城实验室、AI靶场对本项目的大力支持和帮助
为类Jupyter交互式环境提供Notebook友好的Ascend分布式训练SDK
Python reStructuredText Batchfile Makefile other
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》