关于GCU、沐曦GPGPU、MLU、0卡V100资源4月7日恢复上架的公告>>> 关于共建具身智能开源数据集的倡议>>> 关于云脑任务中统一路径访问方式的公告>>> 关于将启智集群GPU资源迁移至智算集群的公告>>>
PCL-Platform.Intelligence
/
Hybrid-Parallel-Solutions-MindSpore
Not watched
12
7
Fork 9
Code
Releases 0 Wiki Activity
Issues 0 Pull Requests 0 Datasets Cloudbrain
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
20 Commits
1 Branch
7.7 MiB
172 Download
 
 
 
Branch: master
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Hybrid-Parallel-Solutions-M.../transformer/src
taoht e465a81dd4 Update 2 years ago
..
__pycache__ Hybrid parallel implementation 2 years ago
__init__.py Hybrid parallel implementation 2 years ago
beam_search.py Hybrid parallel implementation 2 years ago
config.py Update 2 years ago
dataset.py Update 2 years ago
eval_config.py Hybrid parallel implementation 2 years ago
lr_schedule.py Update 2 years ago
process_output.py Hybrid parallel implementation 2 years ago
tokenization.py Hybrid parallel implementation 2 years ago
transformer_for_train.py Update 2 years ago
transformer_model.py Update 2 years ago
weight_init.py Hybrid parallel implementation 2 years ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

让模型的训练更有效率(10B以内)，支持训练更大规模的模型（>10B、50B、100B），构建支持分布式混合并行的典型模型案例，是该项目的初衷。

Python Shell Perl

Apache-2.0

Contributors (2)
All

Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit