关于GCU、沐曦GPGPU、MLU、0卡V100资源4月7日恢复上架的公告>>> 关于共建具身智能开源数据集的倡议>>> 关于云脑任务中统一路径访问方式的公告>>> 关于将启智集群GPU资源迁移至智算集群的公告>>>
MeRanSeTi
/
Chinese-Megatron
forked from PCL-Platform.Intelligence/Chinese-Megatron
Not watched
1
6
Fork 4
Code
Releases 0 Wiki Activity
Issues 0 Pull Requests 0 Datasets Cloudbrain
You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
8 Commits
1 Branch
1.2 MiB
17 Download
 
 
 
 
 
 
Branch: master
Branches Tags
${ item.name }
Create branch ${ searchTerm }
from 'master'
${ noResults }
Chinese-Megatron/nvidia-code/examples
zhanghangit bf716fb7c0 add nvidia megatron code 3 years ago
..
.ipynb_checkpoints add nvidia megatron code 3 years ago
.pretrain_gpt2_distributed_2.6B.sh.swo add nvidia megatron code 3 years ago
debug_pretrain_gpt2_distributed_xxxM.sh add nvidia megatron code 3 years ago
evalPPL_gpt2_distributed.sh add nvidia megatron code 3 years ago
evaluate_zeroshot_gpt2.sh add nvidia megatron code 3 years ago
finetune_mnli_distributed.sh add nvidia megatron code 3 years ago
finetune_race_distributed.sh add nvidia megatron code 3 years ago
generate_text.sh add nvidia megatron code 3 years ago
generate_text_cmrc2018.sh add nvidia megatron code 3 years ago
merge_mp_bert.sh add nvidia megatron code 3 years ago
pretrain_bert.sh add nvidia megatron code 3 years ago
pretrain_bert_distributed.sh add nvidia megatron code 3 years ago
pretrain_gpt2.sh add nvidia megatron code 3 years ago
pretrain_gpt2_distributed.sh add nvidia megatron code 3 years ago
pretrain_gpt2_distributed_2.6B.sh add nvidia megatron code 3 years ago
pretrain_gpt2_distributed_345M.sh add nvidia megatron code 3 years ago
Delete task

Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.

cancel
confirm

使用100G中文高质量语料，128张V100，训练的中文Megatron模型，参数量2.6B

Python C++ Shell Cuda TeX other

Contributors (2)
All

Please read the following content carefully:

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

Agree and continue
Disagree, exit