Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
PCL-张晗 e04663e67a | 2 years ago | |
---|---|---|
bpe_3w_new | 2 years ago | |
nvidia-code | 2 years ago | |
README.md | 2 years ago | |
tokenization_jieba.py | 2 years ago |
本模型使用Megatron代码训练,使用了清源公布的3万字词表,数据使用100G高质量中文语料
模型参数2.6B,模型采用GPT结构,使用了数据并行和张量并行并行方式,模型文件可以在数据集中下载。
或百度网盘:
链接:https://pan.baidu.com/s/17x4ZpcS8b7zabWtKtsiWOw
提取码:ep3f
模型的训练和推理与英伟达的Megatron代码一致,使用说明请参考NVIDIA-Megatron: https://github.com/NVIDIA/Megatron-LM
使用100G中文高质量语料,128张V100,训练的中文Megatron模型,参数量2.6B
Python C++ Shell Cuda TeX other
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》