Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
BAAI-WuDao 35bf709642 | 2 years ago | |
---|---|---|
FastMoE | 2 years ago | |
InfMoE | 2 years ago | |
InversePrompting | 2 years ago | |
KnowledgeInheritance | 2 years ago | |
P-tuning | 2 years ago | |
TDS | 2 years ago | |
.gitignore | 2 years ago | |
README.md | 2 years ago |
“悟道”项目开发了一系列创新的算法工具,用于提升模型预训练的效率和效果。
P-Promptuning算法在历史上首次实现自回归模型在理解任务上超越自编码模型,并在知识探测和小样本学习的多个数据集上取得世界第一,提升高达20百分点。
Inverse Prompting旨在提升文本生成任务的可控性和相关性,让回答和问题关联性更强,即更好地利用 Prompt 的信息来控制所生成的内容。
FastMoE是首个支持国产超算和GPU的高性能MoE系统,同时支持Switch,Gshard等复杂均衡策略。
InfMoE是世界首创低资源大模型推理系统,单卡GPU可以进行千亿规模模型的推理。
预训练知识继承是世界首创大规模预训练融合框架-缩短大模型近50%前期训练时间。
3D加速框架TDS采用DeepSpeed结合TDS插件,可同时支持数据/模型/流水并行、ZeRO和混合加速。
“悟道”项目开源算法和工具
Python Text C++ Cuda Shell other
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》