Deleting a branch is permanent. It CANNOT be undone. Continue?
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》
用启智里云脑镜像dockerhub.pcl.ac.cn:5000/user-images/yands:megatron_lm_20_03
数据集Pangu-alpha_2.6B_fp16_mgt.zip
在目录panguAlpha_pytorch/examples/下
1 运行脚本finetune_pangu_distributed.sh
显示错误
File "/code/panguAlpha_pytorch/examples/finetune_pangu_distributed.sh", line 12
WORLD_SIZE=$(($GPUS_PER_NODE*$NNODES))
^
SyntaxError: invalid syntax
2 运行脚本 pretrain_pangu_distributed_2.6B.sh
显示错误
File "/code/panguAlpha_pytorch/examples/pretrain_pangu_distributed_2.6B.sh", line 3
export CUDA_VISIBLE_DEVICES="2,3,4,5"
^
SyntaxError: invalid syntax
请用bash finetune_pangu_distributed.sh来执行脚本。然后根据您的资源和数据位置,修改.sh文件配置