启智社区最近又发版了,新增模型推理功能,欢迎大家体验>>>

#22 在启智里用云脑运行finetune训练脚本发生错误

Closed
created 3 months ago by zhaoxiong · 1 comments

用启智里云脑镜像dockerhub.pcl.ac.cn:5000/user-images/yands:megatron_lm_20_03
数据集Pangu-alpha_2.6B_fp16_mgt.zip
在目录panguAlpha_pytorch/examples/下

1 运行脚本finetune_pangu_distributed.sh
显示错误
File “/code/panguAlpha_pytorch/examples/finetune_pangu_distributed.sh”, line 12
WORLD_SIZE=$(($GPUS_PER_NODE*$NNODES))
^
SyntaxError: invalid syntax

2 运行脚本 pretrain_pangu_distributed_2.6B.sh
显示错误
File “/code/panguAlpha_pytorch/examples/pretrain_pangu_distributed_2.6B.sh”, line 3
export CUDA_VISIBLE_DEVICES="2,3,4,5”
^
SyntaxError: invalid syntax

用启智里云脑镜像dockerhub.pcl.ac.cn:5000/user-images/yands:megatron_lm_20_03 数据集Pangu-alpha_2.6B_fp16_mgt.zip 在目录panguAlpha_pytorch/examples/下 1 运行脚本finetune_pangu_distributed.sh 显示错误 File "/code/panguAlpha_pytorch/examples/finetune_pangu_distributed.sh", line 12 WORLD_SIZE=$(($GPUS_PER_NODE*$NNODES)) ^ SyntaxError: invalid syntax 2 运行脚本 pretrain_pangu_distributed_2.6B.sh 显示错误 File "/code/panguAlpha_pytorch/examples/pretrain_pangu_distributed_2.6B.sh", line 3 export CUDA_VISIBLE_DEVICES="2,3,4,5" ^ SyntaxError: invalid syntax
imyzx commented 3 months ago
Owner

请用bash finetune_pangu_distributed.sh来执行脚本。然后根据您的资源和数据位置,修改.sh文件配置

请用bash finetune_pangu_distributed.sh来执行脚本。然后根据您的资源和数据位置,修改.sh文件配置
superqing closed this issue 2 months ago
Sign in to join this conversation.
No Label
No Milestone
No Assignees
2 Participants
Notifications
Due Date

No due date set.

Dependencies

This issue currently doesn't have any dependencies.

Loading…
There is no content yet.