cpu调试任务，每次运行到特定轮次都会被killed

问题描述

任务类型（调试/训练/推理）

调试

任务名

nocol202401202054280

日志说明或问题截图

期望的解决方案或建议

有没有可能是爆内存了，老是卡在acc_iter=10这，通过输出中间变量，发现是acc_iter=11时，grad_fn内部报的killed

image.png

5.3 KiB

image.png

16 KiB

有可能是内存问题，可以选一个大内存的资源规格试试

每次进入网络都要占用掉大量内存

Deleting a branch is permanent. It CANNOT be undone. Continue?

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

#1224 cpu调试任务，每次运行到特定轮次都会被killed

问题描述

相关环境（GPU/NPU）

相关集群（启智/智算）

任务类型（调试/训练/推理）

任务名

日志说明或问题截图

期望的解决方案或建议