启智训练集群偶现lr为负数的情况

问题描述

在单节点8卡训练及多节点8卡训练均出现过lr为负数的情况，无法训练网络

任务类型（调试/训练/推理）

训练

任务名

lixia202212061510312 - v24和v23

日志说明或问题截图

期望的解决方案或建议

修复lr为负数的情况

928782c32adf2b93dbb6672d71364b2.png

14 KiB

image.png

23 KiB

重试下看是否还有此问题

Deleting a branch is permanent. It CANNOT be undone. Continue?

Dear OpenI User

Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.

For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》

#393 启智训练集群偶现lr为负数的情况

问题描述

相关环境（GPU/NPU）

相关集群（启智/智算）

任务类型（调试/训练/推理）

任务名

日志说明或问题截图

期望的解决方案或建议