zgy
  • Wow! You can really dance ~~
  • Joined on Mar 18, 2022
  • Organization
Loading Heatmap…

zgy commented on issue OpenBMB/BMInf#1

求助,如何部署复现本项目,谢谢。

> > 1. 复现项目:要实现文本生成可以参考readme中的quick start,运行examples/generate_cpm1.py代码 > > 2. 添加语料进行微调:BMInf本身不支持全参数微调,可以利用 https://github.com/TsinghuaAI/CPM-1-Finetune 的代码进行微调,然后使用 tools/migrate_cpm1.py 将训练好的checkpoint转换为BMInf需要的checkpoint。 > > 谢谢,微调可以用https://github.com/TsinghuaAI/CPM-2-Finetune 吗? > > 可以的,对应的模型代码和checkpoint转换代码需要用cpm2的那一个。

1 year ago

zgy commented on issue OpenBMB/BMInf#1

求助,如何部署复现本项目,谢谢。

1. 复现项目:要实现文本生成可以参考readme中的quick start,运行examples/generate_cpm1.py代码 2. 添加语料进行微调:BMInf本身不支持全参数微调,可以利用 https://github.com/TsinghuaAI/CPM-1-Finetune 的代码进行微调,然后使用 tools/migrate_cpm1.py 将训练好的checkpoint转换为BMInf需要的checkpoint。

1 year ago

zgy pushed to main at OpenBMB/BMTrain

1 year ago

zgy pushed to main at OpenBMB/BMTrain

  • cb06d144a8 FX: has_inf_or_nan cuda invalid configuration argument
  • 81f1a03b77 FX: buffer size not aligned
  • 751aa393be update setup
  • f14eac3d6e Merge pull request #23 from yushengsu-thu/main fix bug in optim adam: add maximize=False to adam to support full-pre…
  • 3a774b50f0 fix bug in optim adam: add maximize=False to adam to support full-precision training
  • Compare 5 commits »

1 year ago

zgy pushed to main at OpenBMB/BMTrain

1 year ago

zgy pushed to master at OpenBMB/BMInf

2 years ago

zgy created repository OpenBMB/BMInf

2 years ago

zgy pushed to main at OpenBMB/BMTrain

2 years ago

zgy created repository OpenBMB/BMTrain

2 years ago