You can apply for a T4 GPU on the Cloud Brain page under the project in the OpenI community.
This step is not detailed, it's simple. Sight in OpenI community.
If you want to apply for a GPU in the OpenI community you have to own a project first, and then apply for T4 inside the project. So you need to make PanGu-Alpha-GPU
as your personal project.
Go to the PanGu-Alpha-GPU project and click the derive
button in the upper right corner to derive your own project based on the original one.
云脑
in the projectClick新建任务
Search for the following image in the 镜像
section
数据集存放路径
fieldClick新建任务
Wait a while and the 调试
button will appear, click inside you will see the familiar jupyter debugging interface
Directory structure
/dataset/ where the dataset is stored, we put the model in this directory when we just submitted the task
/code/ where the code of your project will be copied to this directory
/model/ where the model is stored, you can download the files in this directory via model download
in the task submission screen
Go to the /code/panguAlpha_pytorch
directory
Run the inference script
python tools/generate_samples_Pangu.py \
--model-parallel-size 1 \
--num-layers 31 \
--hidden-size 2560 \
--load /dataset/Pangu-alpha_2.6B_mgt/ \
--num-attention-heads 32 \
--max-position-embeddings 1024 \
--tokenizer-type GPT2BPETokenizer \
--fp16 \
--batch-size 1 \
--seq-length 1024 \
--out-seq-length 50 \
--temperature 1.0 \
--vocab-file megatron/tokenizer/bpe_4w_pcl/vocab \
--num-samples 0 \
--top_k 2 \
--finetune
Congratulations, you have completed the inference process
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》