You can not select more than 25 topics Topics must start with a chinese character,a letter or number, can include dashes ('-') and can be up to 35 characters long.
 
 
 
 
ZJUTER0126 65625d6f3a add Ascend910 training, Ascend310 infer for cct 2 years ago
..
run_distribute_train_ascend.sh add Ascend910 training, Ascend310 infer for cct 2 years ago
run_eval_ascend.sh add Ascend910 training, Ascend310 infer for cct 2 years ago
run_infer_310.sh add Ascend910 training, Ascend310 infer for cct 2 years ago
run_standalone_train_ascend.sh add Ascend910 training, Ascend310 infer for cct 2 years ago

目前transformer往往依赖于大规模的而数据和强大的计算资源,这对于一些小的领域很难进行尝试。CCT: Convolutional Compact Transformer, 在CVT的基础上进一步处理输入数据,即将image经过若干conv之后再划分patch token,输入CVT中, CNN的使用能够减弱position embedding的依赖。每个conv block包括conv layer, relu和maxpool, 可以多个conv block叠加。

Python C++ Shell Text

Contributors (2)