Are you sure you want to delete this task? Once this task is deleted, it cannot be recovered.
AnjanDutta 97253f21c7 | 2 years ago | |
---|---|---|
.idea | 2 years ago | |
data | 2 years ago | |
figs | 2 years ago | |
README.md | 2 years ago | |
ViT_ZSL.ipynb | 2 years ago | |
requirements.txt | 2 years ago |
PyTorch implementation of our ViT-ZSL model for zero-shot learning:
Multi-Head Self-Attention via Vision Transformer for Zero-Shot Learning
Faisal Alamri, Anjan Dutta
IMVIP, 2021
Zero-Shot Learning (ZSL) aims to recognise unseen object classes, which are not observed during the training phase. The existing body of works on ZSL mostly relies on pretrained visual features and lacks the explicit attribute localisation mechanism on images. In this work, we propose an attention-based model in the problem settings of ZSL to learn attributes useful for unseen class recognition. Our method uses an attention mechanism adapted from Vision Transformer to capture and learn discriminative attributes by splitting images into small patches. We conduct experiments on three popular ZSL benchmarks (i.e., AWA2, CUB and SUN) and set new state-of-the-art harmonic mean results on all the three datasets, which illustrate the effectiveness of our proposed method.
Follow the instructions provided in data/Dataset_Instruction.txt
Refer to: Conda Environment for more information.
# conda create -n {ENVNAME} python=3.6
conda create -n ViT_ZSL python=3.6
# Activate the environment: conda activate {ENVNAME}
conda activate ViT_ZSL
This is a PyTorch implementation
pip install -r requirements.txt
# PyTorch
conda install pytorch torchvision torchaudio cudatoolkit=11.1 -c pytorch -c nvidia
open ViT_ZSL.ipynb
jupyter notebook ViT_ZSL.ipynb
Please do read our paper.
If you still require any further information, feel free to contact us at our emails.
If you use ViT-ZSL in your research, please use the following BibTeX entry.
@InProceedings{Alamri2021ViTZSL,
author = {Faisal Alamri and Anjan Dutta},
title = {Multi-Head Self-Attention via Vision Transformer for Zero-Shot Learning},
booktitle = {IMVIP},
year = {2021}
}
No Description
Jupyter Notebook Text
Dear OpenI User
Thank you for your continuous support to the Openl Qizhi Community AI Collaboration Platform. In order to protect your usage rights and ensure network security, we updated the Openl Qizhi Community AI Collaboration Platform Usage Agreement in January 2024. The updated agreement specifies that users are prohibited from using intranet penetration tools. After you click "Agree and continue", you can continue to use our services. Thank you for your cooperation and understanding.
For more agreement content, please refer to the《Openl Qizhi Community AI Collaboration Platform Usage Agreement》