Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Research for Visual Language Pre-trained Model #185

Open
7 of 13 tasks
Tracked by #183
PommesPeter opened this issue Apr 7, 2023 · 0 comments
Open
7 of 13 tasks
Tracked by #183

Research for Visual Language Pre-trained Model #185

PommesPeter opened this issue Apr 7, 2023 · 0 comments
Assignees
@PommesPeter
Labels
paper request Add a paper to the notes
Milestone
Multi-Modal Research

Comments

@PommesPeter
Copy link
Member

PommesPeter commented Apr 7, 2023 •
edited
Loading

There are some related paper blow:

NLP and Attention

  • Glove Word Embedding
  • CBAM
  • GPT model
  • ChatGLM

Transformer

  • Attention is all you need
  • non-local

Pre-trained

  • CLIP
  • BERT
  • DINO
  • ViT
  • BEiT

Others

  • xxx
  • xxx
@PommesPeter PommesPeter mentioned this issue Apr 7, 2023
Open
3 tasks
@PommesPeter PommesPeter added this to the Multi-Modal Research milestone Apr 7, 2023
@PommesPeter PommesPeter added the documentation Improvements or additions to documentation label Apr 7, 2023
@PommesPeter PommesPeter self-assigned this Apr 7, 2023
@PommesPeter PommesPeter added paper request Add a paper to the notes and removed documentation Improvements or additions to documentation labels Apr 7, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@PommesPeter PommesPeter

Labels
paper request Add a paper to the notes
Projects
None yet
Milestone
Multi-Modal Research
Development

No branches or pull requests
1 participant
@PommesPeter