If you're interested in positional embeddings for Transformers, check out this r... | Hacker News

Hacker News new | past | comments | ask | show | jobs | submit

login

Scene_Cast2 3 months ago | parent | context | favorite | on: You could have designed state of the art positiona...

If you're interested in positional embeddings for Transformers, check out this repo - https://github.com/gazelle93/Attention-Various-Positional-En... - it implements various popular ones.

Join us for AI Startup School this June 16-17 in San Francisco!
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact