Signed in
We value your privacy
This site uses cookies to improve your browsing experience, analyze site traffic, and show personalized content.
| $20.11% | |
| $10.06% | |
| $0.870.05% | |
| $0.700.04% | |
| $0.370.02% | |
| $0.360.02% | |
| $0.330.02% | |
| $0.190.01% | |
| $0.170.01% | |
| $0.080.00% | |
| $0.040.00% | |
| $0.040.00% |
Implementation of hedgehog transformer which is a Linear Attention Mechanism inspired by the concept described in "The Hedgehog & the Porcupine: Expressive Linear Attentions with Softmax Mimicry." https://arxiv.org/pdf/2402.04347.pdf