Transformers, capsules, or both?
From Attention in Transformers to Dynamic Routing in Capsule Nets
In this post, we go through the main building blocks of transformers and capsule networks and try to draw a connection between different components of these two models. Our main goal here is to understand if these models are inherently different and if not, how they relate.
The full blogpost is published on Samira’s homepage.