Intuition Behind Self-Attention Mechanism in Transformer Networks

This is the first part of the Transformer Series. Here, I present an intuitive understanding of the self-attention mechanism in transformer networks. [Paper] Attention Is All You Need: Other Resources: Video Lecture on Word2Vec: Great article on Word2Vec: