Introduction to Transformers

An introduction to the transformer architecture and the attention mechanism lying at its heart, following the famous paper “Attention Is All You Need” by Vaswani et. al. Presented at the Colfax Seminar by a team member.