The Transformer Architecture

Implement sinusoidal positional encodings for sequence order information

Build a complete Transformer encoder block, including multi-head attention and a position-wise feed-forward network

Build a Transformer decoder block with masked multi-head self-attention

Apply layer normalization and residual connections within the Transformer architecture

Assemble a full encoder-decoder Transformer model from scratch