DeepMind’s AlphaCode Explained

Overview of DeepMind’s AlphaCode system Presented by Tim Pearce: 0:00 Overview of coding problem 1:00 Overview of system 1:18 Protocol used 1:52 AlphaCode at test time 4:40 Pretraining and finetuning datasets 5:40 Training process of transformer models 7:43 Transformer architecture 8:10 Other tricks 8:23 Metadata conditioning 9:28 Outro Blog: Paper: Dataset: CodeForces website: