Deep Learning
"Go deeper"
Convolutional Neural Networks
Scanning a photo with a magnifying glass, looking for specific patterns
Pooling and Downsampling
Summarizing a paragraph into a single sentence
Transfer Learning
Hiring someone who already knows how to cook, then training them on your specific menu
Recurrent Neural Networks
Reading a book where each word depends on all previous words
LSTMs and GRUs
A reader with a good memory who can choose to remember or forget
Attention Mechanism
Highlighting the most important words in a sentence before answering a question about it
Transformers Architecture
A room full of people who all talk to each other at once, finding the relevant connections
Batch Normalization
Resetting the scoreboard between rounds so everyone starts fair
Deep Learning: Challenge Round
Put everything together