A key strength of neural networks is their composability which allows them to process different forms of input and output data. This talk describes the basic building blocks of neural networks and how they handle varying types of data (such as images & text) as well as varying dataset sizes.
50. BUILDING BLOCKS
1. dense connections
2. embeddings for processing text
3. tied weights for reducing parameters
4. recurrence for handling sequences
59. BUILDING BLOCKS
1. dense connections
2. embeddings for processing text
3. tied weights for reducing parameters
4. recurrence for handling sequences
5. convolutions for processing images
61. PROBLEM: CAPTIONING IMAGES
input: output:
A group of young
people playing a
game of frisbee.
Show and Tell: A Neural Image Caption Generator: Vinyals et al