Scaling can lead to compositional generalization

TL;DR

Can neural networks systematically capture discrete, compositional task structure despite their continuous, distributed nature? The impressive capabilities of large-scale neural networks suggest that…

Opening excerpt from the authors’ abstract. source