The project was developed as part of the “Center for Brains, Minds and Machines summer school ” (2019). During the project a novel compositional neural network architecture was proposed. The architecture was shown to be able to learn to play “Game of Life” on arbitrarily long boards. Moreover, the architecture was shown to be able to perform “parity bit checking” on arbitrarily long bite strings.