Channel-Wise MLPs Improve the Generalization of Recurrent Convolutional Networks

We investigate the impact of channel-wise mixing via multi-layer perceptrons (MLPs) on the generalization capabilities of recurrent convolutional networks. Specifically, we compare two architectures: DARC (Depth Aware Recurrent Convolution), which employs a simple recurrent convolutional structure, and DAMP (Depth Aware Multi-layer Perceptron), which extends DARC with a gated MLP for channel mixing. Using the Re-ARC benchmark, we find that DAMP significantly outperforms DARC in both in-distribution and out-of-distribution generalization under exact-match grading criteria. These results suggest that explicit channel mixing through MLPs enables recurrent convolutional networks to learn more robust and generalizable computational patterns. Our findings have implications for neural program synthesis and highlight the potential of DAMP as a target architecture for hypernetwork approaches.

Paper

References (11)

10ARC-icecuber: Code for 1st place so-lution to Kaggle’s Abstraction and Reasoning Challenge2020 · :/
11Getting 50% (sota) on arc-agi with gpt-4oRedwood

Similar papers

© 2026 NYSGPT2525 LLC