Architectures in neural networks commonly assume that inference is hierarchical. In this Perspective, Suzuki et al. present the shallow brain hypothesis, a neural processing mechanism based on neuroanatomical and electrophysiological evidence that intertwines hierarchical cortical processing with a massively parallel process to which subcortical areas substantially contribute.