Think Deep, Not Wide