Historians like to blame drought, famine and invaders. But this can’t explain why the empires never came back.