I think that's a misreading of the chart and also why this chart is silly.

Countries like the US specialize because they exist in a world of widespread trade, not because they can't grow the foods that are imported.

Under autarky, farmers would face very different market incentives and would grow very different things.