It's a factual argument. Our civilization has been peaking in agricultural productivity decade after decade for 200 years. Your hypothetical argument is not statistically likely. Sure, on a long enough time frame some natural disaster will occur that causes a crisis, but the fundamental mechanics of photosynthesis and ag science aren't going anywhere.