In the current paradigm of LLMs, I'd put my money on it reaching a plateau with small incremental changes.

You can't just extrapolate the last few years and assume it'll keep going.

The next jump will imo only happen with a whole new fundamentally different type of approach.