So you are saying we should uncap the block size limit as long as its filled with witness data?

It is simple and doable with policy or a soft fork.

What you are proposing would require a hard fork.