There is no this problem above you think there is - just due to Bitcoin beauty.

The moment we will see the first "destructive halving" - i.e. network difficulty was not able to recover during long four years after given halving - is right moment to switch-off halvings completely, and that's best possible method to set level of annual inflation rate. Best - because empirically done, by saturation of Bitcoin system at global scale.

Things destructive to the Bitcoin should be eliminated (no matter from where they are). So destructive halvings as well. I predict we will see it probably in 10 years, just around 0.1% annual inflation rate, reached "naturally".