This is something I was concerned about with SN's wallet which is why I have users set a max fee and make them pay for those routing costs. It's not the best UX, but it's better than getting robbed.