Good question. Why even require a Tapsigner then?

You'd also have to trust them with your privacy as you're sharing a multisig with them.