pull down to refresh

Yep, that's the idea. You don't give them any special powers, it's just a mutual agreement that is automated. Anyone is free to leave the pool at any time. The channels don't have to get closed either, they just become gateway channels from the perspective of the pool.
For peer swap or channel openings, for example, the node operator will get a notification and some reasonable time frame to complete it. But the moderator can't force the node to do anything.