Let's see how this goes first. There are a variety of tradeoffs to any approach.
If territories were opt-in only, then we'd have to default people to some set of territories (which would biased as hell) or have none selected to start in which case you'd have an empty experience like on twitter.
While this might not be a forever approach, it is congruent with muting and unmuting stackers which is very nice I think.