Browser extensions can be sketchy at times. So your distrust isn't unfounded. Not to mention extensions must be lightweight. Self custodial wallets can be a little heavy so a lot of extensions opt to be an interface for a custodial wallet instead. Extensions are inherently connected to the internet any time you use them, which is a potential danger.