can fedimint guardians collude to deanonymize me or target my specific ecash tokens
No, they can not. It's either applied to all or applied to none. Anonymous bearer tokens have incredibly great privacy.