pull down to refresh

My Ledger wallet has multiple addresses that belong to it and it's troublesome tracking those in trackers. So my (newbie) question here: How can wallet sizes be estimated if you only know the receiving addresses and not the xpup of the single wallets? Doesn't that property lead to an overestimation of existing wallets and therefore an overestimation of the distribution of BTC?