I would suggest against having the security key to be your wallet. Wallet should be a wallet, while security key should be a security key. Having them combined means more lines of code, more place to developers to fail.

YubiKey is great, soon there will be Mullvad security key too.