Oof yes, that's the hardest pill to swallow, I guess. To know deep down that you shouldn't be like this but you want to be for some reason. So essentially, you don't want to want to be that person.
Reminds me of that line in a very old song:
I would like to want to go to the cinema with you, but I don't.