Maybe you consider to talk to them again on neutral ground where they have the possibility of free speech.
lololol
Given I was talking to them in private, eg at their own home, and they knew me personally, they certainly could have said anything they wanted.