Go to the main menu by clicking on your avatar, the view bellow will show, click on "Settings and Privacy"

The following view will show, click on "Privacy and Safety" (the irony...)

The following view will show, scroll down until the end, click on "Grok"

The final view below will show, X (Twitter) profiles you by default, you need to remove your consent, unclick the tick box and you are done.

Suggestion While you are there, check the rest of the privacy settings, there are others like sharing your data and location that perhaps you would like to remove as well...