That's how I often feel too, but I blame the other person(s), rather than the topic.

I've had really good conversations about politics with people who hold radically different views, because we were both interested in the ideas.

I avoid any conversation when I sense the person I'm talking to is too close-minded to entertain views other than their own. Then I avoid those people going forward.