Now I'm sure that I'm not getting the red square notification icon I was talking about here: #430959

I also see the option is gone from the settings. I just unsubbed and resubbed to ~UFOs to see if that might do anything.