It should only show up when you have comments that you haven't read.

So, if you are on the home page, and one of the posts that you've already looked at, gets a comment, you'll notice that a small blue dot appears next to the number of comments. If you view the post again, the blue dot will appear near the notifications bell and you can use it to navigate between unread comments.