This is just a concern I had with the client. Back during the good ol’ Reddit days, I get notified about a post/comment reply immediately when it happens. I have since left that website, and for some reason I don’t know why this isn’t a feature yet.
And yes I have tried Connect for Lemmy, I had major problems with that app.
There is a button to mark as read, aswell a mark all as read button.