If I click on one of my tweets in my notifications (e.g. if someone liked it), I see a list of people who liked the tweet, with a follow button. I don't see a way to hide that (that I haven't already activated).