See if it helps to disable the in-page icon in the settings panel. Toggle the "Show the Relay icon in email fields on websites" setting OFF.

Hi would you be willing to let us know what website(s) you're seeing this issue on and we can take a look? Please feel free to edit your comment or you can file an issue in our github repo: https://github.com/mozilla/fx-private-relay-add-on/issues