The tension is between simplicity and flexibility. A blacklist could work as a compromise between saving settings for each site and nothing.

Contrast to dark backgrounds is a real problem. There are ways to guess the background color, none of them fully reliable. I keep wishing that someday browsers will expose the computed background.

I did not know that a restart is required. Will see if anything can be done.