You'd have to switch `extensions.allowPrivateBrowsingByDefault` to `false` in `about:config` too to make it work. Details: https://bugzilla.mozilla.org/show_bug.cgi?id=1600423