I end up needing to leave the settings page open just to switch it, as different sites require different settings.