EDIT: I suddenly got it to work by checking the "Require verification for browser integration" setting, setting up Biometrics in the Firefox extension, and then after logging in, unchecking the setting again. Now it works every time. Weird why this was necessary.
The biometrics integration stopped working recently, which very much sucks.