This shouldn't be an issue with the plugin.
Not sure why you're having that issue, do you have anything else interacting with audio / firefox?
For convenience upon clicking, the slider is in focus, perhaps you have a device where the direction is locking to the right? Like in windows if you have an xbox controller plugged in with joystick drift.