It is. You just have to make sure that the video is being focused
Two ways to make it focused:
1. Click it
2. When you load up a video
EDIT:
The extension's options page mistakenly listed "N" and "P" for the next and previous videos on the playlist
The actual combinations are Shift+N and Shift+P