Even though vibrate on keypress is turned on, and popup on keypress is turned off, the keys popup on keypress, but do not vibrate.
So it seems as though no matter what the settings are, the keys will popup, and not anything else.
Nvm, this seems to work now.
I have no idea why this suddenly started working.
Toggling both settings works for me.
Perhaps there were some settings "corrupted" and it healed itself when enabling/disabling or during reboot.