I don't know why you are using custom Actions.
The up/down arrow keys are already bound to Action of the JSpinner. Use the default Actions.
I don't have a problem when I use the default behaviour of a JSpinner.
Post your
SSCCE the uses the default behaviour of a JSpinner.