Complain to the JVM developers and tell them that logging to stderr is stupid. Good luck with that.
(Sorry for the cynicism.
)
You could always edit java.util.logging.ConsoleHandler.java and change this line:
setOutputStream(System.err);
to
setOutputStream(System.out);