This is Windows, right? Yeah, it doesn't work because of something like this: the file doesn't get closed, so Windows has a lock on it, so it can't be renamed. I tried to fix the appender to close the file properly but in the end I found a thing called
DatedFileAppender and used that instead.
Works fine on other operating systems though.