posted 2 years ago
I have a scoop process that is defined like this:
It creates 4 files named: part-m-00000, part-m-00001, part-m-00002, part-m-00003
My probably stupid novice question, but has the number of created files, 4, to do with the option '-m 4'? And that option has to do with the number of parallel processes you start, I've read that so far. Or is that number of 'part' files set in some other way?