It is actually number of cores. If your processor has hyperthreading then it will be more (number of processors your OS sees)
niedz., 22 mar 2015, 4:51 PM Ted Yu użytkownik <[email protected]> napisał: > I assume spark.default.parallelism is 4 in the VM Ashish was using. > > Cheers >
