Hi, I am wondering the mechanism that determines the number of partitions created by SparkContext.sequenceFile ?
For example, although my file has only 4 splits, Spark would create 16 partitions for it. Is it determined by the file size? Is there any way to control it? (Looks like I can only tune minPartitions but not maxPartitions) Thank you! Best, Wenlei
