[GitHub] [spark] viirya edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
viirya edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552631299 Another point is, for datasource table scan node, the parallelism is controlled b

[GitHub] [spark] viirya edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism

2019-11-11 Thread GitBox
viirya edited a comment on issue #26461: [SPARK-29831][SQL] Scan Hive partitioned table should not dramatically increase data parallelism URL: https://github.com/apache/spark/pull/26461#issuecomment-552627966 > The optimal value for each table is unknown, isn't it? This PR doesn't give any