Johnny W. created SPARK-15247: --------------------------------- Summary: sqlCtx.read.parquet yields at least n_executors * n_cores tasks Key: SPARK-15247 URL: https://issues.apache.org/jira/browse/SPARK-15247 Project: Spark Issue Type: Bug Components: SQL Affects Versions: 1.6.0 Reporter: Johnny W.
sqlCtx.read.parquet always yields at least n_executors * n_cores tasks, no matter how small the input file is. This issue can increase the latency for small jobs. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org