[
https://issues.apache.org/jira/browse/SPARK-23185?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Apache Spark reassigned SPARK-23185:
------------------------------------
Assignee: Apache Spark
> Make the configuration "spark.default.parallelism" can be changed on each SQL
> session to decrease empty files
> -------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-23185
> URL: https://issues.apache.org/jira/browse/SPARK-23185
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.2.1
> Reporter: LvDongrong
> Assignee: Apache Spark
> Priority: Minor
>
> When execute "insert into ... values ...", many empty files will be
> generated.We can change the configuration "spark.default.parallelism" to
> decrease the number of empty files.But there are many occasions that we want
> to chang the configuration during each session so as not to influence other
> sql sentences, like we may use thrift server to excute many sql sentences on
> a SQL session.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
