Sahil Takiar created HIVE-17959: ----------------------------------- Summary: SparkPartitionPruningSinkOperator buffers all writes in memory Key: HIVE-17959 URL: https://issues.apache.org/jira/browse/HIVE-17959 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Sahil Takiar Priority: Major
{{SparkPartitionPruningSinkOperator}} buffers everything in memory and only flushes to the output file with the operator is closed. This can cause memory issues. -- This message was sent by Atlassian JIRA (v6.4.14#64029)