Shixiong Zhu created SPARK-18187:
------------------------------------
Summary: CompactibleFileStreamLog should not rely on
"compactInterval" to detect a compaction batch
Key: SPARK-18187
URL: https://issues.apache.org/jira/browse/SPARK-18187
Project: Spark
Issue Type: Sub-task
Components: SQL
Affects Versions: 2.0.1
Reporter: Shixiong Zhu
Right now CompactibleFileStreamLog uses compactInterval to check if a batch is
a compaction batch. However, since this conf is controlled by the user, they
may just change it, and CompactibleFileStreamLog will just silently return the
wrong answer.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
