Brian Cho created SPARK-20261:
---------------------------------
Summary: EventLoggingListener may not truly flush the logger when
a compression codec is used
Key: SPARK-20261
URL: https://issues.apache.org/jira/browse/SPARK-20261
Project: Spark
Issue Type: Bug
Components: Spark Core
Affects Versions: 2.1.0
Reporter: Brian Cho
Priority: Minor
Log events with flushLogger set to true are supposed to immediately flush to
update the event history. However, this does not happen when using some
compression codecs e.g., LZ4BlockOutputStream, because the compressed stream
can hold on to the update until the compression block is filled.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
