[
https://issues.apache.org/jira/browse/SPARK-20243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bogdan Raducanu updated SPARK-20243:
------------------------------------
Description:
Introduced by SPARK-19946.
DebugFilesystem.assertNoOpenStreams gets the size of the openStreams
ConcurrentHashMap and then later, if the size was > 0, accesses the first
element in openStreams.values. But, the ConcurrentHashMap might be cleared by
another thread between getting its size and accessing it, resulting in an
exception when trying to call .head on an empty collection.
was:Introduced by SPARK-19946
> DebugFilesystem.assertNoOpenStreams thread race
> -----------------------------------------------
>
> Key: SPARK-20243
> URL: https://issues.apache.org/jira/browse/SPARK-20243
> Project: Spark
> Issue Type: Bug
> Components: Tests
> Affects Versions: 2.2.0
> Reporter: Bogdan Raducanu
>
> Introduced by SPARK-19946.
> DebugFilesystem.assertNoOpenStreams gets the size of the openStreams
> ConcurrentHashMap and then later, if the size was > 0, accesses the first
> element in openStreams.values. But, the ConcurrentHashMap might be cleared by
> another thread between getting its size and accessing it, resulting in an
> exception when trying to call .head on an empty collection.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
