[jira] [Updated] (SPARK-23183) Failure caused by TaskContext is missing in the thread spawned by user code

[ https://issues.apache.org/jira/browse/SPARK-23183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongqin Xiao updated SPARK-23183: - Summary: Failure caused by TaskContext is missing in the thread spawned by user code (was:

[jira] [Commented] (SPARK-23183) Failure caused by TaskContext is missing in the thread spawned by Custom RDD

[ https://issues.apache.org/jira/browse/SPARK-23183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335160#comment-16335160 ] Yongqin Xiao commented on SPARK-23183: -- Please look at reproduction mentioned in this site: 

[jira] [Commented] (SPARK-23183) Failure caused by TaskContext is missing in the thread spawned by Custom RDD

[ https://issues.apache.org/jira/browse/SPARK-23183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16335059#comment-16335059 ] Yongqin Xiao commented on SPARK-23183: -- Exact same issue reported by other user: 

[jira] [Updated] (SPARK-23183) Failure caused by TaskContext is missing in the thread spawned by Custom RDD

[ https://issues.apache.org/jira/browse/SPARK-23183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongqin Xiao updated SPARK-23183: - Description: This is related to the already resolved issue

[jira] [Created] (SPARK-23183) Failure caused by TaskContext is missing in the thread spawned by Custom RDD

Yongqin Xiao created SPARK-23183: Summary: Failure caused by TaskContext is missing in the thread spawned by Custom RDD Key: SPARK-23183 URL: https://issues.apache.org/jira/browse/SPARK-23183

[jira] [Commented] (SPARK-22828) Data corruption happens when same RDD being repeatedly used as parent RDD of a custom RDD which reads each parent RDD in concurrent threads

[ https://issues.apache.org/jira/browse/SPARK-22828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16297369#comment-16297369 ] Yongqin Xiao commented on SPARK-22828: -- I have trouble putting below response to your question in

[jira] [Updated] (SPARK-22828) Data corruption happens when same RDD being repeatedly used as parent RDD of a custom RDD which reads each parent RDD in concurrent threads

[ https://issues.apache.org/jira/browse/SPARK-22828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongqin Xiao updated SPARK-22828: - Shepherd: Jiang Xingbo > Data corruption happens when same RDD being repeatedly used as parent

[jira] [Updated] (SPARK-22828) Data corruption happens when same RDD being repeatedly used as parent RDD of a custom RDD which reads each parent RDD in concurrent threads

[ https://issues.apache.org/jira/browse/SPARK-22828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongqin Xiao updated SPARK-22828: - Description: I have defined a custom RDD that - computes the output based on input data using

[jira] [Updated] (SPARK-22828) Data corruption happens when same RDD being repeatedly used as parent RDD of a custom RDD which reads each parent RDD in concurrent threads

[ https://issues.apache.org/jira/browse/SPARK-22828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongqin Xiao updated SPARK-22828: - Description: I have defined a custom RDD that - computes the output based on input data using

[jira] [Created] (SPARK-22828) Data corruption happens when same RDD being repeatedly used as parent RDD of a custom RDD which reads each parent RDD in concurrent threads

Yongqin Xiao created SPARK-22828: Summary: Data corruption happens when same RDD being repeatedly used as parent RDD of a custom RDD which reads each parent RDD in concurrent threads Key: SPARK-22828 URL:

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

[ https://issues-test.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16167180#comment-16167180 ] Yongqin Xiao commented on SPARK-18406: -- [~cloud_fan], I see there are 3 check-ins for this

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16022077#comment-16022077 ] Yongqin Xiao commented on SPARK-18406: -- Thanks for the fix. What spark release will have it? Can we

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15970496#comment-15970496 ] Yongqin Xiao commented on SPARK-18406: -- Thanks Josh for the quick response! This issue is critical

[jira] [Commented] (SPARK-18406) Race between end-of-task and completion iterator read lock release

[ https://issues.apache.org/jira/browse/SPARK-18406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969384#comment-15969384 ] Yongqin Xiao commented on SPARK-18406: -- The same JIRA is found under