[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14337785#comment-14337785
]
Ziv Huang commented on SPARK-3687:
--
I've already resigned my job (not due to this issue)
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14156236#comment-14156236
]
Ziv Huang commented on SPARK-3687:
--
The following is the jstack dump of one
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14152985#comment-14152985
]
Ziv Huang commented on SPARK-3687:
--
I run jps on worker node when it hangs.
I see two
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147504#comment-14147504
]
Ziv Huang commented on SPARK-3687:
--
The following is the jstack dump of one executor when
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147513#comment-14147513
]
Ziv Huang commented on SPARK-3687:
--
Just a few mins ago I ran a job twice, processing 203
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147513#comment-14147513
]
Ziv Huang edited comment on SPARK-3687 at 9/25/14 8:36 AM:
---
Just
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Comment: was deleted
(was: Just a few mins ago I ran a job twice, processing 203 sequence files.
Both
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Description:
In my application, I read more than 100 sequence files to a JavaPairRDD,
perform flatmap to
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14147504#comment-14147504
]
Ziv Huang edited comment on SPARK-3687 at 9/25/14 3:09 PM:
---
The
Ziv Huang created SPARK-3687:
Summary: Spark hang while
Key: SPARK-3687
URL: https://issues.apache.org/jira/browse/SPARK-3687
Project: Spark
Issue Type: Bug
Reporter: Ziv Huang
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Summary: Spark hang while processing more than 100 sequence files (was:
Spark hang while )
Spark hang
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Affects Version/s: 1.0.2
1.1.0
Spark hang while processing more than 100 sequence
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Component/s: Spark Core
Spark hang while processing more than 100 sequence files
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Description: I use spark
Spark hang while processing more than 100 sequence files
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Description: In my application, I read more than 100 sequence files to a
JavaPairRDD, perform flatmap to
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Description:
In my application, I read more than 100 sequence files to a JavaPairRDD,
perform flatmap to
[
https://issues.apache.org/jira/browse/SPARK-3687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Ziv Huang updated SPARK-3687:
-
Description:
In my application, I read more than 100 sequence files to a JavaPairRDD,
perform flatmap to
17 matches
Mail list logo