[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-10 Thread Dyno (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132746#comment-17132746 ] Dyno commented on HADOOP-17063: --- > important: you are using the classic FileOutputCommitter; this is slow

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132581#comment-17132581 ] Steve Loughran commented on HADOOP-17063: - stack 40 is the same; stack 34 is the one blocking

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132574#comment-17132574 ] Steve Loughran commented on HADOOP-17063: - jstack 74, delete objects is blocking. maybe

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-10 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17132571#comment-17132571 ] Steve Loughran commented on HADOOP-17063: - thanks for the stack. regarding the test

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-09 Thread Dyno (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17129802#comment-17129802 ] Dyno commented on HADOOP-17063: --- it happens again i attached the jstack. thanks for looking into it. i

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125838#comment-17125838 ] Steve Loughran commented on HADOOP-17063: - note: if you supply the patch to

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-04 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125823#comment-17125823 ] Steve Loughran commented on HADOOP-17063: - Looking at the relevant code, we are scheduling the

[jira] [Commented] (HADOOP-17063) S3ABlockOutputStream.putObject looks stuck and never timeout

2020-06-03 Thread Dyno (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17125413#comment-17125413 ] Dyno commented on HADOOP-17063: --- log in the spark executor, Jun 3, 2020 @ 22:57:23.032 2020-06-03