[jira] [Commented] (HADOOP-14965) s3a input stream "normal" fadvise mode to be adaptive

2022-02-08 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17489161#comment-17489161 ] Yongjun Zhang commented on HADOOP-14965: Hi [~ste...@apache.org] , Thanks for the work here.

[jira] [Commented] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2021-03-26 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309433#comment-17309433 ] Yongjun Zhang commented on HADOOP-17338: For the record, thanks [~ste...@apache.org] for

[jira] [Commented] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2021-03-25 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17309155#comment-17309155 ] Yongjun Zhang commented on HADOOP-17338: Sorry [~ste...@apache.org] I missed your message

[jira] [Commented] (HADOOP-16767) S3AInputStream reopening does not handle non IO exceptions properly

2021-02-08 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17281519#comment-17281519 ] Yongjun Zhang commented on HADOOP-16767: Thanks [~ste...@apache.org]! > S3AInputStream

[jira] [Comment Edited] (HADOOP-16767) S3AInputStream reopening does not handle non IO exceptions properly

2021-02-07 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280758#comment-17280758 ] Yongjun Zhang edited comment on HADOOP-16767 at 2/8/21, 5:34 AM: -

[jira] [Comment Edited] (HADOOP-16767) S3AInputStream reopening does not handle non IO exceptions properly

2021-02-07 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280758#comment-17280758 ] Yongjun Zhang edited comment on HADOOP-16767 at 2/8/21, 5:33 AM: -

[jira] [Commented] (HADOOP-16767) S3AInputStream reopening does not handle non IO exceptions properly

2021-02-07 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17280758#comment-17280758 ] Yongjun Zhang commented on HADOOP-16767: Thanks [~spoganshev] for the work here. Hi

[jira] [Commented] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2021-01-04 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17258363#comment-17258363 ] Yongjun Zhang commented on HADOOP-17338: Happy new year and many thanks again

[jira] [Commented] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-12-18 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252071#comment-17252071 ] Yongjun Zhang commented on HADOOP-17338: Many thanks to [~ste...@apache.org] for reviewing and

[jira] [Updated] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-11-10 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-17338: --- Description: We are seeing the following two kinds of intermittent exceptions when using

[jira] [Commented] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-11-10 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17229470#comment-17229470 ] Yongjun Zhang commented on HADOOP-17338: HI [~ste...@apache.org], Sorry for the delay. I tried

[jira] [Commented] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-11-02 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17225132#comment-17225132 ] Yongjun Zhang commented on HADOOP-17338: Many thanks for the nice feedback

[jira] [Updated] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-11-01 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-17338: --- Description: We are seeing the following two kinds of intermittent exceptions when using

[jira] [Resolved] (HADOOP-17312) S3AInputStream to be resilient to faiures in abort(); translate AWS Exceptions

2020-10-30 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17312?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-17312. Resolution: Duplicate > S3AInputStream to be resilient to faiures in abort(); translate

[jira] [Commented] (HADOOP-14596) AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error

2020-10-30 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17223956#comment-17223956 ] Yongjun Zhang commented on HADOOP-14596: HI [~ste...@apache.org], Finally got to the bottom of

[jira] [Work started] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-10-30 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HADOOP-17338 started by Yongjun Zhang. -- > Intermittent S3AInputStream failures: Premature end of Content-Length

[jira] [Updated] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-10-30 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-17338: --- Attachment: HADOOP-17338.001.patch > Intermittent S3AInputStream failures: Premature end

[jira] [Updated] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-10-30 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-17338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-17338: --- Description: We are seeing the following exceptions intermittently when using

[jira] [Created] (HADOOP-17338) Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc

2020-10-30 Thread Yongjun Zhang (Jira)
Yongjun Zhang created HADOOP-17338: -- Summary: Intermittent S3AInputStream failures: Premature end of Content-Length delimited message body etc Key: HADOOP-17338 URL:

[jira] [Commented] (HADOOP-14596) AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error

2020-09-16 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17196743#comment-17196743 ] Yongjun Zhang commented on HADOOP-14596: Thanks a lot [~ste...@apache.org]! Sorry did not see

[jira] [Comment Edited] (HADOOP-14596) AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error

2020-08-21 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182240#comment-17182240 ] Yongjun Zhang edited comment on HADOOP-14596 at 8/22/20, 3:46 AM: -- Hi

[jira] [Commented] (HADOOP-14596) AWS SDK 1.11+ aborts() on close() if > 0 bytes in stream; logs error

2020-08-21 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17182240#comment-17182240 ] Yongjun Zhang commented on HADOOP-14596: Hi [~ste...@apache.org], Thank you for the work here!

[jira] [Commented] (HADOOP-14040) Use shaded aws-sdk uber-JAR 1.11.86

2020-08-05 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17171886#comment-17171886 ] Yongjun Zhang commented on HADOOP-14040: Many thanks [~liuml07]! > Use shaded aws-sdk uber-JAR

[jira] [Commented] (HADOOP-14040) Use shaded aws-sdk uber-JAR 1.11.86

2020-07-29 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167544#comment-17167544 ] Yongjun Zhang commented on HADOOP-14040: Thanks a lot [~liuml07]! > Use shaded aws-sdk

[jira] [Commented] (HADOOP-14040) Use shaded aws-sdk uber-JAR 1.11.86

2020-07-29 Thread Yongjun Zhang (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-14040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17167312#comment-17167312 ] Yongjun Zhang commented on HADOOP-14040: HI [~liuml07] [~ste...@apache.org], Thanks for the

[jira] [Issue Comment Deleted] (HADOOP-12909) Change ipc.Client to support asynchronous calls

2019-03-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-12909: --- Comment: was deleted (was: Hi [~xiaobingo] and [~szetszwo], Thanks for your work here.

[jira] [Issue Comment Deleted] (HADOOP-15720) rpcTimeout may not have been applied correctly

2019-03-03 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15720: --- Comment: was deleted (was: The latest RPC code is changed (by HADOOP-12909 and related) to

[jira] [Comment Edited] (HADOOP-12909) Change ipc.Client to support asynchronous calls

2019-02-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16778680#comment-16778680 ] Yongjun Zhang edited comment on HADOOP-12909 at 2/26/19 11:14 PM: -- Hi

[jira] [Comment Edited] (HADOOP-12909) Change ipc.Client to support asynchronous calls

2019-02-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16778680#comment-16778680 ] Yongjun Zhang edited comment on HADOOP-12909 at 2/26/19 11:13 PM: -- Hi

[jira] [Commented] (HADOOP-12909) Change ipc.Client to support asynchronous calls

2019-02-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16778680#comment-16778680 ] Yongjun Zhang commented on HADOOP-12909: Hi [~xiaobingo], Thanks for your work here. One

[jira] [Commented] (HADOOP-15720) rpcTimeout may not have been applied correctly

2019-02-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16778657#comment-16778657 ] Yongjun Zhang commented on HADOOP-15720: The latest RPC code is changed (by HADOOP-12909 and

[jira] [Commented] (HADOOP-15720) rpcTimeout may not have been applied correctly

2019-02-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16774526#comment-16774526 ] Yongjun Zhang commented on HADOOP-15720: Hi [~arpaga], [~szetszwo], [~jojochuang], Wonder if

[jira] [Updated] (HADOOP-15538) Possible RPC deadlock in Client

2019-02-07 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15538: --- Description: We have a jstack collection that spans 13 minutes. One frame per ~1.5

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2019-01-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16753222#comment-16753222 ] Yongjun Zhang commented on HADOOP-15538: Hi Guys, We are seeing more of this kind of issues,

[jira] [Updated] (HADOOP-15720) rpcTimeout may not have been applied correctly

2018-09-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15720: --- Description: org.apache.hadoop.ipc.Client send multiple RPC calls to server synchronously

[jira] [Updated] (HADOOP-15720) rpcTimeout may not have been applied correctly

2018-09-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15720: --- Description: org.apache.hadoop.ipc.Client send multiple RPC calls to server synchronously

[jira] [Created] (HADOOP-15720) rpcTimeout may not have been applied correctly

2018-09-04 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-15720: -- Summary: rpcTimeout may not have been applied correctly Key: HADOOP-15720 URL: https://issues.apache.org/jira/browse/HADOOP-15720 Project: Hadoop Common

[jira] [Commented] (HADOOP-10219) ipc.Client.setupIOstreams() needs to check for ClientCache.stopClient requested shutdowns

2018-09-04 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10219?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16603328#comment-16603328 ] Yongjun Zhang commented on HADOOP-10219: Hi [~ste...@apache.org] and [~kihwal], Thanks for

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-07-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540325#comment-16540325 ] Yongjun Zhang commented on HADOOP-15538: BTW, I agree very much with  {code:java} The bottom

[jira] [Comment Edited] (HADOOP-15538) Possible RPC deadlock in Client

2018-07-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540325#comment-16540325 ] Yongjun Zhang edited comment on HADOOP-15538 at 7/11/18 4:20 PM: - BTW,

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-07-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16540322#comment-16540322 ] Yongjun Zhang commented on HADOOP-15538: Thanks a lot [~mi...@cloudera.com]. Good inputs! The

[jira] [Updated] (HADOOP-15590) Use gpg2 and add set GPG_AGENT_INFO for hadoop release

2018-07-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15590: --- Attachment: HADOOP-15590.001.patch > Use gpg2 and add set GPG_AGENT_INFO for hadoop

[jira] [Updated] (HADOOP-15590) Use gpg2 and add set GPG_AGENT_INFO for hadoop release

2018-07-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15590: --- Status: Patch Available (was: Open) > Use gpg2 and add set GPG_AGENT_INFO for hadoop

[jira] [Updated] (HADOOP-15590) Use gpg2 and add set GPG_AGENT_INFO for hadoop release

2018-07-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15590: --- Summary: Use gpg2 and add set GPG_AGENT_INFO for hadoop release (was: Two gpg related

[jira] [Assigned] (HADOOP-15590) Two gpg related errors when doing hadoop release

2018-07-10 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HADOOP-15590: -- Assignee: Yongjun Zhang > Two gpg related errors when doing hadoop release >

[jira] [Created] (HADOOP-15590) Two gpg related errors when doing hadoop release

2018-07-09 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-15590: -- Summary: Two gpg related errors when doing hadoop release Key: HADOOP-15590 URL: https://issues.apache.org/jira/browse/HADOOP-15590 Project: Hadoop Common

[jira] [Comment Edited] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514846#comment-16514846 ] Yongjun Zhang edited comment on HADOOP-15538 at 6/16/18 5:29 PM: - There

[jira] [Assigned] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HADOOP-15538: -- Assignee: Yongjun Zhang > Possible RPC deadlock in Client >

[jira] [Updated] (HADOOP-15530) RPC could stuck at senderFuture.get()

2018-06-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15530: --- Description: In Client.java, sendRpcRequest does the following {code} /** Initiates a

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514846#comment-16514846 ] Yongjun Zhang commented on HADOOP-15538: There is also the other thread reported in

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-16 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514708#comment-16514708 ] Yongjun Zhang commented on HADOOP-15538: Expanding the code snippet that [~daryn] shared, the

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514551#comment-16514551 ] Yongjun Zhang commented on HADOOP-15538: FYI [~daryn], the CPU usage is pretty low.   >

[jira] [Comment Edited] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514425#comment-16514425 ] Yongjun Zhang edited comment on HADOOP-15538 at 6/15/18 10:21 PM: --

[jira] [Comment Edited] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514425#comment-16514425 ] Yongjun Zhang edited comment on HADOOP-15538 at 6/15/18 10:20 PM: --

[jira] [Comment Edited] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514425#comment-16514425 ] Yongjun Zhang edited comment on HADOOP-15538 at 6/15/18 10:16 PM: --

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514425#comment-16514425 ] Yongjun Zhang commented on HADOOP-15538: Only the two threads above refers to 

[jira] [Comment Edited] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514402#comment-16514402 ] Yongjun Zhang edited comment on HADOOP-15538 at 6/15/18 9:58 PM: -

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514402#comment-16514402 ] Yongjun Zhang commented on HADOOP-15538: pstack for thread {code} "IPC Parameter Sending Thread

[jira] [Comment Edited] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514360#comment-16514360 ] Yongjun Zhang edited comment on HADOOP-15538 at 6/15/18 9:14 PM: -

[jira] [Commented] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16514360#comment-16514360 ] Yongjun Zhang commented on HADOOP-15538: Thanks a lot [~daryn]! somehow I did not see your

[jira] [Updated] (HADOOP-15538) Possible RPC deadlock in Client

2018-06-15 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15538: --- Summary: Possible RPC deadlock in Client (was: Possible deadlock in Client) > Possible

[jira] [Updated] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15538: --- Description: We have a jstack collection that spans 13 minutes. One frame per ~1.5

[jira] [Comment Edited] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513183#comment-16513183 ] Yongjun Zhang edited comment on HADOOP-15538 at 6/15/18 12:45 AM: --

[jira] [Commented] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513183#comment-16513183 ] Yongjun Zhang commented on HADOOP-15538: Thanks a lot [~daryn] and [~billyean]. Please see

[jira] [Updated] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15538: --- Attachment: t1+13min.jstack t1.jstack > Possible deadlock in Client >

[jira] [Commented] (HADOOP-15530) RPC could stuck at senderFuture.get()

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16513156#comment-16513156 ] Yongjun Zhang commented on HADOOP-15530: Thanks a lot for the feedback and good info [~daryn].

[jira] [Updated] (HADOOP-15530) RPC could stuck at senderFuture.get()

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15530: --- Description: In Client.java, sendRpcRequest does the following {code} /** Initiates a

[jira] [Commented] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512135#comment-16512135 ] Yongjun Zhang commented on HADOOP-15538: All other 6 BLOCKED threads (there are 8 BLOCKED

[jira] [Comment Edited] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512076#comment-16512076 ] Yongjun Zhang edited comment on HADOOP-15538 at 6/14/18 7:39 AM: - Hm, I

[jira] [Commented] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16512076#comment-16512076 ] Yongjun Zhang commented on HADOOP-15538: Hm, I noticed that in

[jira] [Updated] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15538: --- Description: We have a jstack collection that spans 13 minutes. Once frame per ~1.5

[jira] [Updated] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15538: --- Description: We have a jstack collection that spans 13 minutes. Once frame per ~1.5

[jira] [Created] (HADOOP-15538) Possible dead lock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-15538: -- Summary: Possible dead lock in Client Key: HADOOP-15538 URL: https://issues.apache.org/jira/browse/HADOOP-15538 Project: Hadoop Common Issue Type: Bug

[jira] [Updated] (HADOOP-15538) Possible deadlock in Client

2018-06-14 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15538: --- Summary: Possible deadlock in Client (was: Possible dead lock in Client) > Possible

[jira] [Assigned] (HADOOP-15530) RPC could stuck at senderFuture.get()

2018-06-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang reassigned HADOOP-15530: -- Assignee: Yongjun Zhang > RPC could stuck at senderFuture.get() >

[jira] [Updated] (HADOOP-15530) RPC could stuck at senderFuture.get()

2018-06-11 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15530: --- Description: In Client.java, sendRpcRequest does the following {code} /** Initiates a

[jira] [Created] (HADOOP-15530) RPC could stuck at senderFuture.get()

2018-06-11 Thread Yongjun Zhang (JIRA)
Yongjun Zhang created HADOOP-15530: -- Summary: RPC could stuck at senderFuture.get() Key: HADOOP-15530 URL: https://issues.apache.org/jira/browse/HADOOP-15530 Project: Hadoop Common Issue

[jira] [Commented] (HADOOP-15253) Should update maxQueueSize when refresh call queue

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491685#comment-16491685 ] Yongjun Zhang commented on HADOOP-15253: Thanks for your work here [~Tao Jie] and [~shv]. Hi

[jira] [Updated] (HADOOP-15264) AWS "shaded" SDK 1.11.271 is pulling in netty 4.1.17

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15264: --- Fix Version/s: 3.0.3 > AWS "shaded" SDK 1.11.271 is pulling in netty 4.1.17 >

[jira] [Updated] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15450: --- Fix Version/s: 3.0.3 > Avoid fsync storm triggered by DiskChecker and handle disk full

[jira] [Updated] (HADOOP-15247) Move commons-net up to 3.6

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15247: --- Fix Version/s: (was: 3.0.1) 3.0.3 > Move commons-net up to 3.6 >

[jira] [Commented] (HADOOP-15247) Move commons-net up to 3.6

2018-05-26 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15247?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16491670#comment-16491670 ] Yongjun Zhang commented on HADOOP-15247: Hi [~ste...@apache.org], Thanks for your work here.

[jira] [Commented] (HADOOP-10768) Optimize Hadoop RPC encryption performance

2018-05-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16486700#comment-16486700 ] Yongjun Zhang commented on HADOOP-10768: Thank you all for working on this issue. Hi

[jira] [Commented] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-22 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16484292#comment-16484292 ] Yongjun Zhang commented on HADOOP-15450: Thanks a lot for your quick turnaround [~kihwal] and

[jira] [Commented] (HADOOP-15401) ConcurrentModificationException on Subject.getPrivateCredentials in UGI constructor

2018-05-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483453#comment-16483453 ] Yongjun Zhang commented on HADOOP-15401: HI [~xiaochen], Based on the discussion you had with

[jira] [Commented] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483469#comment-16483469 ] Yongjun Zhang commented on HADOOP-15450: Hi [~arpitagarwal], Thanks for working on this issue.

[jira] [Comment Edited] (HADOOP-15450) Avoid fsync storm triggered by DiskChecker and handle disk full situation

2018-05-21 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16483469#comment-16483469 ] Yongjun Zhang edited comment on HADOOP-15450 at 5/22/18 4:25 AM: - Hi

[jira] [Updated] (HADOOP-15090) Add ADL troubleshooting doc

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-15090: --- Fix Version/s: (was: 3.0.1) 3.0.3 > Add ADL troubleshooting doc >

[jira] [Updated] (HADOOP-14696) parallel tests don't work for Windows

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14696: --- Fix Version/s: 3.0.1 > parallel tests don't work for Windows >

[jira] [Updated] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-10571: --- Fix Version/s: (was: 3.0.1) 3.0.3 > Use Log.*(Object, Throwable)

[jira] [Commented] (HADOOP-10571) Use Log.*(Object, Throwable) overload to log exceptions

2018-05-09 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10571?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468413#comment-16468413 ] Yongjun Zhang commented on HADOOP-10571: Found this Jira is not in 3.0.1 and 3.0.2. It's in

[jira] [Updated] (HADOOP-13055) Implement linkMergeSlash and linkFallback for ViewFileSystem

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-13055: --- Fix Version/s: (was: 3.0.3) > Implement linkMergeSlash and linkFallback for

[jira] [Comment Edited] (HADOOP-13055) Implement linkMergeSlash and linkFallback for ViewFileSystem

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468410#comment-16468410 ] Yongjun Zhang edited comment on HADOOP-13055 at 5/9/18 5:58 AM: Talked

[jira] [Commented] (HADOOP-13055) Implement linkMergeSlash and linkFallback for ViewFileSystem

2018-05-08 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16468410#comment-16468410 ] Yongjun Zhang commented on HADOOP-13055: Talked with [~xiaochen], we agreed to revert it from

[jira] [Resolved] (HADOOP-14262) rpcTimeOut is not set up correctly in Client thus client doesn't time out

2017-08-12 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14262?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang resolved HADOOP-14262. Resolution: Duplicate > rpcTimeOut is not set up correctly in Client thus client doesn't

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2017-07-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094956#comment-16094956 ] Yongjun Zhang commented on HADOOP-14445: Thanks [~daryn]. > Delegation tokens are not shared

[jira] [Commented] (HADOOP-14445) Delegation tokens are not shared between KMS instances

2017-07-19 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16093857#comment-16093857 ] Yongjun Zhang commented on HADOOP-14445: HI [~shahrs87], Wonder if you have any update on this

[jira] [Commented] (HADOOP-14515) Specifically configure zookeeper-related log levels in KMS log4j

2017-06-28 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16065989#comment-16065989 ] Yongjun Zhang commented on HADOOP-14515: Thanks [~xiaochen]. +1 on the addendum patch. >

[jira] [Commented] (HADOOP-14429) FTPFileSystem#getFsAction always returns FsAction.NONE

2017-06-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056724#comment-16056724 ] Yongjun Zhang commented on HADOOP-14429: Committed to trunk and branch-2. Thanks [~Hongyuan

[jira] [Updated] (HADOOP-14429) FTPFileSystem#getFsAction always returns FsAction.NONE

2017-06-20 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HADOOP-14429: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha4

  1   2   3   4   5   6   7   8   >