[jira] [Commented] (HADOOP-14559) FTPFileSystem instance in TestFTPFileSystem should be created before tests and closed after tests

2017-08-23 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139464#comment-16139464 ] Hongyuan Li commented on HADOOP-14559: -- Hi, [~ste...@apache.org], [~yzhangal], sorry to interrupt

[jira] [Comment Edited] (HADOOP-13743) error message in AzureNativeFileSystemStore.connectUsingAnonymousCredentials has too many spaces

2017-08-09 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119883#comment-16119883 ] Hongyuan Li edited comment on HADOOP-13743 at 8/9/17 1:49 PM: -- dig into the

[jira] [Commented] (HADOOP-13743) error message in AzureNativeFileSystemStore.connectUsingAnonymousCredentials has too many spaces

2017-08-09 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16119883#comment-16119883 ] Hongyuan Li commented on HADOOP-13743: -- dig into the log4j source code, the message format uses the

[jira] [Commented] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-25 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16099702#comment-16099702 ] Hongyuan Li commented on HADOOP-14623: -- Hi, [~bharatviswa], you are right. It does not matter. The

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-23 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097550#comment-16097550 ] Hongyuan Li edited comment on HADOOP-14623 at 7/23/17 9:32 AM: --- Hi,

[jira] [Commented] (HADOOP-14559) FTPFileSystem instance in TestFTPFileSystem should be created before tests and closed after tests

2017-07-23 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097566#comment-16097566 ] Hongyuan Li commented on HADOOP-14559: -- Hi, [~yzhangal]. Sorry to call you again, can this jira be

[jira] [Updated] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-23 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Attachment: HADOOP-14623-004.patch modify compile error and check style warn > fixed some bugs

[jira] [Commented] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-23 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097550#comment-16097550 ] Hongyuan Li commented on HADOOP-14623: -- Hi, [~bharatviswa]. i resubmit the patch 003 according to

[jira] [Updated] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-23 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Attachment: HADOOP-14623-003.patch > fixed some bugs in KafkaSink >

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-21 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095937#comment-16095937 ] Hongyuan Li edited comment on HADOOP-14623 at 7/21/17 8:54 AM: --- Hi,

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-21 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095937#comment-16095937 ] Hongyuan Li edited comment on HADOOP-14623 at 7/21/17 8:50 AM: --- Hi,

[jira] [Commented] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-21 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095937#comment-16095937 ] Hongyuan Li commented on HADOOP-14623: -- Hi, [~bharatviswa], find that the kafka client must have

[jira] [Commented] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-20 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095632#comment-16095632 ] Hongyuan Li commented on HADOOP-14623: -- Hi [~bharatviswa]. Thanks for your kindly comment.In my

[jira] [Commented] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-10 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16081509#comment-16081509 ] Hongyuan Li commented on HADOOP-14623: -- Hi [~aw], could you give me a code review? > fixed some

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076628#comment-16076628 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 11:55 AM: ---

[jira] [Commented] (HADOOP-10949) metrics2 sink plugin for Apache Kafka

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10949?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079110#comment-16079110 ] Hongyuan Li commented on HADOOP-10949: -- i filed HADOOP-14623 to update this module. > metrics2

[jira] [Commented] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079108#comment-16079108 ] Hongyuan Li commented on HADOOP-14623: -- none of the test failure is related with this patch. None

[jira] [Commented] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079075#comment-16079075 ] Hongyuan Li commented on HADOOP-14632: -- none of the test failure is related with this patch. None

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 9:20 AM: -- I highly

[jira] [Updated] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Attachment: HADOOP-14623-002.patch > fixed some bugs in KafkaSink >

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 9:15 AM: -- I highly

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 8:51 AM: -- I highly

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 8:46 AM: -- I highly

[jira] [Updated] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14632: - Attachment: HADOOP-14632-005.patch fix junit test > add buffer to SFTPFileSystem#create and

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 8:24 AM: -- I highly

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 8:20 AM: -- I highly

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 8:11 AM: -- I highly

[jira] [Comment Edited] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li edited comment on HADOOP-14623 at 7/8/17 8:06 AM: -- I highly

[jira] [Commented] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079033#comment-16079033 ] Hongyuan Li commented on HADOOP-14623: -- I highly recommend Two points: 1、should use acks = 1.

[jira] [Updated] (HADOOP-14623) fixed some bugs in KafkaSink

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Summary: fixed some bugs in KafkaSink (was: KafkaSink#init should set acks to 1,not 0 and

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0 and key.serializer is wrong however key not used

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Description: {{KafkaSink}}#{{init}} should set ack to *1* to make sure the message has been

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0 and key.serializer is wrong however key not used

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Description: {{KafkaSink}}#{{init}} should set ack to *1* to make sure the message has been

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0 and key.serializer is wrong however key not used

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Summary: KafkaSink#init should set acks to 1,not 0 and key.serializer is wrong however key not

[jira] [Comment Edited] (HADOOP-14567) DistCP NullPointerException when -atomic is set but -tmp is not

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16071185#comment-16071185 ] Hongyuan Li edited comment on HADOOP-14567 at 7/8/17 7:35 AM: -- i think we

[jira] [Updated] (HADOOP-14631) Distcp should add a default atomicWorkPath properties when using atomic

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14631: - Fix Version/s: 2.7.3 > Distcp should add a default atomicWorkPath properties when using atomic

[jira] [Assigned] (HADOOP-14567) DistCP NullPointerException when -atomic is set but -tmp is not

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li reassigned HADOOP-14567: Assignee: Hongyuan Li > DistCP NullPointerException when -atomic is set but -tmp is not

[jira] [Commented] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079022#comment-16079022 ] Hongyuan Li commented on HADOOP-14632: -- attched new patch. > add buffer to SFTPFileSystem#create

[jira] [Updated] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14632: - Attachment: HADOOP-14632-004.patch > add buffer to SFTPFileSystem#create and

[jira] [Commented] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16079020#comment-16079020 ] Hongyuan Li commented on HADOOP-14632: -- one of the junit test is related with the patch, will work

[jira] [Updated] (HADOOP-14631) Distcp should add a default atomicWorkPath properties when using atomic

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14631: - Summary: Distcp should add a default atomicWorkPath properties when using atomic (was: Distcp

[jira] [Updated] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-08 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14632: - Attachment: HADOOP-14632-003.patch > add buffer to SFTPFileSystem#create and

[jira] [Comment Edited] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078964#comment-16078964 ] Hongyuan Li edited comment on HADOOP-14632 at 7/8/17 5:46 AM: -- Will add

[jira] [Comment Edited] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078964#comment-16078964 ] Hongyuan Li edited comment on HADOOP-14632 at 7/8/17 5:45 AM: -- Will add

[jira] [Updated] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14632: - Summary: add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve

[jira] [Commented] (HADOOP-14632) add buffer to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078964#comment-16078964 ] Hongyuan Li commented on HADOOP-14632: -- Will add fntionational test units in next patch. > add

[jira] [Commented] (HADOOP-14631) Distcp should add a default atomicWorkPath properties when using atomic or throw obvious Exception

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078963#comment-16078963 ] Hongyuan Li commented on HADOOP-14631: -- ok, thanks for your advice. Will working on it. > Distcp

[jira] [Commented] (HADOOP-14631) Distcp should add a default atomicWorkPath properties when using atomic or throw obvious Exception

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078563#comment-16078563 ] Hongyuan Li commented on HADOOP-14631: -- ping [~liuml07] for a suggestion. > Distcp should add a

[jira] [Updated] (HADOOP-14632) add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14632: - Attachment: HADOOP-14632-002.patch fix findbug warnings > add buffersize to

[jira] [Comment Edited] (HADOOP-14631) Distcp should add a default atomicWorkPath properties when using atomic or throw obvious Exception

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078250#comment-16078250 ] Hongyuan Li edited comment on HADOOP-14631 at 7/7/17 6:02 PM: -- i don't know

[jira] [Updated] (HADOOP-14632) add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14632: - Status: Patch Available (was: Open) > add buffersize to SFTPFileSystem#create and

[jira] [Comment Edited] (HADOOP-14632) add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078215#comment-16078215 ] Hongyuan Li edited comment on HADOOP-14632 at 7/7/17 3:37 PM: -- attach a

[jira] [Updated] (HADOOP-14632) add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14632: - Affects Version/s: 3.0.0-alpha1 > add buffersize to SFTPFileSystem#create and

[jira] [Commented] (HADOOP-14631) Distcp should add a default atomicWorkPath properties when using atomic or throw obvious Exception

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078250#comment-16078250 ] Hongyuan Li commented on HADOOP-14631: -- i don't know which is a goos idea ? to adding a default

[jira] [Commented] (HADOOP-14632) add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16078227#comment-16078227 ] Hongyuan Li commented on HADOOP-14632: -- the performance test result will be added soon. > add

[jira] [Updated] (HADOOP-14632) add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14632: - Attachment: HADOOP-14632-001.patch attach a file > add buffersize to SFTPFileSystem#create and

[jira] [Assigned] (HADOOP-14632) add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li reassigned HADOOP-14632: Assignee: Hongyuan Li > add buffersize to SFTPFileSystem#create and SFTPFileSystem#open

[jira] [Created] (HADOOP-14632) add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed.

2017-07-07 Thread Hongyuan Li (JIRA)
Hongyuan Li created HADOOP-14632: Summary: add buffersize to SFTPFileSystem#create and SFTPFileSystem#open method, which can improve the transfer speed. Key: HADOOP-14632 URL:

[jira] [Updated] (HADOOP-14631) Distcp should add a default atomicWorkPath properties when using atomic or throw obvious Exception

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14631: - Summary: Distcp should add a default atomicWorkPath properties when using atomic or throw

[jira] [Updated] (HADOOP-14631) Distcp should add a default atomicWorkPath properties when using atomic or throw detailed Exception

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14631: - Summary: Distcp should add a default atomicWorkPath properties when using atomic or throw

[jira] [Updated] (HADOOP-14631) Distcp should add a default AtomicWorkPath properties when using atomic

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14631: - Description: Distcp should add a default AtomicWorkPath properties when using atomic

[jira] [Updated] (HADOOP-14631) Distcp should add a default AtomicWorkPath properties when using atomic

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14631: - Description: Distcp should add a default AtomicWorkPath properties when using atomic

[jira] [Updated] (HADOOP-14631) Distcp should add a default AtomicWorkPath properties when using atomic

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14631: - Affects Version/s: 2.7.3 3.0.0-alpha3 > Distcp should add a default

[jira] [Updated] (HADOOP-14631) Distcp should add a default AtomicWorkPath properties when using atomic

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14631: - Description: Distcp should add a default AtomicWorkPath properties when using atomic

[jira] [Assigned] (HADOOP-14631) Distcp should add a default AtomicWorkPath properties when using atomic

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li reassigned HADOOP-14631: Assignee: Hongyuan Li > Distcp should add a default AtomicWorkPath properties when

[jira] [Created] (HADOOP-14631) Distcp should add a default AtomicWorkPath properties when using atomic

2017-07-07 Thread Hongyuan Li (JIRA)
Hongyuan Li created HADOOP-14631: Summary: Distcp should add a default AtomicWorkPath properties when using atomic Key: HADOOP-14631 URL: https://issues.apache.org/jira/browse/HADOOP-14631 Project:

[jira] [Comment Edited] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077727#comment-16077727 ] Hongyuan Li edited comment on HADOOP-12802 at 7/7/17 7:22 AM: -- [~boky01], i

[jira] [Comment Edited] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077727#comment-16077727 ] Hongyuan Li edited comment on HADOOP-12802 at 7/7/17 7:21 AM: -- [~boky01], i

[jira] [Comment Edited] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077727#comment-16077727 ] Hongyuan Li edited comment on HADOOP-12802 at 7/7/17 7:17 AM: -- [~boky01], i

[jira] [Comment Edited] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077727#comment-16077727 ] Hongyuan Li edited comment on HADOOP-12802 at 7/7/17 7:17 AM: -- [~boky01]],

[jira] [Commented] (HADOOP-12802) local FileContext does not rename .crc file

2017-07-07 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-12802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077727#comment-16077727 ] Hongyuan Li commented on HADOOP-12802: -- [~Andras Bokor], i don't think so , the implement of

[jira] [Comment Edited] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077520#comment-16077520 ] Hongyuan Li edited comment on HADOOP-1 at 7/7/17 3:24 AM: -- socket is

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16077520#comment-16077520 ] Hongyuan Li commented on HADOOP-1: -- socket is complex, i don't like to open a new socket just

[jira] [Comment Edited] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076628#comment-16076628 ] Hongyuan Li edited comment on HADOOP-14623 at 7/7/17 3:19 AM: -- futuremore,

[jira] [Commented] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076628#comment-16076628 ] Hongyuan Li commented on HADOOP-14623: -- futuremore, flush method is to confirm that data has been

[jira] [Commented] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-06 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16076154#comment-16076154 ] Hongyuan Li commented on HADOOP-14623: -- i don't think so, setting it to 1 does not means that it

[jira] [Commented] (HADOOP-13743) error message in AzureNativeFileSystemStore.connectUsingAnonymousCredentials has too many spaces

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-13743?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074908#comment-16074908 ] Hongyuan Li commented on HADOOP-13743: -- why not using String.format or stringBuilder ? > error

[jira] [Comment Edited] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074831#comment-16074831 ] Hongyuan Li edited comment on HADOOP-1 at 7/5/17 2:46 PM: -- 1、if you

[jira] [Comment Edited] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074831#comment-16074831 ] Hongyuan Li edited comment on HADOOP-1 at 7/5/17 2:36 PM: -- 1、if you

[jira] [Comment Edited] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074856#comment-16074856 ] Hongyuan Li edited comment on HADOOP-14623 at 7/5/17 2:35 PM: --

[jira] [Comment Edited] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074856#comment-16074856 ] Hongyuan Li edited comment on HADOOP-14623 at 7/5/17 2:34 PM: --

[jira] [Comment Edited] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074856#comment-16074856 ] Hongyuan Li edited comment on HADOOP-14623 at 7/5/17 2:30 PM: --

[jira] [Comment Edited] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074856#comment-16074856 ] Hongyuan Li edited comment on HADOOP-14623 at 7/5/17 2:30 PM: --

[jira] [Commented] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074856#comment-16074856 ] Hongyuan Li commented on HADOOP-14623: -- [~jojochuang] i will try to test it, but iam not sure it

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074831#comment-16074831 ] Hongyuan Li commented on HADOOP-1: -- 1、if you rename "AbstractFTPFileSystem" to anything else, i

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074526#comment-16074526 ] Hongyuan Li commented on HADOOP-1: -- i have implemented it with some necessary feature. 在

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074478#comment-16074478 ] Hongyuan Li commented on HADOOP-1: -- 1) ftp is very diffrent from sftp. sftp relies on ssh

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set acks to 1,not 0

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Summary: KafkaSink#init should set acks to 1,not 0 (was: KafkaSink#init should set ack to 1)

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Status: Patch Available (was: Open) > KafkaSink#init should set ack to 1 >

[jira] [Comment Edited] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074394#comment-16074394 ] Hongyuan Li edited comment on HADOOP-14623 at 7/5/17 8:07 AM: -- ping

[jira] [Commented] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074394#comment-16074394 ] Hongyuan Li commented on HADOOP-14623: -- ping [~ajisakaa] [~jojochuang] for code review. >

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Description: {{KafkaSink}}#{{init}} should set ack to *1* to make sure the message has been

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Component/s: tools common > KafkaSink#init should set ack to 1 >

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Affects Version/s: 3.0.0-alpha3 > KafkaSink#init should set ack to 1 >

[jira] [Updated] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14623: - Attachment: HADOOP-14623-001.patch > KafkaSink#init should set ack to 1 >

[jira] [Assigned] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li reassigned HADOOP-14623: Assignee: Hongyuan Li > KafkaSink#init should set ack to 1 >

[jira] [Created] (HADOOP-14623) KafkaSink#init should set ack to 1

2017-07-05 Thread Hongyuan Li (JIRA)
Hongyuan Li created HADOOP-14623: Summary: KafkaSink#init should set ack to 1 Key: HADOOP-14623 URL: https://issues.apache.org/jira/browse/HADOOP-14623 Project: Hadoop Common Issue Type: Bug

[jira] [Commented] (HADOOP-14622) Test failure in TestFilterFileSystem and TestHarFileSystem

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074351#comment-16074351 ] Hongyuan Li commented on HADOOP-14622: -- {{HarFileSystem}}#{{appendFile}} has been implemented in

[jira] [Commented] (HADOOP-14444) New implementation of ftp and sftp filesystems

2017-07-05 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-1?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16074285#comment-16074285 ] Hongyuan Li commented on HADOOP-1: -- 1、seek cause the client disconnect and connect again, don't

[jira] [Comment Edited] (HADOOP-14429) FTPFileSystem#getFsAction always returns FsAction.NONE

2017-07-04 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16056767#comment-16056767 ] Hongyuan Li edited comment on HADOOP-14429 at 7/4/17 11:58 AM: --- Thanks

[jira] [Updated] (HADOOP-14469) FTPFileSystem#listStatus get currentPath and parentPath at the same time, causing recursively list action endless

2017-07-04 Thread Hongyuan Li (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyuan Li updated HADOOP-14469: - Affects Version/s: 3.0.0-alpha2 > FTPFileSystem#listStatus get currentPath and parentPath at

  1   2   3   4   >