[jira] [Updated] (HADOOP-14065) AliyunOSS: oss directory filestatus should use meta time

2017-11-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HADOOP-14065: --- Fix Version/s: 2.9.1 > AliyunOSS: oss directory filestatus should use meta time >

[jira] [Updated] (HADOOP-14065) AliyunOSS: oss directory filestatus should use meta time

2017-11-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14065?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HADOOP-14065: --- Fix Version/s: (was: 2.9.1) > AliyunOSS: oss directory filestatus should use meta time >

[jira] [Commented] (HADOOP-14964) AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches

2017-11-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264873#comment-16264873 ] Kai Zheng commented on HADOOP-14964: Thanks [~Sammi] for the update. It sounds good, let's forget

[jira] [Commented] (HADOOP-14964) AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches

2017-11-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264868#comment-16264868 ] SammiChen commented on HADOOP-14964: Here is the Aliyun OSS Unit Test results on branch-2.9,

[jira] [Commented] (HADOOP-14943) Add common getFileBlockLocations() emulation for object stores, including S3A

2017-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264711#comment-16264711 ] Hadoop QA commented on HADOOP-14943: | (/) *{color:green}+1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15069: Status: Patch Available (was: Open) patch 002: Better patterns. scan-history still

[jira] [Updated] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15069: Attachment: HADOOP-15069-002.patch > support git-secrets commit hook to keep AWS secrets

[jira] [Updated] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15069: Status: Open (was: Patch Available) > support git-secrets commit hook to keep AWS

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Status: Patch Available (was: Open) > extend per-bucket secret key config with explicit

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Attachment: HADOOP-14507-005.patch Patch 005: bucket password support in sync; restored

[jira] [Updated] (HADOOP-14507) extend per-bucket secret key config with explicit getPassword() on fs.s3a.$bucket.secret,key

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14507: Status: Open (was: Patch Available) > extend per-bucket secret key config with explicit

[jira] [Commented] (HADOOP-14965) s3a input stream "normal" fadvise mode to be adaptive

2017-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14965?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264648#comment-16264648 ] Hadoop QA commented on HADOOP-14965: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-14965) s3a input stream "normal" fadvise mode to be adaptive

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14965: Attachment: HADOOP-14965-003.patch Patch 003; rebased to trunk. > s3a input stream

[jira] [Updated] (HADOOP-14943) Add common getFileBlockLocations() emulation for object stores, including S3A

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14943: Attachment: HADOOP-14943-003.patch utility class is now FileBlockLocationSupport; may be

[jira] [Updated] (HADOOP-14943) Add common getFileBlockLocations() emulation for object stores, including S3A

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14943: Status: Patch Available (was: Open) > Add common getFileBlockLocations() emulation for

[jira] [Updated] (HADOOP-14943) Add common getFileBlockLocations() emulation for object stores, including S3A

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14943: Status: Open (was: Patch Available) > Add common getFileBlockLocations() emulation for

[jira] [Commented] (HADOOP-14943) Add common getFileBlockLocations() emulation for object stores, including S3A

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14943?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264639#comment-16264639 ] Steve Loughran commented on HADOOP-14943: - HADOOP-12878 would merge in here well: make that

[jira] [Commented] (HADOOP-15067) GC time percentage reported in JvmMetrics should be a gauge, not counter

2017-11-23 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264636#comment-16264636 ] Hudson commented on HADOOP-15067: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #13275 (See

[jira] [Updated] (HADOOP-15067) GC time percentage reported in JvmMetrics should be a gauge, not counter

2017-11-23 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HADOOP-15067: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.10.0 3.0.0

[jira] [Commented] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264603#comment-16264603 ] Hadoop QA commented on HADOOP-15069: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15069: Issue Type: Sub-task (was: Improvement) Parent: HADOOP-14831 > support

[jira] [Updated] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15069: Attachment: HADOOP-15069-001.patch Patch 001: adds docs and the .gitallow file to stop

[jira] [Updated] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-15069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-15069: Status: Patch Available (was: Open) > support git-secrets commit hook to keep AWS

[jira] [Created] (HADOOP-15069) support git-secrets commit hook to keep AWS secrets out of git

2017-11-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-15069: --- Summary: support git-secrets commit hook to keep AWS secrets out of git Key: HADOOP-15069 URL: https://issues.apache.org/jira/browse/HADOOP-15069 Project:

[jira] [Commented] (HADOOP-14600) LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions

2017-11-23 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264461#comment-16264461 ] Steve Loughran commented on HADOOP-14600: - doing a recursive walk like that will kill

[jira] [Commented] (HADOOP-14964) AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches

2017-11-23 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264441#comment-16264441 ] Hadoop QA commented on HADOOP-14964: | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HADOOP-14964) AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches

2017-11-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264442#comment-16264442 ] SammiChen commented on HADOOP-14964: Hi [~chris.douglas], thanks for your thoughtful suggestions. We

[jira] [Commented] (HADOOP-14600) LocatedFileStatus constructor forces RawLocalFS to exec a process to get the permissions

2017-11-23 Thread Ohad Raviv (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16264406#comment-16264406 ] Ohad Raviv commented on HADOOP-14600: - Hi, We also encountered a similar problem as SPARK-21137,

[jira] [Updated] (HADOOP-14964) AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches

2017-11-23 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HADOOP-14964: --- Summary: AliyunOSS: backport Aliyun OSS module to branch-2 and 2.8+ branches (was: AliyunOSS:

[jira] [Updated] (HADOOP-14964) AliyunOSS: backport Aliyun OSS module to branch-2 and 2.7+ branches

2017-11-23 Thread SammiChen (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-14964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SammiChen updated HADOOP-14964: --- Attachment: HADOOP-14964-branch-2.9.001.patch Patch for branch-2.9 > AliyunOSS: backport Aliyun