[jira] [Created] (HADOOP-14361) Azure: NativeAzureFileSystem.getDelegationToken() call fails sometimes when invoked concurrently
Santhosh G Nayak created HADOOP-14361:
-
Summary: Azure: NativeAzureFileSystem.getDelegationToken() call
fails sometimes when invoked concurrently
Key: HADOOP-14361
URL: https://issues.apache.org/jira/browse/HADOOP-14361
Project: Hadoop Common
Issue Type: Bug
Components: fs/azure
Affects Versions: 2.9.0
Reporter: Santhosh G Nayak
Assignee: Santhosh G Nayak
Sometimes {{NativeAzureFileSystem.getDelegationToken()}} method fails with
below exception when invoked concurrently,
{code}Caused by:
org.apache.hadoop.security.authentication.client.AuthenticationException:
Authentication failed, URL:
http://delegationtokenmanger/?op=GETDELEGATIONTOKEN=rm%2Fhostname%40realm,
status: 401, message: Authentication required
at
org.apache.hadoop.security.authentication.client.AuthenticatedURL.extractToken(AuthenticatedURL.java:278)
at
org.apache.hadoop.security.authentication.client.KerberosAuthenticator.authenticate(KerberosAuthenticator.java:195)
at
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.authenticate(DelegationTokenAuthenticator.java:132)
at
org.apache.hadoop.security.authentication.client.AuthenticatedURL.openConnection(AuthenticatedURL.java:216)
at
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.doDelegationTokenOperation(DelegationTokenAuthenticator.java:298)
at
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticator.getDelegationToken(DelegationTokenAuthenticator.java:170)
at
org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticatedURL.getDelegationToken(DelegationTokenAuthenticatedURL.java:371)
at
org.apache.hadoop.fs.azure.NativeAzureFileSystem$2.run(NativeAzureFileSystem.java:2993)
at
org.apache.hadoop.fs.azure.NativeAzureFileSystem$2.run(NativeAzureFileSystem.java:2990)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1866)
... 29 more
{code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14309) Add PowerShell NodeFencer
[ https://issues.apache.org/jira/browse/HADOOP-14309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987925#comment-15987925 ] Hudson commented on HADOOP-14309: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11644 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11644/]) HADOOP-14309. Add PowerShell NodeFencer. Contributed by Inigo Goiri (cdouglas: rev 31cf480d6520e259f2a7f29de64ef4c5b5a50142) * (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ha/PowerShellFencer.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/ha/NodeFencer.java > Add PowerShell NodeFencer > - > > Key: HADOOP-14309 > URL: https://issues.apache.org/jira/browse/HADOOP-14309 > Project: Hadoop Common > Issue Type: Improvement > Components: ha >Affects Versions: 2.8.0 >Reporter: Inigo Goiri >Assignee: Inigo Goiri >Priority: Minor > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-14309-000.patch, HADOOP-14309-001.patch > > > Fencer implementation that uses PowerShell to fence a remote component. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14354) SysInfoWindows is not thread safe
[
https://issues.apache.org/jira/browse/HADOOP-14354?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987926#comment-15987926
]
Hudson commented on HADOOP-14354:
-
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11644 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/11644/])
HADOOP-14354. SysInfoWindows is not thread safe. Contributed by Inigo
(cdouglas: rev 689fb2fc661f233367ecbfa26795ff4c01408f3e)
* (edit)
hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/SysInfoWindows.java
> SysInfoWindows is not thread safe
> -
>
> Key: HADOOP-14354
> URL: https://issues.apache.org/jira/browse/HADOOP-14354
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Inigo Goiri
>Assignee: Inigo Goiri
> Fix For: 3.0.0-alpha3
>
> Attachments: HADOOP-14354-000.patch
>
>
> Multiple threads can trigger {{refreshIfNeeded()}} in {{SysInfoWindows}} at
> the same time and cause undesired behaviors.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-14354) SysInfoWindows is not thread safe
[
https://issues.apache.org/jira/browse/HADOOP-14354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chris Douglas resolved HADOOP-14354.
Resolution: Fixed
Hadoop Flags: Reviewed
Fix Version/s: 3.0.0-alpha3
+1 lgtm
I committed this. Thanks Inigo
> SysInfoWindows is not thread safe
> -
>
> Key: HADOOP-14354
> URL: https://issues.apache.org/jira/browse/HADOOP-14354
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Inigo Goiri
>Assignee: Inigo Goiri
> Fix For: 3.0.0-alpha3
>
> Attachments: HADOOP-14354-000.patch
>
>
> Multiple threads can trigger {{refreshIfNeeded()}} in {{SysInfoWindows}} at
> the same time and cause undesired behaviors.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14309) Add PowerShell NodeFencer
[ https://issues.apache.org/jira/browse/HADOOP-14309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987888#comment-15987888 ] Inigo Goiri commented on HADOOP-14309: -- [~chris.douglas], thanks for the review and the commit. > Add PowerShell NodeFencer > - > > Key: HADOOP-14309 > URL: https://issues.apache.org/jira/browse/HADOOP-14309 > Project: Hadoop Common > Issue Type: Improvement > Components: ha >Affects Versions: 2.8.0 >Reporter: Inigo Goiri >Assignee: Inigo Goiri >Priority: Minor > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-14309-000.patch, HADOOP-14309-001.patch > > > Fencer implementation that uses PowerShell to fence a remote component. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14306) TestLocalFileSystem tests have very low timeouts
[
https://issues.apache.org/jira/browse/HADOOP-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987864#comment-15987864
]
Hadoop QA commented on HADOOP-14306:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
23s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 15m
0s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 19m
35s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
43s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
19s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
23s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 2m
6s{color} | {color:red} hadoop-common-project/hadoop-common in trunk has 17
extant Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
3s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
4s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 17m
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 17m
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
39s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
20s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 1m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
47s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 7m
53s{color} | {color:green} hadoop-common in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
42s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 74m 34s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:0ac17dc |
| JIRA Issue | HADOOP-14306 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12865428/HADOOP-14306.003.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle |
| uname | Linux d3d9f0bdd347 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6
15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 9460721 |
| Default Java | 1.8.0_121 |
| findbugs | v3.1.0-RC1 |
| findbugs |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12203/artifact/patchprocess/branch-findbugs-hadoop-common-project_hadoop-common-warnings.html
|
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12203/testReport/ |
| modules | C: hadoop-common-project/hadoop-common U:
hadoop-common-project/hadoop-common |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12203/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> TestLocalFileSystem tests have very low timeouts
>
>
> Key: HADOOP-14306
> URL: https://issues.apache.org/jira/browse/HADOOP-14306
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Eric Badger
>Assignee: Eric Badger
> Attachments: HADOOP-14306.001.patch,
[jira] [Updated] (HADOOP-14309) Add PowerShell NodeFencer
[ https://issues.apache.org/jira/browse/HADOOP-14309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-14309: --- Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available) +1 I committed this. Thanks, Inigo > Add PowerShell NodeFencer > - > > Key: HADOOP-14309 > URL: https://issues.apache.org/jira/browse/HADOOP-14309 > Project: Hadoop Common > Issue Type: Improvement > Components: ha >Affects Versions: 2.8.0 >Reporter: Inigo Goiri >Assignee: Inigo Goiri >Priority: Minor > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-14309-000.patch, HADOOP-14309-001.patch > > > Fencer implementation that uses PowerShell to fence a remote component. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14309) Add PowerShell NodeFencer
[ https://issues.apache.org/jira/browse/HADOOP-14309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Douglas updated HADOOP-14309: --- Summary: Add PowerShell NodeFencer (was: PowerShellFencer) > Add PowerShell NodeFencer > - > > Key: HADOOP-14309 > URL: https://issues.apache.org/jira/browse/HADOOP-14309 > Project: Hadoop Common > Issue Type: Improvement > Components: ha >Affects Versions: 2.8.0 >Reporter: Inigo Goiri >Assignee: Inigo Goiri >Priority: Minor > Attachments: HADOOP-14309-000.patch, HADOOP-14309-001.patch > > > Fencer implementation that uses PowerShell to fence a remote component. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14306) TestLocalFileSystem tests have very low timeouts
[ https://issues.apache.org/jira/browse/HADOOP-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Badger updated HADOOP-14306: - Attachment: HADOOP-14306.003.patch Thanks, [~jlowe] for the review! That makes sense. Uploading a new patch where I got rid of the protected method and just created the timeout straight up > TestLocalFileSystem tests have very low timeouts > > > Key: HADOOP-14306 > URL: https://issues.apache.org/jira/browse/HADOOP-14306 > Project: Hadoop Common > Issue Type: Bug >Reporter: Eric Badger >Assignee: Eric Badger > Attachments: HADOOP-14306.001.patch, HADOOP-14306.002.patch, > HADOOP-14306.003.patch > > > Most tests have a timeout of 1 second, which is much too low, especially if > there is a spinning disk involved. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14306) TestLocalFileSystem tests have very low timeouts
[
https://issues.apache.org/jira/browse/HADOOP-14306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987708#comment-15987708
]
Jason Lowe commented on HADOOP-14306:
-
Thanks for updating the patch, Eric!
Nit: I don't see the point of having a protected method for getting the test
timeout value. For {{AbstractFSContractTestBase}} it makes sense since the
whole point of that class is to be subclassed by the "real" tests. In this
case nothing is going to subclass it, so it's just extra boilerplate with no
purpose.
> TestLocalFileSystem tests have very low timeouts
>
>
> Key: HADOOP-14306
> URL: https://issues.apache.org/jira/browse/HADOOP-14306
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Eric Badger
>Assignee: Eric Badger
> Attachments: HADOOP-14306.001.patch, HADOOP-14306.002.patch
>
>
> Most tests have a timeout of 1 second, which is much too low, especially if
> there is a spinning disk involved.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987626#comment-15987626 ] Hudson commented on HADOOP-13200: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11643 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11643/]) HADOOP-13200. Implement customizable and configurable erasure coders. (weichiu: rev bbf8cac14d8b1a0e919b57cb7f081edce45acd5b) * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/ErasureCodeConstants.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/CodecUtil.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RSRawErasureCoderFactory.java * (add) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/TestCodecRegistry.java * (add) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/CodecRegistry.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/coder/TestRSErasureCoder.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/DummyRawErasureCoderFactory.java * (add) hadoop-common-project/hadoop-common/src/main/resources/META-INF/services/org.apache.hadoop.io.erasurecode.rawcoder.RawErasureCoderFactory * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/NativeRSRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/resources/core-default.xml * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStreamWithFailure.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/XORRawErasureCoderFactory.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSErasureCoding.md * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStream.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestUnsetAndChangeDirectoryEcPolicy.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReconstructStripedFile.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RSLegacyRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/TestCodecRawCoderMapping.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/NativeXORRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/coder/TestHHXORErasureCoder.java > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987470#comment-15987470 ] Hudson commented on HADOOP-13200: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11642 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11642/]) Revert "HADOOP-13200. Implement customizable and configurable erasure (weichiu: rev ddaeb3e4979338551573285f219a2d361f502950) * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/NativeRSRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/XORRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/CodecUtil.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStreamWithFailure.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RawErasureCoderFactory.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/NativeXORRawErasureCoderFactory.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStream.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/coder/TestRSErasureCoder.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/TestCodecRawCoderMapping.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/DummyRawErasureCoderFactory.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestUnsetAndChangeDirectoryEcPolicy.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RSLegacyRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/resources/core-default.xml * (edit) hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSErasureCoding.md * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/ErasureCodeConstants.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReconstructStripedFile.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RSRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/coder/TestHHXORErasureCoder.java > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-13200. -- Resolution: Fixed Added new files, and verified it compiles. Thanks to [~djp] for catching the issue quickly! > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987398#comment-15987398 ] Junping Du commented on HADOOP-13200: - I see. No worry. We all make same mistake before. :) > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987363#comment-15987363 ] Wei-Chiu Chuang commented on HADOOP-13200: -- Oh I am sorry. It does compile but I forgot to add new files into commit. > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Reopened] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du reopened HADOOP-13200: - Trunk build get broken ... Can we make sure build pass before we commit the patch? > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14328) Hadoop build double jars some artifacts
[
https://issues.apache.org/jira/browse/HADOOP-14328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987321#comment-15987321
]
Jonathan Eagles commented on HADOOP-14328:
--
[~ste...@apache.org], [~ajisakaa], can you comment on this maven-jar-plugin fix
and version update. This could be backported if necessary.
> Hadoop build double jars some artifacts
> ---
>
> Key: HADOOP-14328
> URL: https://issues.apache.org/jira/browse/HADOOP-14328
> Project: Hadoop Common
> Issue Type: Bug
> Components: build
>Reporter: Jonathan Eagles
>Assignee: Jonathan Eagles
> Labels: build
> Attachments: HADOOP-14328.1.patch, HADOOP-14328.2.patch,
> maven-jar-plugin.log, maven-jar-plugin-patch.log
>
>
> Couple of highlights from maven-jar-plugin
> hadoop-build-tools is using 2.4 version of plugin which is different than the
> rest of the build.
> {code}
> maven-jar-plugin:2.4:jar (default-jar) @ hadoop-build-tools ---
> {code}
> hadoop-yarn-applications-distributedshell is double jar'd from default +
> default-jar issue
> {code}
> [INFO] --- maven-jar-plugin:2.5:jar (default) @
> hadoop-yarn-applications-distributedshell ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @
> hadoop-yarn-applications-distributedshell ---
> {code}
> other double jar artifacts from prepare-jar + default-jar issue
> {code}
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-auth ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-auth ---
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-client ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-client ---
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-common ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-common ---
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-distcp ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-distcp ---
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-hdfs ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-hdfs ---
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-hdfs-client ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-hdfs-client ---
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-hdfs-native-client
> ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-hdfs-native-client
> ---
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-tools-dist ---
> [INFO] --- maven-jar-plugin:2.5:jar (default-jar) @ hadoop-tools-dist ---
> {code}
> hadoop-project-dist is jar under a different id but not double jar'd
> {code}
> [INFO] --- maven-jar-plugin:2.5:jar (prepare-jar) @ hadoop-project-dist ---
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-13200: - Resolution: Fixed Hadoop Flags: Incompatible change,Reviewed Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available) Committed rev 11 patch to trunk. Thanks very much to [~timmyyao] for your persistent revision, [~drankye] for your initial reviews, and inputs from [~lewuathe] and [~andrew.wang]. Added incompatible change flag because it changed valid configuration values. [~timmyyao] would you please also update release note to summarize this work? Thanks. > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987296#comment-15987296 ] Hudson commented on HADOOP-13200: - FAILURE: Integrated in Jenkins build Hadoop-trunk-Commit #11641 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11641/]) HADOOP-13200. Implement customizable and configurable erasure coders. (weichiu: rev 872088c6e7e78534a8ffd1ea6e57b86faea3d6e1) * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/coder/TestRSErasureCoder.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RSLegacyRawErasureCoderFactory.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStream.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/NativeRSRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/NativeXORRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RSRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/resources/core-default.xml * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedInputStream.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestReconstructStripedFile.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/CodecUtil.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/coder/TestHHXORErasureCoder.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/ErasureCodeConstants.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/DummyRawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/XORRawErasureCoderFactory.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/site/markdown/HDFSErasureCoding.md * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestDFSStripedOutputStreamWithFailure.java * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/erasurecode/rawcoder/RawErasureCoderFactory.java * (edit) hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/erasurecode/TestCodecRawCoderMapping.java * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/hdfs/TestUnsetAndChangeDirectoryEcPolicy.java > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-13200) Implement customizable and configurable erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-13200: - Summary: Implement customizable and configurable erasure coders (was: Seeking a better approach allowing to customize and configure erasure coders) > Implement customizable and configurable erasure coders > -- > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13200) Seeking a better approach allowing to customize and configure erasure coders
[ https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987278#comment-15987278 ] Wei-Chiu Chuang commented on HADOOP-13200: -- +1 LGTM. findbugs warnings are unrelated. Failed tests are unrelated and not reproducible on my local machine. Will commit soon. > Seeking a better approach allowing to customize and configure erasure coders > > > Key: HADOOP-13200 > URL: https://issues.apache.org/jira/browse/HADOOP-13200 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Kai Zheng >Assignee: Tim Yao >Priority: Blocker > Labels: hdfs-ec-3.0-must-do > Attachments: HADOOP-13200.02.patch, HADOOP-13200.03.patch, > HADOOP-13200.04.patch, HADOOP-13200.05.patch, HADOOP-13200.06.patch, > HADOOP-13200.07.patch, HADOOP-13200.08.patch, HADOOP-13200.09.patch, > HADOOP-13200.10.patch, HADOOP-13200.11.patch > > > This is a follow-on task for HADOOP-13010 as discussed over there. There may > be some better approach allowing to customize and configure erasure coders > than the current having raw coder factory, as [~cmccabe] suggested. Will copy > the relevant comments here to continue the discussion. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[
https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987162#comment-15987162
]
Hadoop QA commented on HADOOP-14359:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
17s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
13s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m
26s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 16m
21s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 2m
10s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 1m
14s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
14s{color} | {color:green} trunk passed {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
14s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 3m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 14m
9s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 14m
9s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 2m
5s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 1m
4s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
4s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
48s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 2m
51s{color} | {color:green} hadoop-kms in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 3m
40s{color} | {color:green} hadoop-hdfs-httpfs in the patch passed. {color} |
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 0m
20s{color} | {color:green} hadoop-client-minicluster in the patch passed.
{color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
35s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black} 66m 18s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:0ac17dc |
| JIRA Issue | HADOOP-14359 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12865384/HADOOP-14359.001.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit xml |
| uname | Linux 0e993185e9c1 4.4.0-43-generic #63-Ubuntu SMP Wed Oct 12
13:48:03 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / d8a3309 |
| Default Java | 1.8.0_121 |
| Test Results |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12202/testReport/ |
| modules | C: hadoop-common-project/hadoop-kms
hadoop-hdfs-project/hadoop-hdfs-httpfs
hadoop-client-modules/hadoop-client-minicluster U: . |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12202/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Remove unnecessary shading of commons-httpclient
>
>
> Key: HADOOP-14359
> URL: https://issues.apache.org/jira/browse/HADOOP-14359
> Project: Hadoop Common
>
[jira] [Comment Edited] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986910#comment-15986910 ] Wei-Chiu Chuang edited comment on HADOOP-14359 at 4/27/17 5:10 PM: --- Thanks for the pointer! I really wish we could get rid of commons-httpclient in Hadoop 3. ran mvn dependency:tree and I see commons-httpclient 3 is exposed in two jars: [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase:jar:3.0.0-alpha3-SNAPSHOT [INFO] +- org.apache.hbase:hbase-server:jar:1.2.4:compile [INFO] | +- org.apache.hbase:hbase-procedure:jar:1.2.4:compile [INFO] | | \- org.apache.hbase:hbase-common:jar:tests:1.2.4:test [INFO] | +- org.apache.hbase:hbase-prefix-tree:jar:1.2.4:runtime [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:compile [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase-tests:jar:3.0.0-alpha3-SNAPSHOT [INFO] +- org.apache.hbase:hbase-server:jar:1.2.4:compile [INFO] | +- org.apache.hbase:hbase-procedure:jar:1.2.4:compile [INFO] | | \- org.apache.hbase:hbase-common:jar:tests:1.2.4:test [INFO] | +- org.apache.hbase:hbase-prefix-tree:jar:1.2.4:runtime [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:compile was (Author: jojochuang): Thanks for the pointer! I really wish we could get rid of commons-httpclient in Hadoop 3. ran mvn dependency:tree and I see commons-httpclient 3 is exposed in two jars: [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase:jar:3.0.0-alpha3-SNAPSHOT [INFO] +- org.apache.hbase:hbase-server:jar:1.2.4:compile [INFO] | +- org.apache.hbase:hbase-procedure:jar:1.2.4:compile [INFO] | | \- org.apache.hbase:hbase-common:jar:tests:1.2.4:test [INFO] | +- org.apache.hbase:hbase-prefix-tree:jar:1.2.4:runtime [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:compile [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase-tests:jar:3.0.0-alpha3-SNAPSHOT [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:test > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Assignee: Wei-Chiu Chuang >Priority: Minor > Attachments: HADOOP-14359.001.patch > > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13475) Adding Append Blob support for WASB
[ https://issues.apache.org/jira/browse/HADOOP-13475?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15987053#comment-15987053 ] Adam Levine commented on HADOOP-13475: -- I am from the Azure machine learning team -- we would very much like to use this feature as well to support our scenarios. Thanks. > Adding Append Blob support for WASB > --- > > Key: HADOOP-13475 > URL: https://issues.apache.org/jira/browse/HADOOP-13475 > Project: Hadoop Common > Issue Type: New Feature > Components: fs/azure >Affects Versions: 2.7.1 >Reporter: Raul da Silva Martins >Assignee: Raul da Silva Martins > Attachments: 0001-Added-Support-for-Azure-AppendBlobs.patch, > HADOOP-13475.001.patch, HADOOP-13475.002.patch > > > Currently the WASB implementation of the HDFS interface does not support the > utilization of Azure AppendBlobs underneath. As owners of a large scale > service who intend to start writing to Append blobs, we need this support in > order to be able to keep using our HDI capabilities. > This JIRA is added to implement Azure AppendBlob support to WASB. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-14359: - Status: Patch Available (was: Open) > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Assignee: Wei-Chiu Chuang >Priority: Minor > Attachments: HADOOP-14359.001.patch > > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Comment Edited] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986910#comment-15986910 ] Wei-Chiu Chuang edited comment on HADOOP-14359 at 4/27/17 4:18 PM: --- Thanks for the pointer! I really wish we could get rid of commons-httpclient in Hadoop 3. ran mvn dependency:tree and I see commons-httpclient 3 is exposed in two jars: [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase:jar:3.0.0-alpha3-SNAPSHOT [INFO] +- org.apache.hbase:hbase-server:jar:1.2.4:compile [INFO] | +- org.apache.hbase:hbase-procedure:jar:1.2.4:compile [INFO] | | \- org.apache.hbase:hbase-common:jar:tests:1.2.4:test [INFO] | +- org.apache.hbase:hbase-prefix-tree:jar:1.2.4:runtime [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:compile [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase-tests:jar:3.0.0-alpha3-SNAPSHOT [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:test was (Author: jojochuang): Thanks for the pointer! I really wish we can get rid of commons-httpclient in Hadoop 3. ran mvn dependency:tree and I see commons-httpclient 3 was exposed in two jars: [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase:jar:3.0.0-alpha3-SNAPSHOT [INFO] +- org.apache.hbase:hbase-server:jar:1.2.4:compile [INFO] | +- org.apache.hbase:hbase-procedure:jar:1.2.4:compile [INFO] | | \- org.apache.hbase:hbase-common:jar:tests:1.2.4:test [INFO] | +- org.apache.hbase:hbase-prefix-tree:jar:1.2.4:runtime [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:compile [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase-tests:jar:3.0.0-alpha3-SNAPSHOT [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:test > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Assignee: Wei-Chiu Chuang >Priority: Minor > Attachments: HADOOP-14359.001.patch > > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986910#comment-15986910 ] Wei-Chiu Chuang commented on HADOOP-14359: -- Thanks for the pointer! I really wish we can get rid of commons-httpclient in Hadoop 3. ran mvn dependency:tree and I see commons-httpclient 3 was exposed in two jars: [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase:jar:3.0.0-alpha3-SNAPSHOT [INFO] +- org.apache.hbase:hbase-server:jar:1.2.4:compile [INFO] | +- org.apache.hbase:hbase-procedure:jar:1.2.4:compile [INFO] | | \- org.apache.hbase:hbase-common:jar:tests:1.2.4:test [INFO] | +- org.apache.hbase:hbase-prefix-tree:jar:1.2.4:runtime [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:compile [INFO] org.apache.hadoop:hadoop-yarn-server-timelineservice-hbase-tests:jar:3.0.0-alpha3-SNAPSHOT [INFO] | +- commons-httpclient:commons-httpclient:jar:3.1:test > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Assignee: Wei-Chiu Chuang >Priority: Minor > Attachments: HADOOP-14359.001.patch > > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986876#comment-15986876 ] Akira Ajisaka commented on HADOOP-14359: +1, the patch looks good to me. I confirmed that the modules do not have transitive commons-httpclient dependency. bq. I'd like to get rid of commons-httpclient and make downstream applications aware it will no longer appear in Hadoop code. Unfortunately, not yet. Now hadoop-yarn-project and yarn-server-timelineserver-hbase module have transitive commons-httpclient dependency via hbase-server. * hadoop-yarn-project -> hadoop-yarn-server -> hbase-server:1.2.4 -> commons-httpclient:3.1.0 HBASE-16267 removed the dependency and the fix version is 2.0.0. > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Assignee: Wei-Chiu Chuang >Priority: Minor > Attachments: HADOOP-14359.001.patch > > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HADOOP-14359: - Attachment: HADOOP-14359.001.patch Here's a quick patch to remove commons-httpclient from all pom.xml. It compiles locally. > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Assignee: Wei-Chiu Chuang >Priority: Minor > Attachments: HADOOP-14359.001.patch > > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986753#comment-15986753 ] Wei-Chiu Chuang commented on HADOOP-14359: -- Assign this to myself. I'd like to get rid of commons-httpclient and make downstream applications aware it will no longer appear in Hadoop code. > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Assignee: Wei-Chiu Chuang >Priority: Minor > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang reassigned HADOOP-14359: Assignee: Wei-Chiu Chuang > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Assignee: Wei-Chiu Chuang >Priority: Minor > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14355) Update maven-war-plugin to 3.1.0
[ https://issues.apache.org/jira/browse/HADOOP-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986715#comment-15986715 ] Akira Ajisaka commented on HADOOP-14355: The patch is a sample patch, not ready for commit. > Update maven-war-plugin to 3.1.0 > > > Key: HADOOP-14355 > URL: https://issues.apache.org/jira/browse/HADOOP-14355 > Project: Hadoop Common > Issue Type: Sub-task > Components: build >Reporter: Akira Ajisaka > Attachments: HADOOP-14335.testing.patch > > > Due to MWAR-405, build fails with Java 9. The issue is fixed in maven war > plugin 3.1.0. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14355) Update maven-war-plugin to 3.1.0
[ https://issues.apache.org/jira/browse/HADOOP-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986713#comment-15986713 ] Akira Ajisaka commented on HADOOP-14355: because 3.1.0 has not been released yet. https://lists.apache.org/thread.html/b552c209ed0180d74867ecb2e3a5a34ed158667cacd0a99e3757953a@%3Cdev.maven.apache.org%3E > Update maven-war-plugin to 3.1.0 > > > Key: HADOOP-14355 > URL: https://issues.apache.org/jira/browse/HADOOP-14355 > Project: Hadoop Common > Issue Type: Sub-task > Components: build >Reporter: Akira Ajisaka > Attachments: HADOOP-14335.testing.patch > > > Due to MWAR-405, build fails with Java 9. The issue is fixed in maven war > plugin 3.1.0. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14346) CryptoOutputStream throws IOException on flush() if stream is closed
[ https://issues.apache.org/jira/browse/HADOOP-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986560#comment-15986560 ] Hudson commented on HADOOP-14346: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11639 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11639/]) HADOOP-14346. CryptoOutputStream throws IOException if stream is closed. (stevel: rev 61cda39e4eec00678706d96e90026455ecfc0a90) * (edit) hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/crypto/CryptoOutputStream.java > CryptoOutputStream throws IOException on flush() if stream is closed > > > Key: HADOOP-14346 > URL: https://issues.apache.org/jira/browse/HADOOP-14346 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.3 >Reporter: Pierre Lacave >Assignee: Pierre Lacave > Fix For: 2.8.1 > > Attachments: CryptoOutputStream.flush-no-throw-on-closed.patch, > HADOOP-14346-1.patch > > > With Druid and Hadoop 2.7.3 I see that calls to flush() on a closed > CryptoOutputStream throws IOException. > Although flushing closed stream is dodgy, the culprit is actually > CryptoOutputStream, according to the java documentation it look actually > authorised. > The OutputStream java doc > (http://docs.oracle.com/javase/8/docs/api/java/io/OutputStream.html#flush()) > shows that flush should behave like close(), which allows being called on a > closed stream without exception (as opposed to write() and others which > clearly says should throw an exception) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-11614) Remove httpclient dependency from hadoop-openstack
[ https://issues.apache.org/jira/browse/HADOOP-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986557#comment-15986557 ] Hudson commented on HADOOP-11614: - SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #11639 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/11639/]) HADOOP-11614. Remove httpclient dependency from hadoop-openstack. (aajisaka: rev 62579b69a0a294ba1ea14cf76c650b640f89f331) * (delete) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/CopyMethod.java * (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/SwiftRestClient.java * (edit) hadoop-tools/hadoop-openstack/src/test/resources/log4j.properties * (edit) hadoop-tools/hadoop-openstack/src/test/java/org/apache/hadoop/fs/swift/http/TestSwiftRestClient.java * (add) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/util/HttpResponseUtils.java * (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/HttpInputStreamWithRelease.java * (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftInvalidResponseException.java * (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftThrottledRequestException.java * (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/snative/SwiftNativeFileSystemStore.java * (edit) hadoop-tools/hadoop-openstack/src/test/java/org/apache/hadoop/fs/swift/TestSwiftFileSystemPartitionedUploads.java * (edit) hadoop-tools/hadoop-openstack/pom.xml * (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftBadRequestException.java * (edit) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/exceptions/SwiftAuthenticationFailedException.java * (add) hadoop-tools/hadoop-openstack/src/main/java/org/apache/hadoop/fs/swift/http/CopyRequest.java > Remove httpclient dependency from hadoop-openstack > -- > > Key: HADOOP-11614 > URL: https://issues.apache.org/jira/browse/HADOOP-11614 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Akira Ajisaka >Assignee: Akira Ajisaka >Priority: Blocker > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-11614-002.patch, HADOOP-11614-003.patch, > HADOOP-11614-004.patch, HADOOP-11614-005.patch, HADOOP-11614-006.patch, > HADOOP-11614-007.patch, HADOOP-11614-008.patch, HADOOP-11614.patch > > > Remove httpclient dependency from hadoop-openstack and its pom.xml file. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14122) Add ADLS to hadoop-cloud-storage-project
[ https://issues.apache.org/jira/browse/HADOOP-14122?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986553#comment-15986553 ] Steve Loughran commented on HADOOP-14122: - I'll review this if done, and the alliyun one too into trunk. Then backport the module all the way least 2.8.x > Add ADLS to hadoop-cloud-storage-project > > > Key: HADOOP-14122 > URL: https://issues.apache.org/jira/browse/HADOOP-14122 > Project: Hadoop Common > Issue Type: Improvement > Components: fs/adl >Affects Versions: 3.0.0-alpha3 >Reporter: John Zhuge > > Add hadoop-azure-datalake to hadoop-cloud-storage-project. > HADOOP-13687 did include hadoop-azure-datalake at one point. > [~cnauroth], could you comment? -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14360) hadoop cloud moduies to scope hadoop-common at "provided"
Steve Loughran created HADOOP-14360:
---
Summary: hadoop cloud moduies to scope hadoop-common at
"provided"
Key: HADOOP-14360
URL: https://issues.apache.org/jira/browse/HADOOP-14360
Project: Hadoop Common
Issue Type: Improvement
Components: fs/adl, fs/azure, fs/oss, fs/s3, fs/swift
Affects Versions: 2.8.0
Reporter: Steve Loughran
If you are trying to exclude bits of the hadoop dependency tree *and include
the hadoop cloud modules, the transitive depenency of the various cloud modules
on {{hadoop-common}} forces you to exclude things in every module.
Better to mark those dependencies as {{provided}}: we assume that you add
hadoop-common to your CP, and only add as compile time dependencies all the new
JARs you need
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14360) hadoop cloud moduies to scope hadoop-common at "provided"
[
https://issues.apache.org/jira/browse/HADOOP-14360?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Steve Loughran updated HADOOP-14360:
Component/s: build
> hadoop cloud moduies to scope hadoop-common at "provided"
>
>
> Key: HADOOP-14360
> URL: https://issues.apache.org/jira/browse/HADOOP-14360
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build, fs/adl, fs/azure, fs/oss, fs/s3, fs/swift
>Affects Versions: 2.8.0
>Reporter: Steve Loughran
>
> If you are trying to exclude bits of the hadoop dependency tree *and include
> the hadoop cloud modules, the transitive depenency of the various cloud
> modules on {{hadoop-common}} forces you to exclude things in every module.
> Better to mark those dependencies as {{provided}}: we assume that you add
> hadoop-common to your CP, and only add as compile time dependencies all the
> new JARs you need
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986435#comment-15986435
]
Hadoop QA commented on HADOOP-14356:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 7s{color}
| {color:red} HADOOP-14356 does not apply to trunk. Rebase required? Wrong
Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HADOOP-14356 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12865326/HADOOP-14356-002.patch
|
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12201/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356-002.patch, HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14346) CryptoOutputStream throws IOException on flush() if stream is closed
[ https://issues.apache.org/jira/browse/HADOOP-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986388#comment-15986388 ] Steve Loughran commented on HADOOP-14346: - +1 Committed to branch-2.8+, thanks. > CryptoOutputStream throws IOException on flush() if stream is closed > > > Key: HADOOP-14346 > URL: https://issues.apache.org/jira/browse/HADOOP-14346 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.3 >Reporter: Pierre Lacave >Assignee: Pierre Lacave > Fix For: 2.8.1 > > Attachments: CryptoOutputStream.flush-no-throw-on-closed.patch, > HADOOP-14346-1.patch > > > With Druid and Hadoop 2.7.3 I see that calls to flush() on a closed > CryptoOutputStream throws IOException. > Although flushing closed stream is dodgy, the culprit is actually > CryptoOutputStream, according to the java documentation it look actually > authorised. > The OutputStream java doc > (http://docs.oracle.com/javase/8/docs/api/java/io/OutputStream.html#flush()) > shows that flush should behave like close(), which allows being called on a > closed stream without exception (as opposed to write() and others which > clearly says should throw an exception) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14346) CryptoOutputStream throws IOException on flush() if stream is closed
[ https://issues.apache.org/jira/browse/HADOOP-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14346: Resolution: Fixed Fix Version/s: 2.8.1 Status: Resolved (was: Patch Available) > CryptoOutputStream throws IOException on flush() if stream is closed > > > Key: HADOOP-14346 > URL: https://issues.apache.org/jira/browse/HADOOP-14346 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.3 >Reporter: Pierre Lacave >Assignee: Pierre Lacave > Fix For: 2.8.1 > > Attachments: CryptoOutputStream.flush-no-throw-on-closed.patch, > HADOOP-14346-1.patch > > > With Druid and Hadoop 2.7.3 I see that calls to flush() on a closed > CryptoOutputStream throws IOException. > Although flushing closed stream is dodgy, the culprit is actually > CryptoOutputStream, according to the java documentation it look actually > authorised. > The OutputStream java doc > (http://docs.oracle.com/javase/8/docs/api/java/io/OutputStream.html#flush()) > shows that flush should behave like close(), which allows being called on a > closed stream without exception (as opposed to write() and others which > clearly says should throw an exception) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-14346) CryptoOutputStream throws IOException on flush() if stream is closed
[ https://issues.apache.org/jira/browse/HADOOP-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-14346: --- Assignee: Pierre Lacave > CryptoOutputStream throws IOException on flush() if stream is closed > > > Key: HADOOP-14346 > URL: https://issues.apache.org/jira/browse/HADOOP-14346 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.3 >Reporter: Pierre Lacave >Assignee: Pierre Lacave > Fix For: 2.8.1 > > Attachments: CryptoOutputStream.flush-no-throw-on-closed.patch, > HADOOP-14346-1.patch > > > With Druid and Hadoop 2.7.3 I see that calls to flush() on a closed > CryptoOutputStream throws IOException. > Although flushing closed stream is dodgy, the culprit is actually > CryptoOutputStream, according to the java documentation it look actually > authorised. > The OutputStream java doc > (http://docs.oracle.com/javase/8/docs/api/java/io/OutputStream.html#flush()) > shows that flush should behave like close(), which allows being called on a > closed stream without exception (as opposed to write() and others which > clearly says should throw an exception) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14346) CryptoOutputStream throws IOException on flush() if stream is closed
[ https://issues.apache.org/jira/browse/HADOOP-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HADOOP-14346: Summary: CryptoOutputStream throws IOException on flush() if stream is closed (was: CryptoOutputStream throws IOException if stream is closed which is not the standard OutputStream behaviour ) > CryptoOutputStream throws IOException on flush() if stream is closed > > > Key: HADOOP-14346 > URL: https://issues.apache.org/jira/browse/HADOOP-14346 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.3 >Reporter: Pierre Lacave > Attachments: CryptoOutputStream.flush-no-throw-on-closed.patch, > HADOOP-14346-1.patch > > > With Druid and Hadoop 2.7.3 I see that calls to flush() on a closed > CryptoOutputStream throws IOException. > Although flushing closed stream is dodgy, the culprit is actually > CryptoOutputStream, according to the java documentation it look actually > authorised. > The OutputStream java doc > (http://docs.oracle.com/javase/8/docs/api/java/io/OutputStream.html#flush()) > shows that flush should behave like close(), which allows being called on a > closed stream without exception (as opposed to write() and others which > clearly says should throw an exception) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14346) CryptoOutputStream throws IOException if stream is closed which is not the standard OutputStream behaviour
[ https://issues.apache.org/jira/browse/HADOOP-14346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986377#comment-15986377 ] Steve Loughran commented on HADOOP-14346: - Actually, I'm thinking of applying it # there's ambiguity in what things are meant to do # if it works on non-crypto streams, it's clear that normal codepath ignores the operation when closed # which means it's a visible change in behaviour We hit a similar issue with thread safety: java.io says "no thread safety", HDFS had it, HBase relied on it, so this class follows the HDFS rules (HADOOP-11710). This is similar > CryptoOutputStream throws IOException if stream is closed which is not the > standard OutputStream behaviour > --- > > Key: HADOOP-14346 > URL: https://issues.apache.org/jira/browse/HADOOP-14346 > Project: Hadoop Common > Issue Type: Bug >Affects Versions: 2.7.3 >Reporter: Pierre Lacave > Attachments: CryptoOutputStream.flush-no-throw-on-closed.patch, > HADOOP-14346-1.patch > > > With Druid and Hadoop 2.7.3 I see that calls to flush() on a closed > CryptoOutputStream throws IOException. > Although flushing closed stream is dodgy, the culprit is actually > CryptoOutputStream, according to the java documentation it look actually > authorised. > The OutputStream java doc > (http://docs.oracle.com/javase/8/docs/api/java/io/OutputStream.html#flush()) > shows that flush should behave like close(), which allows being called on a > closed stream without exception (as opposed to write() and others which > clearly says should throw an exception) -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14355) Update maven-war-plugin to 3.1.0
[ https://issues.apache.org/jira/browse/HADOOP-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986374#comment-15986374 ] Steve Loughran commented on HADOOP-14355: - why the new staging entry? > Update maven-war-plugin to 3.1.0 > > > Key: HADOOP-14355 > URL: https://issues.apache.org/jira/browse/HADOOP-14355 > Project: Hadoop Common > Issue Type: Sub-task > Components: build >Reporter: Akira Ajisaka > Attachments: HADOOP-14335.testing.patch > > > Due to MWAR-405, build fails with Java 9. The issue is fixed in maven war > plugin 3.1.0. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14291) S3a "Bad Request" message to include diagnostics
[ https://issues.apache.org/jira/browse/HADOOP-14291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986342#comment-15986342 ] Steve Loughran commented on HADOOP-14291: - + proxies, IP Address of proxies and S3 endpoint + if bucket requires encryption and client doesn't have it turned on, that also fails. Something which can be probed Maybe the strategy would be to bootstrap comms to the endpoint: lookup, remote server time (in HTTP responses?), then * List buckets & see if the user is down as an owner for the target bucket (warn but don't fail if not, as it may be someone else's public one, one in same org,...) * attempt to read bucket root / * pick a file & do a HEAD * try to read the file * if enabled, attempt to write then delete an entry (some UUID on root; avoids directory creation issues) > S3a "Bad Request" message to include diagnostics > > > Key: HADOOP-14291 > URL: https://issues.apache.org/jira/browse/HADOOP-14291 > Project: Hadoop Common > Issue Type: Sub-task > Components: fs/s3 >Affects Versions: 2.8.0 >Reporter: Steve Loughran > > There's a whole section in s3a troubleshooting because requests can get auth > failures for many reasons, including > * no credentials > * wrong credentials > * right credentials, wrong bucket > * wrong endpoint for v4 auth > * trying to use private S3 server without specifying endpoint, so AWS being > hit > * clock out > * joda time > > We can aid with debugging this by including as much as we can in in the > message and a URL To a new S3A bad auth wiki page. > Info we could include > * bucket > * fs.s3a.endpoint > * nslookup of endpoint > * Anything else relevant but not a security risk > Goal; people stand a chance of working out what is failing within a bounded > time period -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HADOOP-14356:
--
Attachment: HADOOP-14356-002.patch
Oh, Updated now..Please review.
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356-002.patch, HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14355) Update maven-war-plugin to 3.1.0
[
https://issues.apache.org/jira/browse/HADOOP-14355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akira Ajisaka updated HADOOP-14355:
---
Attachment: HADOOP-14335.testing.patch
Attaching a patch for testing.
I can successfully compiled hadoop-auth-examples module without any error by
{{mvn clean install -DskipTests -Pstaged-releases}}
{noformat}
[INFO] --- maven-war-plugin:3.1.0:war (default-war) @ hadoop-auth-examples ---
[INFO] Packaging webapp
[INFO] Assembling webapp [hadoop-auth-examples] in
[/Users/ajisaka/git/hadoop/hadoop-common-project/hadoop-auth-examples/target/hadoop-auth-examples-3.0.0-alpha3-SNAPSHOT]
[INFO] Processing war project
[INFO] Copying webapp resources
[/Users/ajisaka/git/hadoop/hadoop-common-project/hadoop-auth-examples/src/main/webapp]
[INFO] Webapp assembled in [162 msecs]
[INFO] Building war:
/Users/ajisaka/git/hadoop/hadoop-common-project/hadoop-auth-examples/target/hadoop-auth-examples.war
{noformat}
without the change, it fails. Please see HADOOP-13915 for the detail.
> Update maven-war-plugin to 3.1.0
>
>
> Key: HADOOP-14355
> URL: https://issues.apache.org/jira/browse/HADOOP-14355
> Project: Hadoop Common
> Issue Type: Sub-task
> Components: build
>Reporter: Akira Ajisaka
> Attachments: HADOOP-14335.testing.patch
>
>
> Due to MWAR-405, build fails with Java 9. The issue is fixed in maven war
> plugin 3.1.0.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986301#comment-15986301
]
Hadoop QA commented on HADOOP-14356:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
0s{color} | {color:blue} Docker mode activated. {color} |
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 7s{color}
| {color:red} HADOOP-14356 does not apply to trunk. Rebase required? Wrong
Branch? See https://wiki.apache.org/hadoop/HowToContribute for help. {color} |
\\
\\
|| Subsystem || Report/Notes ||
| JIRA Issue | HADOOP-14356 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12865316/HADOOP-14356.patch |
| Console output |
https://builds.apache.org/job/PreCommit-HADOOP-Build/12200/console |
| Powered by | Apache Yetus 0.5.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-14358) NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: Native Library /usr/java/jdk/jre/lib/amd64/libhadoop.so already loaded in a
[
https://issues.apache.org/jira/browse/HADOOP-14358?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Masatake Iwasaki resolved HADOOP-14358.
---
Resolution: Invalid
Please use [user mailing list|https://hadoop.apache.org/mailing_lists.html] to
ask about operational issue. The log message implies misconfiguration.
> NativeCodeLoader: Failed to load native-hadoop with error:
> java.lang.UnsatisfiedLinkError: Native Library
> /usr/java/jdk/jre/lib/amd64/libhadoop.so already loaded in another classloader
> -
>
> Key: HADOOP-14358
> URL: https://issues.apache.org/jira/browse/HADOOP-14358
> Project: Hadoop Common
> Issue Type: Bug
> Components: common
>Reporter: liuxian
>
> I am not sure whether this is a problem, in the "public final class
> NativeCodeLoader", when "loadLibrary("hadoop")", encounter this Exception.
> This time I want to confirm whether "nativeCodeLoaded" variables should be
> true
> Log print as follows:
> Line 10307: 2017-04-26 19:06:51,459 DEBUG NativeCodeLoader: Trying to load
> the custom-built native-hadoop library...
> Line 10308: 2017-04-26 19:06:51,460 DEBUG NativeCodeLoader: Failed to
> load native-hadoop with error: java.lang.UnsatisfiedLinkError: Native Library
> /usr/java/jdk/jre/lib/amd64/libhadoop.so already loaded in another classloader
> Line 10309: 2017-04-26 19:06:51,460 DEBUG NativeCodeLoader:
> java.library.path=/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
> Line 10310: 2017-04-26 19:06:51,460 WARN NativeCodeLoader: Unable to
> load native-hadoop library for your platform... using builtin-java classes
> where applicable
>*/
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986285#comment-15986285
]
Akira Ajisaka commented on HADOOP-14356:
I used {{git log --numstat}} to find the commits that do not edit CHANGES.txt.
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986282#comment-15986282
]
Akira Ajisaka commented on HADOOP-14356:
Would you add the following issues?
HADOOP-14195, YARN-1728, MAPREDUCE-6711, YARN-5694, HDFS-10941, HDFS-10921,
YARN-3877
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HADOOP-14356:
--
Attachment: HADOOP-14356.patch
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HADOOP-14356:
--
Attachment: (was: HADOOP-14356.patch)
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HADOOP-14356:
--
Attachment: (was: HADOOP-14356.patch)
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HADOOP-14356:
--
Attachment: HADOOP-14356.patch
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HADOOP-14356:
--
Status: Patch Available (was: Open)
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula updated HADOOP-14356:
--
Attachment: HADOOP-14356.patch
Attached the patch..Kindly Review.
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Assigned] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Brahma Reddy Battula reassigned HADOOP-14356:
-
Assignee: Brahma Reddy Battula
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Assignee: Brahma Reddy Battula
>Priority: Blocker
> Attachments: HADOOP-14356.patch
>
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-11614) Remove httpclient dependency from hadoop-openstack
[ https://issues.apache.org/jira/browse/HADOOP-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986226#comment-15986226 ] Brahma Reddy Battula commented on HADOOP-11614: --- [~ajisakaa] thanks for commit and thanks to others.. > Remove httpclient dependency from hadoop-openstack > -- > > Key: HADOOP-11614 > URL: https://issues.apache.org/jira/browse/HADOOP-11614 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Akira Ajisaka >Assignee: Akira Ajisaka >Priority: Blocker > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-11614-002.patch, HADOOP-11614-003.patch, > HADOOP-11614-004.patch, HADOOP-11614-005.patch, HADOOP-11614-006.patch, > HADOOP-11614-007.patch, HADOOP-11614-008.patch, HADOOP-11614.patch > > > Remove httpclient dependency from hadoop-openstack and its pom.xml file. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14359) Remove unnecessary shading of commons-httpclient
[ https://issues.apache.org/jira/browse/HADOOP-14359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-14359: --- Summary: Remove unnecessary shading of commons-httpclient (was: Remove unnecessary shading of httpclient) > Remove unnecessary shading of commons-httpclient > > > Key: HADOOP-14359 > URL: https://issues.apache.org/jira/browse/HADOOP-14359 > Project: Hadoop Common > Issue Type: Improvement >Reporter: Akira Ajisaka >Priority: Minor > > commons-httpclient dependency was removed in HADOOP-10105 but there are some > settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-10105) remove httpclient dependency
[
https://issues.apache.org/jira/browse/HADOOP-10105?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986176#comment-15986176
]
Akira Ajisaka commented on HADOOP-10105:
The issue was completed but I noticed there is a task to do. Filed HADOOP-14359
to remove unneessary settings to shade commons-httpclient.
> remove httpclient dependency
>
>
> Key: HADOOP-10105
> URL: https://issues.apache.org/jira/browse/HADOOP-10105
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
>Affects Versions: 2.8.0
>Reporter: Colin P. McCabe
>Assignee: Akira Ajisaka
>Priority: Blocker
> Fix For: 3.0.0-alpha3
>
> Attachments: HADOOP-10105.2.patch, HADOOP-10105.part2.patch,
> HADOOP-10105.part.patch, HADOOP-10105.patch
>
>
> httpclient is now end-of-life and is no longer being developed. Now that we
> have a dependency on {{httpcore}}, we should phase out our use of the old
> discontinued {{httpclient}} library in Hadoop. This will allow us to reduce
> {{CLASSPATH}} bloat and get updated code.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Created] (HADOOP-14359) Remove unnecessary shading of httpclient
Akira Ajisaka created HADOOP-14359: -- Summary: Remove unnecessary shading of httpclient Key: HADOOP-14359 URL: https://issues.apache.org/jira/browse/HADOOP-14359 Project: Hadoop Common Issue Type: Improvement Reporter: Akira Ajisaka Priority: Minor commons-httpclient dependency was removed in HADOOP-10105 but there are some settings to shade commons-httpclient. Probably they can be safely removed. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Resolved] (HADOOP-10105) remove httpclient dependency
[
https://issues.apache.org/jira/browse/HADOOP-10105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akira Ajisaka resolved HADOOP-10105.
Resolution: Fixed
Fix Version/s: 3.0.0-alpha3
Release Note: Apache Httpclient has been removed as a dependency. This
library is End of Life: people using it should move to its {{httpcore}}
successor. If you cannot do that, you must add an explicit dependency on
{{httpclient}} in your classpath. (was: Apache Httpclient has been removed as
a dependency. This library is End of Life: people using it should move to its
{{httpcode}} successor. If you cannot do that, you must add an explicit
dependency on {{httpclient}} in your classpath.)
All sub-tasks are now resolved. Closing this.
Thanks all for contributing to this issue!
> remove httpclient dependency
>
>
> Key: HADOOP-10105
> URL: https://issues.apache.org/jira/browse/HADOOP-10105
> Project: Hadoop Common
> Issue Type: Improvement
> Components: build
>Affects Versions: 2.8.0
>Reporter: Colin P. McCabe
>Assignee: Akira Ajisaka
>Priority: Blocker
> Fix For: 3.0.0-alpha3
>
> Attachments: HADOOP-10105.2.patch, HADOOP-10105.part2.patch,
> HADOOP-10105.part.patch, HADOOP-10105.patch
>
>
> httpclient is now end-of-life and is no longer being developed. Now that we
> have a dependency on {{httpcore}}, we should phase out our use of the old
> discontinued {{httpclient}} library in Hadoop. This will allow us to reduce
> {{CLASSPATH}} bloat and get updated code.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-11614) Remove httpclient dependency from hadoop-openstack
[ https://issues.apache.org/jira/browse/HADOOP-11614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira Ajisaka updated HADOOP-11614: --- Resolution: Fixed Assignee: Akira Ajisaka (was: Brahma Reddy Battula) Fix Version/s: 3.0.0-alpha3 Status: Resolved (was: Patch Available) Committed this to trunk. Thanks [~iwasakims] and [~ste...@apache.org] for the review and thanks [~brahmareddy] for the contribution. > Remove httpclient dependency from hadoop-openstack > -- > > Key: HADOOP-11614 > URL: https://issues.apache.org/jira/browse/HADOOP-11614 > Project: Hadoop Common > Issue Type: Sub-task >Reporter: Akira Ajisaka >Assignee: Akira Ajisaka >Priority: Blocker > Fix For: 3.0.0-alpha3 > > Attachments: HADOOP-11614-002.patch, HADOOP-11614-003.patch, > HADOOP-11614-004.patch, HADOOP-11614-005.patch, HADOOP-11614-006.patch, > HADOOP-11614-007.patch, HADOOP-11614-008.patch, HADOOP-11614.patch > > > Remove httpclient dependency from hadoop-openstack and its pom.xml file. -- This message was sent by Atlassian JIRA (v6.3.15#6346) - To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Updated] (HADOOP-14356) Update CHANGES.txt to reflect all the changes in branch-2.7
[
https://issues.apache.org/jira/browse/HADOOP-14356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Akira Ajisaka updated HADOOP-14356:
---
Priority: Blocker (was: Major)
> Update CHANGES.txt to reflect all the changes in branch-2.7
> ---
>
> Key: HADOOP-14356
> URL: https://issues.apache.org/jira/browse/HADOOP-14356
> Project: Hadoop Common
> Issue Type: Bug
>Reporter: Brahma Reddy Battula
>Priority: Blocker
>
> Following jira's are not updated in {{CHANGES.txt}}
> HADOOP-14066,HDFS-11608,HADOOP-14293,HDFS-11628,YARN-6274,YARN-6152,HADOOP-13119,HDFS-10733,HADOOP-13958,HDFS-11280,YARN-6024
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
-
To unsubscribe, e-mail: common-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-issues-h...@hadoop.apache.org
[jira] [Commented] (HADOOP-13200) Seeking a better approach allowing to customize and configure erasure coders
[
https://issues.apache.org/jira/browse/HADOOP-13200?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15986151#comment-15986151
]
Hadoop QA commented on HADOOP-13200:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
18s{color} | {color:blue} Docker mode activated. {color} |
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 9 new or modified test
files. {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
13s{color} | {color:blue} Maven dependency ordering for branch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 13m
56s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 16m
51s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
59s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 2m
24s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
39s{color} | {color:green} trunk passed {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
41s{color} | {color:red} hadoop-common-project/hadoop-common in trunk has 17
extant Findbugs warnings. {color} |
| {color:red}-1{color} | {color:red} findbugs {color} | {color:red} 1m
59s{color} | {color:red} hadoop-hdfs-project/hadoop-hdfs in trunk has 10 extant
Findbugs warnings. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
43s{color} | {color:green} trunk passed {color} |
| {color:blue}0{color} | {color:blue} mvndep {color} | {color:blue} 0m
17s{color} | {color:blue} Maven dependency ordering for patch {color} |
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
52s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 15m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 15m
7s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 1m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 2m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvneclipse {color} | {color:green} 0m
49s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 3m
34s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
45s{color} | {color:green} the patch passed {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 7m 54s{color}
| {color:red} hadoop-common in the patch failed. {color} |
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 63m 57s{color}
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
43s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}166m 19s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.security.TestKDiag |
| | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:0ac17dc |
| JIRA Issue | HADOOP-13200 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12865267/HADOOP-13200.11.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle xml |
| uname | Linux 6a1a1966e35d 3.13.0-106-generic #153-Ubuntu SMP Tue Dec 6
15:44:32 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | trunk / 28eb2aa |
| Default Java | 1.8.0_121 |
| findbugs | v3.1.0-RC1 |
| findbugs |
