[jira] [Created] (HADOOP-13693) Make the SPNEGO initialization OPTIONS message in kms audit log more admin-friendly
Xiao Chen created HADOOP-13693: -- Summary: Make the SPNEGO initialization OPTIONS message in kms audit log more admin-friendly Key: HADOOP-13693 URL: https://issues.apache.org/jira/browse/HADOOP-13693 Project: Hadoop Common Issue Type: Improvement Components: kms Reporter: Xiao Chen Assignee: Xiao Chen Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13692) hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts.
Chris Nauroth created HADOOP-13692: -- Summary: hadoop-aws should declare explicit dependency on Jackson 2 jars to prevent classpath conflicts. Key: HADOOP-13692 URL: https://issues.apache.org/jira/browse/HADOOP-13692 Project: Hadoop Common Issue Type: Sub-task Components: fs/s3 Reporter: Chris Nauroth Assignee: Chris Nauroth Priority: Minor If an end user's application has a dependency on hadoop-aws and no other Hadoop artifacts, then it picks up a transitive dependency on Jackson 2.5.3 jars through the AWS SDK. This can cause conflicts at deployment time, because Hadoop has a dependency on version 2.2.3, and the 2 versions are not compatible with one another. We can prevent this problem by changing hadoop-aws to declare explicit dependencies on the Jackson artifacts, at the version Hadoop wants. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13691) remove build person and date from various hadoop UI
Sangjin Lee created HADOOP-13691: Summary: remove build person and date from various hadoop UI Key: HADOOP-13691 URL: https://issues.apache.org/jira/browse/HADOOP-13691 Project: Hadoop Common Issue Type: Improvement Components: util Reporter: Sangjin Lee Priority: Minor Currently in the namenode UI as well as the resource manager UI, we display the date of the build as well as the user id of the person who built it. Although other bits of information is useful (e.g. git commit it, branch, etc.), the value of the build date and user is suspect. We should consider removing them from the visible UI. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
I think it's a good idea. We can still have the underlying data (in *-version.properties) but we can consider removing the date and the build person from the web UI. I'll file a JIRA to consider the idea. I would greatly appreciate it if you folks can take a little time to take the RC1 for a spin and vote on it. Tomorrow will be the conclusion of the vote, and I haven't received many votes yet. Thanks! Sangjin On Thu, Oct 6, 2016 at 3:13 PM, Andrew Wangwrote: > I don't think it's a blocker, though I wonder what the point of that date > and attribution are on the WebUI. > > Maybe file a follow-on JIRA to remove it for the future? > > On Thu, Oct 6, 2016 at 3:09 PM, Sangjin Lee wrote: > > > I looked into building it on jenkins earlier, but it appears that this > > jenkins job is busted (at least for 2.6.x): > > https://builds.apache.org/job/HADOOP2_Release_Artifacts_Builder/ > > > > I don't have access to the job configuration, so I'm unable to fix it > atm. > > > > That said, I do think Allen has a point. It strikes me that the release > > manager building it under his/her own control shouldn't be a problem, if > > not better. Also, the how-to-release wiki currently seems to suggest > > building it locally is fine (http://wiki.apache.org/hadoop/HowToRelease > ). > > > > IMO I don't think this is a blocker. Thoughts? > > > > Thanks, > > Sangjin > > > > On Thu, Oct 6, 2016 at 1:39 PM, Akira Ajisaka < > ajisa...@oss.nttdata.co.jp> > > wrote: > > > > > > It wasn't 'renamed' to jenkins, prior releases were actually built by > > > and on the Jenkins infrastructure. Which was a very very bad idea: > it's > > > insecure and pretty much against ASF policy. > > > > > > Sorry for the confusion. I should not have used the word 'rename'. > > > What I meant is that "would you change the name to 'jenkins' by using > the > > > Jenkins infra?" > > > > > > Regards, > > > Akira > > > > > > > > > On 10/7/16 03:04, Allen Wittenauer wrote: > > > > > >> > > >> On Oct 5, 2016, at 10:35 PM, Akira Ajisaka < > ajisa...@oss.nttdata.co.jp> > > >>> wrote: > > >>> Can we rename it? > > >>> > > >>> AFAIK, hadoop releases were built by hortonmu in 2014 and was renamed > > to > > >>> jenkins. > > >>> > > >> > > >> That's not how that works. > > >> > > >> It's literally storing the id of the person who built the > > >> classes. It wasn't 'renamed' to jenkins, prior releases were actually > > >> built by and on the Jenkins infrastructure. Which was a very very bad > > >> idea: it's insecure and pretty much against ASF policy. > > >> - > > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > >> > > >> > > > > > > - > > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > > > > > >
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
I don't think it's a blocker, though I wonder what the point of that date and attribution are on the WebUI. Maybe file a follow-on JIRA to remove it for the future? On Thu, Oct 6, 2016 at 3:09 PM, Sangjin Leewrote: > I looked into building it on jenkins earlier, but it appears that this > jenkins job is busted (at least for 2.6.x): > https://builds.apache.org/job/HADOOP2_Release_Artifacts_Builder/ > > I don't have access to the job configuration, so I'm unable to fix it atm. > > That said, I do think Allen has a point. It strikes me that the release > manager building it under his/her own control shouldn't be a problem, if > not better. Also, the how-to-release wiki currently seems to suggest > building it locally is fine (http://wiki.apache.org/hadoop/HowToRelease). > > IMO I don't think this is a blocker. Thoughts? > > Thanks, > Sangjin > > On Thu, Oct 6, 2016 at 1:39 PM, Akira Ajisaka > wrote: > > > > It wasn't 'renamed' to jenkins, prior releases were actually built by > > and on the Jenkins infrastructure. Which was a very very bad idea: it's > > insecure and pretty much against ASF policy. > > > > Sorry for the confusion. I should not have used the word 'rename'. > > What I meant is that "would you change the name to 'jenkins' by using the > > Jenkins infra?" > > > > Regards, > > Akira > > > > > > On 10/7/16 03:04, Allen Wittenauer wrote: > > > >> > >> On Oct 5, 2016, at 10:35 PM, Akira Ajisaka > >>> wrote: > >>> Can we rename it? > >>> > >>> AFAIK, hadoop releases were built by hortonmu in 2014 and was renamed > to > >>> jenkins. > >>> > >> > >> That's not how that works. > >> > >> It's literally storing the id of the person who built the > >> classes. It wasn't 'renamed' to jenkins, prior releases were actually > >> built by and on the Jenkins infrastructure. Which was a very very bad > >> idea: it's insecure and pretty much against ASF policy. > >> - > >> To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > >> For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >> > >> > > > > - > > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > > > > >
[jira] [Resolved] (HADOOP-11513) Artifact errors with Maven build
[ https://issues.apache.org/jira/browse/HADOOP-11513?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu resolved HADOOP-11513. Resolution: Cannot Reproduce Feel free to re-open if it happens again. Thanks. > Artifact errors with Maven build > > > Key: HADOOP-11513 > URL: https://issues.apache.org/jira/browse/HADOOP-11513 > Project: Hadoop Common > Issue Type: Bug > Components: build >Affects Versions: 2.7.0 >Reporter: Arpit Agarwal > > I recently started getting the following errors with _mvn -q clean compile > install_ on Linux and OS X. > {code} > [ERROR] Artifact: org.xerial.snappy:snappy-java:jar:1.0.4.1 has no file. > [ERROR] Artifact: xerces:xercesImpl:jar:2.9.1 has no file. > [ERROR] Artifact: xml-apis:xml-apis:jar:1.3.04 has no file. > [ERROR] Artifact: xmlenc:xmlenc:jar:0.52 has no file. > [ERROR] Artifact: org.xerial.snappy:snappy-java:jar:1.0.4.1 has no file. > [ERROR] Artifact: xerces:xercesImpl:jar:2.9.1 has no file. > [ERROR] Artifact: xml-apis:xml-apis:jar:1.3.04 has no file. > [ERROR] Artifact: xmlenc:xmlenc:jar:0.52 has no file. > {code} > _mvn --version_ on Linux reports: > {code} > Apache Maven 3.2.5 (12a6b3acb947671f09b81f49094c53f426d8cea1; > 2014-12-14T09:29:23-08:00) > Maven home: /home/vagrant/usr/share/maven > Java version: 1.7.0_65, vendor: Oracle Corporation > Java home: /usr/lib/jvm/java-7-openjdk-amd64/jre > Default locale: en_US, platform encoding: UTF-8 > OS name: "linux", version: "3.13.0-24-generic", arch: "amd64", family: "unix" > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/116/ [Oct 5, 2016 2:02:11 PM] (stevel) HADOOP-12667 s3a to support createNonRecursive API. Contributed by Sean [Oct 5, 2016 5:52:50 PM] (jing9) HDFS-10826. Correctly report missing EC blocks in FSCK. Contributed by [Oct 5, 2016 7:16:49 PM] (cdouglas) YARN-5702. Refactor TestPBImplRecords for reuse in other YARN modules. [Oct 5, 2016 8:50:01 PM] (liuml07) HADOOP-13628. Support to retrieve specific property from configuration [Oct 5, 2016 10:08:56 PM] (wang) HDFS-10962. TestRequestHedgingProxyProvider is flaky. [Oct 6, 2016 12:36:50 AM] (weichiu) HDFS-10683. Make class Token$PrivateToken private. Contributed by John [Oct 6, 2016 5:33:29 AM] (liuml07) HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for [Oct 6, 2016 6:57:15 AM] (aajisaka) MAPREDUCE-6789. Fix TestAMWebApp failure. Contributed by Daniel [Oct 6, 2016 12:17:31 PM] (brahma) HDFS-10963. Reduce log level when network topology cannot find enough [Oct 6, 2016 12:36:08 PM] (brahma) HADOOP-13690. Fix typos in core-default.xml. Contributed by Yiqun Lin -1 overall The following subsystems voted -1: compile unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.ha.TestZKFailoverController hadoop.hdfs.tools.offlineImageViewer.TestOfflineImageViewer hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.yarn.server.nodemanager.recovery.TestNMLeveldbStateStoreService hadoop.yarn.server.nodemanager.TestNodeManagerShutdown hadoop.yarn.server.timeline.TestRollingLevelDB hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices hadoop.yarn.server.timeline.TestTimelineDataManager hadoop.yarn.server.timeline.TestLeveldbTimelineStore hadoop.yarn.server.timeline.recovery.TestLeveldbTimelineStateStore hadoop.yarn.server.timeline.TestRollingLevelDBTimelineStore hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.timelineservice.storage.common.TestRowKeys hadoop.yarn.server.timelineservice.storage.common.TestKeyConverters hadoop.yarn.server.timelineservice.storage.common.TestSeparator hadoop.yarn.server.resourcemanager.recovery.TestLeveldbRMStateStore hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.server.resourcemanager.TestRMAdminService hadoop.yarn.server.resourcemanager.TestResourceTrackerService hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.client.api.impl.TestNMClient hadoop.yarn.server.timeline.TestLevelDBCacheTimelineStore hadoop.yarn.server.timeline.TestOverrideTimelineStoreYarnClient hadoop.yarn.server.timeline.TestEntityGroupFSTimelineStore hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestPhoenixOfflineAggregationWriterImpl hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.yarn.applications.distributedshell.TestDistributedShell hadoop.mapred.TestShuffleHandler hadoop.mapreduce.v2.hs.TestHistoryServerLeveldbStateStoreService Timed out junit tests : org.apache.hadoop.hdfs.server.datanode.TestFsDatasetCache org.apache.hadoop.mapred.TestMRIntermediateDataEncryption compile: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/116/artifact/out/patch-compile-root.txt [312K] cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/116/artifact/out/patch-compile-root.txt [312K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/116/artifact/out/patch-compile-root.txt [312K] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/116/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [120K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/116/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [196K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/116/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [52K]
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
+1 ( non- binding) --Downloaded source and built from it. --Installed 3 node cluster with HA deployed. —Ran sample MR jobs and tested with basics operations. — Integrated JCarder tool to find any potential deadlock cycles. And did not observe any potential cycles. Thanks & Regards Rohith Sharma K S > On Oct 3, 2016, at 5:42 AM, Sangjin Leewrote: > > Hi folks, > > I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5 > release (the next maintenance release in the 2.6.x release line). RC1 > contains fixes to CHANGES.txt, and is otherwise identical to RC0. > > Below are the details of this release candidate: > > The RC is available for validation at: > http://home.apache.org/~sjlee/hadoop-2.6.5-RC1/. > > The RC tag in git is release-2.6.5-RC1 and its git commit is > e8c9fe0b4c252caf2ebf1464220599650f119997. > > The maven artifacts are staged via repository.apache.org at: > https://repository.apache.org/content/repositories/orgapachehadoop-1050/. > > You can find my public key at > http://svn.apache.org/repos/asf/hadoop/common/dist/KEYS. > > Please try the release and vote. The vote will run for the usual 5 days. I > would greatly appreciate your timely vote. Thanks! > > Regards, > Sangjin - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)
> On Oct 5, 2016, at 10:35 PM, Akira Ajisakawrote: > Can we rename it? > > AFAIK, hadoop releases were built by hortonmu in 2014 and was renamed to > jenkins. That's not how that works. It's literally storing the id of the person who built the classes. It wasn't 'renamed' to jenkins, prior releases were actually built by and on the Jenkins infrastructure. Which was a very very bad idea: it's insecure and pretty much against ASF policy. - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/ [Oct 5, 2016 10:01:38 AM] (vvasudev) YARN-5704. Provide config knobs to control enabling/disabling new/work [Oct 5, 2016 11:41:08 AM] (aajisaka) HADOOP-13685. Document -safely option of rm command. Contributed by [Oct 5, 2016 11:44:39 AM] (aajisaka) HADOOP-13681. Reduce Kafka dependencies in hadoop-kafka module. [Oct 5, 2016 2:02:11 PM] (stevel) HADOOP-12667 s3a to support createNonRecursive API. Contributed by Sean [Oct 5, 2016 5:52:50 PM] (jing9) HDFS-10826. Correctly report missing EC blocks in FSCK. Contributed by [Oct 5, 2016 7:16:49 PM] (cdouglas) YARN-5702. Refactor TestPBImplRecords for reuse in other YARN modules. [Oct 5, 2016 8:50:01 PM] (liuml07) HADOOP-13628. Support to retrieve specific property from configuration [Oct 5, 2016 10:08:56 PM] (wang) HDFS-10962. TestRequestHedgingProxyProvider is flaky. [Oct 6, 2016 12:36:50 AM] (weichiu) HDFS-10683. Make class Token$PrivateToken private. Contributed by John [Oct 6, 2016 5:33:29 AM] (liuml07) HDFS-10893. Refactor TestDFSShell by setting up MiniDFSCluser once for -1 overall The following subsystems voted -1: asflicense unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager hadoop.yarn.server.applicationhistoryservice.webapp.TestAHSWebServices hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.mapreduce.v2.app.webapp.TestAMWebApp cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/diff-compile-javac-root.txt [168K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/whitespace-eol.txt [11M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/diff-javadoc-javadoc-root.txt [2.2M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [40K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [12K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt [24K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [120K] asflicense: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/186/artifact/out/patch-asflicense-problems.txt [4.0K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org
[jira] [Created] (HADOOP-13690) Fix typos in core-default.xml
Yiqun Lin created HADOOP-13690: -- Summary: Fix typos in core-default.xml Key: HADOOP-13690 URL: https://issues.apache.org/jira/browse/HADOOP-13690 Project: Hadoop Common Issue Type: Bug Components: documentation Reporter: Yiqun Lin Assignee: Yiqun Lin Priority: Minor There are three typos in file {{core-default.xml}}: * In {{hadoop.user.group.static.mapping.overrides}}: in otherwords-> in other words * In {{hadoop.security.group.mapping.ldap.search.group.hierarchy.levels}}: exectue->execute * In {{hadoop.security.dns.interface}}: subsitution->substitution -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: common-dev-h...@hadoop.apache.org