Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)
+ Junping, Sammi Hi Jonathan, Many thanks for reporting the issues and sorry for the inconvenience. 1. Shouldn't the build be looking for artifacts in https://repository.apache.org/content/repositories/releases rather than https://repository.apache.org/content/repositories/snapshots ? 2. Not seeing the artifact published here as well. https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project Indeed, I did not see 2.9.1 there too. So included Sammi Chen. Hi Junping, would you please share which step in https://wiki.apache.org/hadoop/HowToRelease should have done this? Thanks a lot. --Yongjun On Fri, Jun 15, 2018 at 10:52 PM, Jonathan Eagles wrote: > Upgraded Tez dependency to hadoop 3.0.3 and found this issue. Anyone else > seeing this issue? > > [ERROR] Failed to execute goal on project hadoop-shim: Could not resolve > dependencies for project org.apache.tez:hadoop-shim:jar:0.10.0-SNAPSHOT: > Failed to collect dependencies at org.apache.hadoop:hadoop-yarn-api:jar:3.0.3: > Failed to read artifact descriptor for > org.apache.hadoop:hadoop-yarn-api:jar:3.0.3: > Could not find artifact org.apache.hadoop:hadoop-project:pom:3.0.3 in > apache.snapshots.https (https://repository.apache. > org/content/repositories/snapshots) -> [Help 1] > [ERROR] > [ERROR] To see the full stack trace of the errors, re-run Maven with the > -e switch. > [ERROR] Re-run Maven using the -X switch to enable full debug logging. > [ERROR] > [ERROR] For more information about the errors and possible solutions, > please read the following articles: > [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/ > DependencyResolutionException > [ERROR] > [ERROR] After correcting the problems, you can resume the build with the > command > [ERROR] mvn -rf :hadoop-shim > > Not seeing the artifact published here as well. > https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-project > > On Tue, Jun 12, 2018 at 6:44 PM, Yongjun Zhang > wrote: > >> Thanks Eric! >> >> --Yongjun >> >> On Mon, Jun 11, 2018 at 8:05 AM, Eric Payne >> wrote: >> >> > Sorry, Yongjun. My +1 is also binding >> > +1 (binding) >> > -Eric Payne >> > >> > On Friday, June 1, 2018, 12:25:36 PM CDT, Eric Payne < >> > eric.payne1...@yahoo.com> wrote: >> > >> > >> > >> > >> > Thanks a lot, Yongjun, for your hard work on this release. >> > >> > +1 >> > - Built from source >> > - Installed on 6 node pseudo cluster >> > >> > >> > Tested the following in the Capacity Scheduler: >> > - Verified that running apps in labelled queues restricts tasks to the >> > labelled nodes. >> > - Verified that various queue config properties for CS are refreshable >> > - Verified streaming jobs work as expected >> > - Verified that user weights work as expected >> > - Verified that FairOrderingPolicy in a CS queue will evenly assign >> > resources >> > - Verified running yarn shell application runs as expected >> > >> > >> > >> > >> > >> > >> > >> > On Friday, June 1, 2018, 12:48:26 AM CDT, Yongjun Zhang < >> > yjzhan...@apache.org> wrote: >> > >> > >> > >> > >> > >> > Greetings all, >> > >> > I've created the first release candidate (RC0) for Apache Hadoop >> > 3.0.3. This is our next maintenance release to follow up 3.0.2. It >> includes >> > about 249 >> > important fixes and improvements, among which there are 8 blockers. See >> > https://issues.apache.org/jira/issues/?filter=12343997 >> > >> > The RC artifacts are available at: >> > https://dist.apache.org/repos/dist/dev/hadoop/3.0.3-RC0/ >> > >> > The maven artifacts are available via >> > https://repository.apache.org/content/repositories/orgapachehadoop-1126 >> > >> > Please try the release and vote; the vote will run for the usual 5 >> working >> > days, ending on 06/07/2018 PST time. Would really appreciate your >> > participation here. >> > >> > I bumped into quite some issues along the way, many thanks to quite a >> few >> > people who helped, especially Sammi Chen, Andrew Wang, Junping Du, Eddy >> Xu. >> > >> > Thanks, >> > >> > --Yongjun >> > >> > >
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/ [Jun 15, 2018 9:28:20 AM] (msingh) HDFS-13679. Fix Typo in javadoc for ScanInfoPerBlockPool#addAll. [Jun 15, 2018 4:40:45 PM] (inigoiri) HADOOP-15537. Clean up ContainerLaunch and ContainerExecutor [Jun 15, 2018 5:33:28 PM] (inigoiri) HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming [Jun 15, 2018 8:07:54 PM] (inigoiri) HDFS-13676. TestEditLogRace fails on Windows. Contributed by Zuoming [Jun 15, 2018 8:36:46 PM] (weichiu) HDFS-13174. hdfs mover -p /path times out after 20 min. Contributed by [Jun 15, 2018 9:10:17 PM] (aengineer) HDDS-172. The numbers of operation should be integer in KSM UI. [Jun 15, 2018 10:06:26 PM] (mackrorysd) HADOOP-15504. Upgrade Maven Core and Maven Wagon dependencies. [Jun 15, 2018 10:59:19 PM] (inigoiri) HDFS-13686. Add overall metrics for FSNamesystemLock. Contributed by [Jun 15, 2018 11:49:06 PM] (inigoiri) HDFS-13681. Fix TestStartup.testNNFailToStartOnReadOnlyNNDir test -1 overall The following subsystems voted -1: asflicense findbugs pathlen shadedclient unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: FindBugs : module:hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager Inconsistent synchronization of org.apache.hadoop.yarn.server.resourcemanager.scheduler.fair.AllocationFileLoaderService.reloadListener; locked 75% of time Unsynchronized access at AllocationFileLoaderService.java:75% of time Unsynchronized access at AllocationFileLoaderService.java:[line 117] Failed junit tests : hadoop.hdfs.server.balancer.TestBalancer hadoop.hdfs.web.TestWebHdfsTimeouts hadoop.hdfs.server.namenode.TestDecommissioningStatus hadoop.yarn.logaggregation.TestAggregatedLogDeletionService hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageSchema hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity hadoop.mapred.TestMRTimelineEventHandling Failed TAP tests : hadoop_stop_daemon.bats.tap cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/diff-compile-javac-root.txt [348K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/diff-checkstyle-root.txt [4.0K] pathlen: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/pathlen.txt [12K] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/diff-patch-pylint.txt [24K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/whitespace-eol.txt [9.4M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/whitespace-tabs.txt [1.1M] xml: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/xml.txt [4.0K] findbugs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/branch-findbugs-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager-warnings.html [8.0K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/branch-findbugs-hadoop-hdds_client.txt [56K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/branch-findbugs-hadoop-hdds_container-service.txt [48K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/branch-findbugs-hadoop-hdds_server-scm.txt [60K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/813/artifact/out/branch-findbugs-hadoop-hdds_tools.txt [12K]
Apache Hadoop qbt Report: trunk+JDK8 on Windows/x64
For more details, see https://builds.apache.org/job/hadoop-trunk-win/499/ [Jun 14, 2018 8:14:25 PM] (Bharat) YARN-8426:Upgrade jquery-ui to 1.12.1 in YARN. Contributed by Sunil [Jun 14, 2018 8:43:14 PM] (inigoiri) HDFS-13675. Speed up TestDFSAdminWithHA. Contributed by Lukas Majercak. [Jun 14, 2018 9:14:24 PM] (aengineer) HDDS-146. Refactor the structure of the acceptance tests. Contributed by [Jun 15, 2018 9:28:20 AM] (msingh) HDFS-13679. Fix Typo in javadoc for ScanInfoPerBlockPool#addAll. [Jun 15, 2018 4:40:45 PM] (inigoiri) HADOOP-15537. Clean up ContainerLaunch and ContainerExecutor [Jun 15, 2018 5:33:28 PM] (inigoiri) HDFS-13673. TestNameNodeMetrics fails on Windows. Contributed by Zuoming -1 overall The following subsystems voted -1: compile mvninstall pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed junit tests : hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.contract.rawlocal.TestRawlocalContractAppend hadoop.fs.TestFileUtil hadoop.fs.TestFsShellCopy hadoop.fs.TestFsShellList hadoop.fs.TestLocalFileSystem hadoop.http.TestHttpServer hadoop.http.TestHttpServerLogs hadoop.io.compress.TestCodec hadoop.io.nativeio.TestNativeIO hadoop.ipc.TestSocketFactory hadoop.metrics2.impl.TestStatsDMetrics hadoop.security.TestSecurityUtil hadoop.security.TestShellBasedUnixGroupsMapping hadoop.security.token.TestDtUtilShell hadoop.util.TestDiskCheckerWithDiskIo hadoop.util.TestNativeCodeLoader hadoop.hdfs.qjournal.server.TestJournalNode hadoop.hdfs.qjournal.server.TestJournalNodeSync hadoop.hdfs.server.blockmanagement.TestNameNodePrunesMissingStorages hadoop.hdfs.server.datanode.fsdataset.impl.TestProvidedImpl hadoop.hdfs.server.datanode.TestBlockPoolSliceStorage hadoop.hdfs.server.datanode.TestBlockScanner hadoop.hdfs.server.datanode.TestDataNodeFaultInjector hadoop.hdfs.server.datanode.TestDataNodeUUID hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.hdfs.server.datanode.TestNNHandlesBlockReportPerStorage hadoop.hdfs.server.datanode.TestNNHandlesCombinedBlockReport hadoop.hdfs.server.diskbalancer.TestDiskBalancerRPC hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.ha.TestRetryCacheWithHA hadoop.hdfs.server.namenode.metrics.TestNameNodeMetrics hadoop.hdfs.server.namenode.TestEditLogRace hadoop.hdfs.server.namenode.TestReencryptionWithKMS hadoop.hdfs.server.namenode.TestStartup hadoop.hdfs.TestDatanodeStartupFixesLegacyStorageIDs hadoop.hdfs.TestDFSShell hadoop.hdfs.TestDFSStripedInputStream hadoop.hdfs.TestDFSStripedOutputStreamWithFailureWithRandomECPolicy hadoop.hdfs.TestDFSUpgradeFromImage hadoop.hdfs.TestFetchImage hadoop.hdfs.TestHDFSFileSystemContract hadoop.hdfs.TestPread hadoop.hdfs.TestReconstructStripedFile hadoop.hdfs.TestReconstructStripedFileWithRandomECPolicy hadoop.hdfs.TestSecureEncryptionZoneWithKMS hadoop.hdfs.TestTrashWithSecureEncryptionZones hadoop.hdfs.tools.TestDFSAdmin hadoop.hdfs.web.TestWebHDFS hadoop.hdfs.web.TestWebHdfsUrl hadoop.fs.http.server.TestHttpFSServerWebServer hadoop.yarn.server.nodemanager.containermanager.launcher.TestContainerLaunch hadoop.yarn.server.nodemanager.containermanager.TestAuxServices hadoop.yarn.server.nodemanager.containermanager.TestContainerManager hadoop.yarn.server.nodemanager.TestContainerExecutor hadoop.yarn.server.nodemanager.TestNodeManagerResync hadoop.yarn.server.webproxy.amfilter.TestAmFilter hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.timeline.security.TestTimelineAuthenticationFilterForV1 hadoop.yarn.server.resourcemanager.scheduler.capacity.conf.TestFSSchedulerConfigurationStore hadoop.yarn.server.resourcemanager.scheduler.capacity.conf.TestLeveldbConfigurationStore hadoop.yarn.server.resourcemanager.scheduler.capacity.TestCapacityScheduler hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerResizing hadoop.yarn.server.resourcemanager.scheduler.capacity.TestNodeLabelContainerAllocation hadoop.yarn.server.resourcemanager.scheduler.capacity.TestQueueManagementDynamicEditPolicy hadoop.yarn.server.resourcemanager.scheduler.constraint.TestPlacementProcessor
