Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/712/ [Dec 7, 2021 7:42:57 AM] (Szilard Nemeth) YARN-11014. YARN incorrectly validates maximum capacity resources on the validation API. Contributed by Benjamin Teke [Dec 7, 2021 7:51:03 AM] (Szilard Nemeth) YARN-11020. [UI2] No container is found for an application attempt with a single AM container. Contributed by Andras Gyori [Dec 7, 2021 8:49:27 AM] (noreply) HDFS-16351. Add path exception information in FSNamesystem (#3713). Contributed by guophilipse. [Dec 7, 2021 12:39:04 PM] (noreply) HDFS-16354. Add description of GETSNAPSHOTDIFFLISTING to WebHDFS doc. (#3740) -1 overall The following subsystems voted -1: blanks pathlen unit xml The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: XML : Parsing Error(s): hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-excerpt.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-output-missing-tags2.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-nodemanager/src/test/resources/nvidia-smi-sample-output.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/fair-scheduler-invalid.xml hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/test/resources/yarn-site-with-invalid-allocation-file-ref.xml Failed junit tests : hadoop.hdfs.TestHDFSFileSystemContract hadoop.tools.TestDistCpWithRawXAttrs hadoop.tools.TestDistCpWithXAttrs hadoop.tools.contract.TestLocalContractDistCp hadoop.tools.TestDistCpSync hadoop.tools.TestIntegration hadoop.tools.TestExternalCall hadoop.tools.contract.TestHDFSContractDistCp hadoop.tools.TestDistCpViewFs hadoop.tools.TestDistCpWithAcls hadoop.yarn.service.client.TestSystemServiceManagerImpl hadoop.yarn.service.client.TestApiServiceClient hadoop.yarn.service.TestCleanupAfterKill hadoop.yarn.service.TestApiServer hadoop.yarn.csi.client.TestCsiClient hadoop.mapred.nativetask.kvtest.KVTest hadoop.mapred.nativetask.kvtest.LargeKVTest hadoop.mapred.nativetask.compresstest.CompressTest hadoop.mapred.nativetask.combinertest.OldAPICombinerTest hadoop.mapred.nativetask.nonsorttest.NonSortTest hadoop.mapred.nativetask.combinertest.CombinerTest hadoop.mapred.nativetask.combinertest.LargeKVCombinerTest hadoop.streaming.TestStreaming hadoop.streaming.TestStreamingStderr hadoop.streaming.TestStreamAggregate hadoop.streaming.mapreduce.TestStreamXmlRecordReader hadoop.streaming.TestStreamingOutputKeyValueTypes hadoop.streaming.TestStreamXmlMultipleRecords hadoop.streaming.TestMultipleArchiveFiles hadoop.streaming.TestStreamingCounters hadoop.streaming.TestStreamingBackground hadoop.streaming.TestStreamingKeyValue hadoop.streaming.TestStreamReduceNone hadoop.streaming.TestFileArgs hadoop.streaming.TestTypedBytesStreaming hadoop.streaming.TestStreamingCombiner hadoop.streaming.TestGzipInput hadoop.streaming.TestStreamDataProtocol hadoop.streaming.TestRawBytesStreaming hadoop.streaming.TestStreamingExitStatus hadoop.streaming.TestStreamingSeparator hadoop.streaming.TestStreamXmlRecordReader hadoop.streaming.TestSymLink hadoop.streaming.TestUnconsumedInput hadoop.streaming.TestStreamingFailure hadoop.streaming.TestStreamingBadRecords hadoop.streaming.TestMultipleCachefiles hadoop.streaming.TestStreamingOutputOnlyKeys hadoop.tools.dynamometer.workloadgenerator.TestWorkloadGenerator hadoop.tools.dynamometer.TestDynamometerInfra hadoop.tools.dynamometer.blockgenerator.TestBlockGen hadoop.tools.dynamometer.TestDynamometerInfra hadoop.tools.dynamometer.blockgenerator.TestBlockGen hadoop.tools.dynamometer.workloadgenerator.TestWorkloadGenerator hadoop.tools.TestHadoopArchives hadoop.tools.TestHadoopArchiveLogsRunner hadoop.contrib.utils.join.TestDataJoin hadoop.tools.TestDistCh cc: https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/712/artifact/out/results-compile-cc-root.txt [96K] javac:
[jira] [Resolved] (MAPREDUCE-7368) DBOutputFormat.DBRecordWriter#write must throw exception when it fails
[ https://issues.apache.org/jira/browse/MAPREDUCE-7368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena resolved MAPREDUCE-7368. - Fix Version/s: 3.4.0 Resolution: Fixed > DBOutputFormat.DBRecordWriter#write must throw exception when it fails > -- > > Key: MAPREDUCE-7368 > URL: https://issues.apache.org/jira/browse/MAPREDUCE-7368 > Project: Hadoop Map/Reduce > Issue Type: Bug >Affects Versions: 3.3.1 >Reporter: Stamatis Zampetakis >Assignee: Stamatis Zampetakis >Priority: Major > Labels: pull-request-available > Fix For: 3.4.0 > > Time Spent: 1h > Remaining Estimate: 0h > > When the > [DBRecordWriter#write|https://github.com/apache/hadoop/blob/91af256a5b44925e5dfdf333293251a19685ba2a/hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-core/src/main/java/org/apache/hadoop/mapreduce/lib/db/DBOutputFormat.java#L120] > fails with an {{SQLException}} the problem is not propagated but printed in > {{System.err}} instead. > {code:java} > public void write(K key, V value) throws IOException { > try { > key.write(statement); > statement.addBatch(); > } catch (SQLException e) { > e.printStackTrace(); > } > } > {code} > The consumer of this API has no way to tell that the write failed. Moreover, > the exception is not present in the logs which makes the problem very hard > debug and can easily lead to data corruption since clients can easily assume > that everything went well. -- This message was sent by Atlassian Jira (v8.20.1#820001) - To unsubscribe, e-mail: mapreduce-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: mapreduce-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64
For more details, see https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/ No changes -1 overall The following subsystems voted -1: asflicense hadolint mvnsite pathlen unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.fs.TestFileUtil hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain hadoop.hdfs.server.datanode.TestDirectoryScanner hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat hadoop.hdfs.server.federation.router.TestRouterQuota hadoop.hdfs.server.federation.resolver.order.TestLocalResolver hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver hadoop.yarn.server.timelineservice.reader.TestTimelineReaderServer hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker hadoop.yarn.server.resourcemanager.TestClientRMService hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter hadoop.mapreduce.lib.input.TestLineRecordReader hadoop.mapred.TestLineRecordReader hadoop.tools.TestDistCpSystem hadoop.yarn.sls.TestSLSRunner hadoop.resourceestimator.service.TestResourceEstimatorService hadoop.resourceestimator.solver.impl.TestLpSolver cc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/diff-compile-javac-root.txt [500K] checkstyle: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/diff-checkstyle-root.txt [14M] hadolint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/diff-patch-hadolint.txt [4.0K] mvnsite: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-mvnsite-root.txt [1.2M] pathlen: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/pathlen.txt [12K] pylint: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/diff-patch-pylint.txt [48K] shellcheck: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/diff-patch-shellcheck.txt [56K] shelldocs: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/diff-patch-shelldocs.txt [8.0K] whitespace: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/whitespace-eol.txt [12M] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-javadoc-root.txt [32K] unit: https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [232K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [428K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt [12K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt [40K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-common.txt [20K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-timelineservice.txt [12K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [128K] https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/505/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [104K]