[jira] [Resolved] (HDFS-10573) DiskBalancer: Add missing package-info
[ https://issues.apache.org/jira/browse/HDFS-10573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-10573. - Resolution: Later This should not be fixed via disk balancer, the checkstyle warning is about an existing directory. > DiskBalancer: Add missing package-info > -- > > Key: HDFS-10573 > URL: https://issues.apache.org/jira/browse/HDFS-10573 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: datanode >Reporter: Anu Engineer >Assignee: Anu Engineer > > Fix checkstyle warning: > > ./hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/server/datanode/DiskBalancerWorkStatus.java:0:: > Missing package-info.java file. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10573) DiskBalancer: Add missing package-info
Anu Engineer created HDFS-10573: --- Summary: DiskBalancer: Add missing package-info Key: HDFS-10573 URL: https://issues.apache.org/jira/browse/HDFS-10573 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Anu Engineer Fix checkstyle warning: ./hadoop-hdfs-project/hadoop-hdfs-client/src/main/java/org/apache/hadoop/hdfs/server/datanode/DiskBalancerWorkStatus.java:0:: Missing package-info.java file. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
Apache Hadoop qbt Report: trunk + YARN-5121 + JDK8 on OS X
For more details, see https://builds.apache.org/job/hadoop-qbt-osx-java8/36/ No changes -1 overall The following subsystems voted -1: unit The following subsystems voted -1 but were configured to be filtered/ignored: cc javac The following subsystems are considered long running: (runtime bigger than 1h 00m 00s) unit Specific tests: Failed CTEST tests : test_test_libhdfs_threaded_hdfs_static test_test_libhdfs_zerocopy_hdfs_static test_test_native_mini_dfs Failed junit tests : hadoop.crypto.TestCryptoCodec hadoop.crypto.TestCryptoStreamsWithOpensslAesCtrCryptoCodec hadoop.fs.TestSymlinkLocalFSFileContext hadoop.fs.TestSymlinkLocalFSFileSystem hadoop.ipc.TestRPCWaitForProxy hadoop.net.unix.TestDomainSocket hadoop.fs.TestEnhancedByteBufferAccess hadoop.hdfs.client.impl.TestBlockReaderFactory hadoop.hdfs.client.impl.TestBlockReaderLocal hadoop.hdfs.client.impl.TestBlockReaderLocalLegacy hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery hadoop.hdfs.server.datanode.fsdataset.impl.TestScrLazyPersistFiles hadoop.hdfs.server.datanode.fsdataset.impl.TestSpaceReservation hadoop.hdfs.server.datanode.TestDataNodeUUID hadoop.hdfs.server.datanode.TestFsDatasetCacheRevocation hadoop.hdfs.server.datanode.TestLargeBlockReport hadoop.hdfs.server.namenode.ha.TestDFSUpgradeWithHA hadoop.hdfs.server.namenode.ha.TestEditLogTailer hadoop.hdfs.server.namenode.TestEditLog hadoop.hdfs.shortcircuit.TestShortCircuitCache hadoop.hdfs.shortcircuit.TestShortCircuitLocalRead hadoop.hdfs.TestDFSInputStream hadoop.hdfs.TestParallelShortCircuitRead hadoop.hdfs.TestParallelShortCircuitReadNoChecksum hadoop.hdfs.TestParallelShortCircuitReadUnCached hadoop.hdfs.TestParallelUnixDomainRead hadoop.hdfs.TestPersistBlocks hadoop.hdfs.TestRead hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer hadoop.tracing.TestTracingShortCircuitLocalRead hadoop.yarn.server.nodemanager.containermanager.queuing.TestQueuingContainerManager hadoop.yarn.server.applicationhistoryservice.TestApplicationHistoryServer hadoop.yarn.server.resourcemanager.TestRMAdminService hadoop.yarn.server.resourcemanager.TestRMRestart hadoop.yarn.client.api.impl.TestYarnClient hadoop.yarn.client.cli.TestLogsCLI hadoop.mapreduce.filecache.TestClientDistributedCacheManager hadoop.mapreduce.v2.TestMRJobs hadoop.mapred.nativetask.compresstest.CompressTest hadoop.mapred.nativetask.kvtest.KVTest hadoop.mapred.nativetask.kvtest.LargeKVTest hadoop.mapred.gridmix.TestGridmixMemoryEmulation hadoop.mapred.gridmix.TestResourceUsageEmulators cc: https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/diff-compile-cc-root.txt [8.0K] javac: https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/diff-compile-javac-root.txt [208K] CTEST: https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-hadoop-hdfs-project_hadoop-hdfs-native-client-ctest.txt [4.0K] unit: https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt [136K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [524K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-native-client.txt [12K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-nodemanager.txt [36K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-applicationhistoryservice.txt [24K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-resourcemanager.txt [52K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt [72K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [96K] https://builds.apache.org/job/hadoop-qbt-osx-java8/36/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt
Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/ [Jun 23, 2016 6:48:18 AM] (aajisaka) HDFS-10561. test_native_mini_dfs fails by NoClassDefFoundError. [Jun 24, 2016 9:39:32 AM] (kai.zheng) HDFS-10460. Recompute block checksum for a particular range less than -1 overall The following subsystems voted -1: unit The following subsystems voted -1 but were configured to be filtered/ignored: cc checkstyle javac javadoc pylint shellcheck shelldocs whitespace The following subsystems are considered long running: (runtime bigger than 1h 0m 0s) unit Specific tests: Failed junit tests : hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer hadoop.yarn.server.TestContainerManagerSecurity hadoop.yarn.server.TestMiniYarnClusterNodeUtilization hadoop.yarn.client.api.impl.TestYarnClient hadoop.yarn.client.cli.TestLogsCLI hadoop.mapred.TestMRCJCFileOutputCommitter cc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-compile-cc-root.txt [4.0K] javac: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-compile-javac-root.txt [172K] checkstyle: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-checkstyle-root.txt [16M] pylint: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-patch-pylint.txt [16K] shellcheck: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-patch-shellcheck.txt [20K] shelldocs: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-patch-shelldocs.txt [16K] whitespace: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/whitespace-eol.txt [12M] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/whitespace-tabs.txt [1.3M] javadoc: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/diff-javadoc-javadoc-root.txt [2.3M] unit: https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt [140K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-server_hadoop-yarn-server-tests.txt [268K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-yarn-project_hadoop-yarn_hadoop-yarn-client.txt [16K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient.txt [92K] https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/73/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-nativetask.txt [124K] Powered by Apache Yetus 0.4.0-SNAPSHOT http://yetus.apache.org - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10572) Fix TestOfflineEditsViewer#testGenerated
Xiaoyu Yao created HDFS-10572:
-
Summary: Fix TestOfflineEditsViewer#testGenerated
Key: HDFS-10572
URL: https://issues.apache.org/jira/browse/HDFS-10572
Project: Hadoop HDFS
Issue Type: Bug
Components: newbie, test
Reporter: Xiaoyu Yao
The test has been failing consistently on trunk recently. This ticket is open
to fix this test to avoid false alarm on Jenkins. Figure out which recent
commit caused this failure can be a good start.
{code}
---
T E S T S
---
Running org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 15.646 sec <<<
FAILURE! - in
org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer
testGenerated(org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer)
Time elapsed: 3.623 sec <<< FAILURE!
java.lang.AssertionError: Generated edits and reparsed (bin to XML to bin)
should be same
at org.junit.Assert.fail(Assert.java:88)
at org.junit.Assert.assertTrue(Assert.java:41)
at
org.apache.hadoop.hdfs.tools.offlineEditsViewer.TestOfflineEditsViewer.testGenerated(TestOfflineEditsViewer.java:125)
Results :
Failed tests:
TestOfflineEditsViewer.testGenerated:125 Generated edits and reparsed (bin to
XML to bin) should be same
Tests run: 5, Failures: 1, Errors: 0, Skipped: 0
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10571) TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException
Xiaobing Zhou created HDFS-10571: Summary: TestDiskBalancerCommand#testPlanNode failed with IllegalArgumentException Key: HDFS-10571 URL: https://issues.apache.org/jira/browse/HDFS-10571 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Xiaobing Zhou Assignee: Xiaobing Zhou -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10570) Netty-all jar should be first in class path while running tests in eclipse
Vinayakumar B created HDFS-10570: Summary: Netty-all jar should be first in class path while running tests in eclipse Key: HDFS-10570 URL: https://issues.apache.org/jira/browse/HDFS-10570 Project: Hadoop HDFS Issue Type: Bug Components: test Reporter: Vinayakumar B Assignee: Vinayakumar B Priority: Minor While debugging tests in eclipse, Cannot access DN http url. Also WebHdfs tests cannot run in eclipse due to classes loading from old version of netty jars instead of netty-all jar. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Resolved] (HDFS-10563) Block reports could be silently dropped by NN
[ https://issues.apache.org/jira/browse/HDFS-10563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Staffan Friberg resolved HDFS-10563. Resolution: Invalid > Block reports could be silently dropped by NN > - > > Key: HDFS-10563 > URL: https://issues.apache.org/jira/browse/HDFS-10563 > Project: Hadoop HDFS > Issue Type: Bug > Components: namenode >Affects Versions: 2.8.0, 2.7.3 >Reporter: Staffan Friberg >Priority: Critical > > Reading through the block reporting code I think I've spotted a case when > block reports can silently be dropped and leave thread waiting indefinitely > on a FutureTask that never will be executed. > The BlockReportProcessingThread.enqueue method doesn't return any status on > if the enqueuing of the task was successful and does not handle the case when > the queue is full and offer return false. > Going back through the call stack to BlockManager.runBlockOp, which > indirectly calls enqueue with a FutureTask and then proceeds to do get() om > the task. > So if the internal queue in the BlockReportingProcessingThread is full, the > BR would never be handled and the thread queuing the task would wait > indefinitely on the FutureTask that will never be executed. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10569) A bug causes OutOfIndex error in BlockListAsLongs
Weiwei Yang created HDFS-10569: -- Summary: A bug causes OutOfIndex error in BlockListAsLongs Key: HDFS-10569 URL: https://issues.apache.org/jira/browse/HDFS-10569 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 2.7.0 Reporter: Weiwei Yang Assignee: Weiwei Yang Priority: Minor -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
[jira] [Created] (HDFS-10568) Reuse ObjectMapper instance in CombinedHostsFileReader and CombinedHostsFileWriter
Yiqun Lin created HDFS-10568:
Summary: Reuse ObjectMapper instance in CombinedHostsFileReader
and CombinedHostsFileWriter
Key: HDFS-10568
URL: https://issues.apache.org/jira/browse/HDFS-10568
Project: Hadoop HDFS
Issue Type: Improvement
Components: hdfs-client
Reporter: Yiqun Lin
Assignee: Yiqun Lin
The {{ObjectMapper}} instance is not reused in class
{{CombinedHostsFileReader}} and {{CombinedHostsFileWriter}}. We can reuse them
to improve performance.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
-
To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org
