Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

We used to get help from Bigtop when it comes to integration testing. Do we think that's possible for 2.8? On Wed, Nov 4, 2015 at 10:08 AM, Steve Loughran wrote: > > > On 2 Nov 2015, at 23:11, Vinod Vavilapalli > wrote: > > > > Yes, I’ve already

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #571

See Changes: [jlowe] Add 2.7.3 release to CHANGES.txt [jlowe] HADOOP-12296. when setnetgrent returns 0 in linux, exception should be -- [...truncated 6885 lines...] Tests run: 8,

Hadoop-Hdfs-trunk-Java8 - Build # 571 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/571/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7078 lines...] [INFO] Executing tasks main:

[jira] [Created] (HDFS-9377) Fix findbugs warnings in FSDirSnapshotOp

Mingliang Liu created HDFS-9377: --- Summary: Fix findbugs warnings in FSDirSnapshotOp Key: HDFS-9377 URL: https://issues.apache.org/jira/browse/HDFS-9377 Project: Hadoop HDFS Issue Type: Task

Build failed in Jenkins: Hadoop-Hdfs-trunk #2509

See Changes: [jlowe] Add 2.7.3 release to CHANGES.txt [jlowe] HADOOP-12296. when setnetgrent returns 0 in linux, exception should be -- [...truncated 8966 lines...] Tests run: 17, Failures:

Hadoop-Hdfs-trunk - Build # 2509 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2509/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9159 lines...] [INFO] [INFO] ---

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

I don't really see the difference between 2.9 with a ton of scary changes (EC is a lot more NN stuff than a usual release) and a 3.0. What's the downside of getting a major version. It relaxes the compat a little bit. It would allow some bake time before it's stable. Put another way. I'm

[jira] [Created] (HDFS-9378) hadoop-hdfs-client tests do not write logs.

Chris Nauroth created HDFS-9378: --- Summary: hadoop-hdfs-client tests do not write logs. Key: HDFS-9378 URL: https://issues.apache.org/jira/browse/HDFS-9378 Project: Hadoop HDFS Issue Type: Bug

Hadoop-Hdfs-trunk-Java8 - Build # 572 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/572/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7055 lines...] [INFO] [INFO] ---

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

Yes we can mostly likely help you. Please come over to dev@bigtop. > On Nov 4, 2015, at 12:40 PM, Andrew Wang wrote: > > We used to get help from Bigtop when it comes to integration testing. Do we > think that's possible for 2.8? > > On Wed, Nov 4, 2015 at 10:08 AM,

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #572

See Changes: [wheat9] HDFS-9357. NN UI renders icons of decommissioned DN incorrectly. [kihwal] fix up CHANGES.txt [wheat9] Revert "HDFS-8855. Webhdfs client leaks active NameNode connections. [lei] HDFS-9007. Fix HDFS

Jenkins build is back to normal : Hadoop-Hdfs-trunk #2510

See

[jira] [Created] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

Uma Maheswara Rao G created HDFS-9381: - Summary: When same block came for replication for Striped mode, we can move that block to PendingReplications Key: HDFS-9381 URL:

[jira] [Created] (HDFS-9380) Builds are failing with protobuf directories as undef

Bob Hansen created HDFS-9380: Summary: Builds are failing with protobuf directories as undef Key: HDFS-9380 URL: https://issues.apache.org/jira/browse/HDFS-9380 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-9382) Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work

Uma Maheswara Rao G created HDFS-9382: - Summary: Track the acks for the packets which are sent from ErasureCodingWorker as part of reconstruction work Key: HDFS-9382 URL:

[jira] [Created] (HDFS-9379) Make NNThroughputBenchmark support more than 10 numThreads

Mingliang Liu created HDFS-9379: --- Summary: Make NNThroughputBenchmark support more than 10 numThreads Key: HDFS-9379 URL: https://issues.apache.org/jira/browse/HDFS-9379 Project: Hadoop HDFS

Hadoop-Hdfs-trunk-Java8 - Build # 570 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/570/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7052 lines...] [INFO] Executing tasks main:

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #570

See Changes: [vvasudev] HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. -- [...truncated 6859 lines...] Java HotSpot(TM) 64-Bit Server VM warning: ignoring option

[jira] [Created] (HDFS-9375) Set balancer bandwidth for specific node

Lin Yiqun created HDFS-9375: --- Summary: Set balancer bandwidth for specific node Key: HDFS-9375 URL: https://issues.apache.org/jira/browse/HDFS-9375 Project: Hadoop HDFS Issue Type: Improvement

Build failed in Jenkins: Hadoop-Hdfs-trunk #2507

See Changes: [zhz] HADOOP-12544. Erasure Coding: create dummy raw coder to isolate -- [...truncated 9355 lines...] [javadoc] [loading

Hadoop-Hdfs-trunk - Build # 2507 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2507/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 9548 lines...] [INFO] Deleting

Hadoop-Hdfs-trunk - Build # 2508 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2508/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6390 lines...] [INFO] Executing tasks main: [mkdir]

Build failed in Jenkins: Hadoop-Hdfs-trunk #2508

See Changes: [vvasudev] HADOOP-10787. Rename/remove non-HADOOP_*, etc from the shell scripts. -- [...truncated 6197 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:

[jira] [Created] (HDFS-9376) TestSeveralNameNodes fails occasionally

Kihwal Lee created HDFS-9376: Summary: TestSeveralNameNodes fails occasionally Key: HDFS-9376 URL: https://issues.apache.org/jira/browse/HDFS-9376 Project: Hadoop HDFS Issue Type: Bug

Build failed in Jenkins: Hadoop-Hdfs-trunk #2506

See Changes: [yzhang] HDFS-9351. checkNNStartup() need to be called when fsck calls -- [...truncated 6186 lines...] Running org.apache.hadoop.hdfs.TestDFSOutputStream Tests run: 3, Failures:

Hadoop-Hdfs-trunk - Build # 2506 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2506/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6379 lines...] [INFO] Executing tasks main: [mkdir]

[jira] [Created] (HDFS-9373) Show friendly information to user when client succeeds the writing with some failed streamers

Li Bo created HDFS-9373: --- Summary: Show friendly information to user when client succeeds the writing with some failed streamers Key: HDFS-9373 URL: https://issues.apache.org/jira/browse/HDFS-9373 Project:

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

To add to the above discussion on umbrella JIRA: the COMMON side changes of EC have been tracked under HADOOP-11264 (before merge) and HADOOP-11842 (after merge). --- Zhe Zhang On Tue, Nov 3, 2015 at 4:40 PM, Vinod Vavilapalli wrote: > That makes sense. > > Thanks for

[jira] [Reopened] (HDFS-8855) Webhdfs client leaks active NameNode connections

[ https://issues.apache.org/jira/browse/HDFS-8855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai reopened HDFS-8855: -- This patch breaks Jenkins around 2 weeks. I reverted this patch in trunk and branch-2 for now to keep

Re: Erasure coding in branch-2 [Was Re: [VOTE] Merge HDFS-7285 (erasure coding) branch to trunk]

> On 2 Nov 2015, at 23:11, Vinod Vavilapalli wrote: > > Yes, I’ve already started looking at 2.8.0, that is exactly how I ended up > with this discussion on the state of EC. > > +Vinod > > > On Nov 2, 2015, at 3:02 PM, Haohui Mai >

[jira] [Created] (HDFS-9374) Inform user when a file with corrupted data blocks are read

Li Bo created HDFS-9374: --- Summary: Inform user when a file with corrupted data blocks are read Key: HDFS-9374 URL: https://issues.apache.org/jira/browse/HDFS-9374 Project: Hadoop HDFS Issue Type:

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #569

See Changes: [zhz] HADOOP-12544. Erasure Coding: create dummy raw coder to isolate -- [...truncated 5859 lines...] Running

Hadoop-Hdfs-trunk-Java8 - Build # 569 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/569/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6052 lines...] [INFO] ---