[jira] [Created] (HDFS-6209) Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK

2014-04-08 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6209: --- Summary: Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK Key: HDFS-6209 URL: https://issues.apache.org/jira/browse/HDFS-6209

[jira] [Commented] (HDFS-6209) Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK

2014-04-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963674#comment-13963674 ] Arpit Agarwal commented on HDFS-6209: - Exception details: {code}

[jira] [Updated] (HDFS-6209) Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK

2014-04-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6209: Status: Patch Available (was: Open) Fix flaky test

[jira] [Updated] (HDFS-6209) Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK

2014-04-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6209: Attachment: HDFS-6209.01.patch Patch with following fixes: # Randomize port selection, add a retry

[jira] [Commented] (HDFS-6209) Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK

2014-04-08 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13963811#comment-13963811 ] Arpit Agarwal commented on HDFS-6209: - The test failure is unrelated and caused by

[jira] [Updated] (HDFS-6160) TestSafeMode occasionally fails

2014-04-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6160: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Target

[jira] [Commented] (HDFS-6208) DataNode caching can leak file descriptors.

2014-04-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13964539#comment-13964539 ] Arpit Agarwal commented on HDFS-6208: - +1 I verified the fix on Windows and Mac OS X.

[jira] [Commented] (HDFS-6209) Fix flaky test TestValidateConfigurationSettings.testThatDifferentRPCandHttpPortsAreOK

2014-04-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13964546#comment-13964546 ] Arpit Agarwal commented on HDFS-6209: - Thanks for the review and commit Nicholas! Fix

[jira] [Commented] (HDFS-5983) TestSafeMode#testInitializeReplQueuesEarly fails

2014-04-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13964574#comment-13964574 ] Arpit Agarwal commented on HDFS-5983: - Yes this is the same issue and [~mingma]'s

[jira] [Resolved] (HDFS-5983) TestSafeMode#testInitializeReplQueuesEarly fails

2014-04-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5983. - Resolution: Duplicate Resolving since this should be fixed now.

[jira] [Resolved] (HDFS-4489) Use InodeID as as an identifier of a file in HDFS protocols and APIs

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-4489. - Resolution: Fixed Fix Version/s: (was: 2.5.0) 2.1.0-beta

[jira] [Created] (HDFS-6230) Expose upgrade status through NameNode web UI

2014-04-10 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6230: --- Summary: Expose upgrade status through NameNode web UI Key: HDFS-6230 URL: https://issues.apache.org/jira/browse/HDFS-6230 Project: Hadoop HDFS Issue Type:

[jira] [Updated] (HDFS-6230) Expose upgrade status through NameNode web UI

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6230: Description: The NameNode web UI does not show upgrade information anymore. Hadoop 2.0 also does

[jira] [Assigned] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with symlink error.

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal reassigned HDFS-6233: --- Assignee: Arpit Agarwal Datanode upgrade in Windows from 1.x to 2.4 fails with symlink

[jira] [Updated] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with symlink error.

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6233: Component/s: datanode Datanode upgrade in Windows from 1.x to 2.4 fails with symlink error.

[jira] [Updated] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with symlink error.

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6233: Component/s: (was: datanode) tools Datanode upgrade in Windows from 1.x to

[jira] [Updated] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with symlink error.

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6233: Attachment: HDFS-6233.01.patch The 1NUL is passed as a parameter to the winutils command instead of

[jira] [Updated] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with symlink error.

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6233: Status: Patch Available (was: Open) Datanode upgrade in Windows from 1.x to 2.4 fails with

[jira] [Commented] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with symlink error.

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13966258#comment-13966258 ] Arpit Agarwal commented on HDFS-6233: - Initial patch, I will probably add a unit test

[jira] [Commented] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with symlink error.

2014-04-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13966259#comment-13966259 ] Arpit Agarwal commented on HDFS-6233: - Our comments crossed, thanks for the quick

[jira] [Commented] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with hardlink error.

2014-04-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967145#comment-13967145 ] Arpit Agarwal commented on HDFS-6233: - +1 from me, however perhaps it will be

[jira] [Comment Edited] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with hardlink error.

2014-04-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967145#comment-13967145 ] Arpit Agarwal edited comment on HDFS-6233 at 4/11/14 10:05 PM:

[jira] [Commented] (HDFS-6237) TestDFSShell#testGet fails on Windows due to invalid file system path.

2014-04-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967915#comment-13967915 ] Arpit Agarwal commented on HDFS-6237: - +1 for the patch. TestDFSShell#testGet fails

[jira] [Commented] (HDFS-6238) TestDirectoryScanner leaks file descriptors.

2014-04-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13967925#comment-13967925 ] Arpit Agarwal commented on HDFS-6238: - +1 for the patch, thanks for the Windows fixes

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13973379#comment-13973379 ] Arpit Agarwal commented on HDFS-5851: - Hi Eric, Unlike Tachyon we won't deal with data

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13974472#comment-13974472 ] Arpit Agarwal commented on HDFS-5851: - Hi Andrew, bq. There are also plans to move

[jira] [Work started] (HDFS-6245) datanode fails to start with a bad disk even when failed volumes is set

2014-04-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-6245 started by Arpit Agarwal. datanode fails to start with a bad disk even when failed volumes is set

[jira] [Updated] (HDFS-6245) datanode fails to start with a bad disk even when failed volumes is set

2014-04-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6245: Attachment: HDFS-6245.01.patch datanode fails to start with a bad disk even when failed volumes is

[jira] [Updated] (HDFS-6245) datanode fails to start with a bad disk even when failed volumes is set

2014-04-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6245: Status: Patch Available (was: In Progress) datanode fails to start with a bad disk even when

[jira] [Commented] (HDFS-6245) datanode fails to start with a bad disk even when failed volumes is set

2014-04-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13974599#comment-13974599 ] Arpit Agarwal commented on HDFS-6245: - This is effectively a regression since 2.3.

[jira] [Commented] (HDFS-6245) datanode fails to start with a bad disk even when failed volumes is set

2014-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13975324#comment-13975324 ] Arpit Agarwal commented on HDFS-6245: - It is hard to simulate this IOError from

[jira] [Updated] (HDFS-6245) datanode fails to start with a bad disk even when failed volumes is set

2014-04-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6245: Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 Target

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977302#comment-13977302 ] Arpit Agarwal commented on HDFS-5851: - Hi Colin, a call sounds like a good idea and we

[jira] [Created] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-22 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6273: --- Summary: Option to allow wildcard endpoints for namenode HTTP and HTTPS servers Key: HDFS-6273 URL: https://issues.apache.org/jira/browse/HDFS-6273 Project: Hadoop

[jira] [Commented] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13977804#comment-13977804 ] Arpit Agarwal commented on HDFS-6273: - These endpoints do bind the wildcard address by

[jira] [Updated] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Attachment: HDFS-6273.01.patch Patch to add the options as described above. Also added unit tests

[jira] [Updated] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Status: Patch Available (was: Open) Option to allow wildcard endpoints for namenode HTTP and

[jira] [Updated] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Attachment: HDFS-6273.02.patch Thanks for the reviews [~vinayrpet] and [~sureshms]. Updated patch

[jira] [Commented] (HDFS-6275) Fix warnings - type arguments can be inferred and redudant local variable

2014-04-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6275?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13978747#comment-13978747 ] Arpit Agarwal commented on HDFS-6275: - +1 pending Jenkins. Fix warnings - type

[jira] [Updated] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Attachment: HDFS-6273.03.patch Updated patch to remove a useless override from the BackupNode. I

[jira] [Updated] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Attachment: HDFS-6273.04.patch One more try. The fix for BackupNode is to restore

[jira] [Commented] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979424#comment-13979424 ] Arpit Agarwal commented on HDFS-6273: - bq. Seems like this is not useless. Its creating

[jira] [Commented] (HDFS-6273) Option to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13979988#comment-13979988 ] Arpit Agarwal commented on HDFS-6273: - Thanks for the reviews [~vinayrpet] and

[jira] [Updated] (HDFS-6273) Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Summary: Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers (was:

[jira] [Updated] (HDFS-6273) Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Target

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13980276#comment-13980276 ] Arpit Agarwal commented on HDFS-5851: - How about 4/30 (next Wednesday) at 3pm PDT? We

[jira] [Updated] (HDFS-6273) Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Release Note: Two new HDFS configuration keys have been introduced by HDFS-6273. -

[jira] [Updated] (HDFS-6273) Config options to allow wildcard endpoints for namenode HTTP and HTTPS servers

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6273: Release Note: HDFS-6273 introduces two new HDFS configuration keys: - dfs.namenode.http-bind-host

[jira] [Updated] (HDFS-6233) Datanode upgrade in Windows from 1.x to 2.4 fails with hardlink error.

2014-04-24 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6233: Attachment: HDFS-6233.03.patch Updated patch to address most of the feedback from [~szetszwo]. I

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983835#comment-13983835 ] Arpit Agarwal commented on HDFS-5851: - I scheduled a Google+ hangout for 4/30 3-4pm PDT

[jira] [Comment Edited] (HDFS-5851) Support memory as a storage medium

2014-04-29 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13983835#comment-13983835 ] Arpit Agarwal edited comment on HDFS-5851 at 4/29/14 7:59 PM: --

[jira] [Commented] (HDFS-6230) Expose upgrade status through NameNode web UI

2014-04-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13985971#comment-13985971 ] Arpit Agarwal commented on HDFS-6230: - No I haven't started. Feel free to pick it up if

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-04-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986160#comment-13986160 ] Arpit Agarwal commented on HDFS-5851: - The hangout is in progress right now. We are

[jira] [Issue Comment Deleted] (HDFS-5851) Support memory as a storage medium

2014-04-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5851: Comment: was deleted (was: The hangout is in progress right now. We are having some technical

[jira] [Commented] (HDFS-6311) TestLargeBlock#testLargeBlockSize : File /tmp/TestLargeBlock/2147484160.dat could only be replicated to 0 nodes instead of minReplication (=1)

2014-04-30 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6311?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13986239#comment-13986239 ] Arpit Agarwal commented on HDFS-6311: - The test passes for me and also appears to be

[jira] [Updated] (HDFS-6340) DN can't finalize upgarde

2014-05-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6340: Status: Patch Available (was: Open) DN can't finalize upgarde -

[jira] [Commented] (HDFS-6340) DN can't finalize upgarde

2014-05-05 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990055#comment-13990055 ] Arpit Agarwal commented on HDFS-6340: - Yes, good catch [~rahulsinghal.iitd]. The change

[jira] [Commented] (HDFS-6340) DN can't finalize upgarde

2014-05-06 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13990780#comment-13990780 ] Arpit Agarwal commented on HDFS-6340: - Thanks [~kihwal]. [~rahulsinghal.iitd], could

[jira] [Updated] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6362: Attachment: HDFS-6362.03.patch Fix findbugs warning. InvalidateBlocks is inconsistent in usage of

[jira] [Commented] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

2014-05-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13995299#comment-13995299 ] Arpit Agarwal commented on HDFS-5682: - Hi [~wuzesheng], this was deprioritized due to

[jira] [Commented] (HDFS-6340) DN can't finalize upgarde

2014-05-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13992964#comment-13992964 ] Arpit Agarwal commented on HDFS-6340: - It looks like the previous build aborted. I

[jira] [Commented] (HDFS-6340) DN can't finalize upgarde

2014-05-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993122#comment-13993122 ] Arpit Agarwal commented on HDFS-6340: - +1 pending Jenkins results. DN can't finalize

[jira] [Commented] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998201#comment-13998201 ] Arpit Agarwal commented on HDFS-6362: - Thanks Chris, will commit after Jenkins result.

[jira] [Commented] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13993685#comment-13993685 ] Arpit Agarwal commented on HDFS-6362: - bq. Please justify why no new tests are needed

[jira] [Updated] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6362: Attachment: HDFS-6362.04.patch Rebase patch to resolve conflicts with HDFS-6186. InvalidateBlocks

[jira] [Commented] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

2014-05-15 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13998277#comment-13998277 ] Arpit Agarwal commented on HDFS-5682: - bq. Last week I looked into HDFS-2832 and found

[jira] [Created] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-15 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-6362: --- Summary: InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID Key: HDFS-6362 URL: https://issues.apache.org/jira/browse/HDFS-6362 Project: Hadoop

[jira] [Updated] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6362: Attachment: HDFS-6362.01.patch Patch for Jenkins run. InvalidateBlocks is inconsistent in usage

[jira] [Updated] (HDFS-4052) BlockManager#invalidateWork should print logs outside the lock

2014-05-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-4052: Target Version/s: 2.4.1 Fix Version/s: 2.4.1 Merged to branch-2 and branch-2.4 for

[jira] [Commented] (HDFS-6364) Incorrect check for unknown datanode in Balancer

2014-05-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14000136#comment-14000136 ] Arpit Agarwal commented on HDFS-6364: - Nice catch. Is it feasible to add a test case?

[jira] [Commented] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14000322#comment-14000322 ] Arpit Agarwal commented on HDFS-6362: - Thanks for that clarification Chris!

[jira] [Updated] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6362: Resolution: Fixed Fix Version/s: 2.4.1 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-6362) InvalidateBlocks is inconsistent in usage of DatanodeUuid and StorageID

2014-05-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13999261#comment-13999261 ] Arpit Agarwal commented on HDFS-6362: - The FindBugs warning looks invalid since the

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-05-20 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14004031#comment-14004031 ] Arpit Agarwal commented on HDFS-5851: - Minutes from Google Hangout: Wrt to the

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-05-21 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14005285#comment-14005285 ] Arpit Agarwal commented on HDFS-5851: - Hi [~eric14], I apologize for the long delayed

[jira] [Commented] (HDFS-6443) Fix MiniQJMHACluster related tests failure

2014-05-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14006591#comment-14006591 ] Arpit Agarwal commented on HDFS-6443: - Thanks for reporting this and the patch

[jira] [Updated] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

2014-05-22 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5682: Attachment: 20140522-Heterogeneous-Storages-API.pdf Attaching a doc with the proposed API. Thanks

[jira] [Commented] (HDFS-6443) Fix MiniQJMHACluster related tests failure

2014-05-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14007621#comment-14007621 ] Arpit Agarwal commented on HDFS-6443: - Thanks for addressing the feedback [~wuzesheng].

[jira] [Updated] (HDFS-6443) Fix MiniQJMHACluster related test failures

2014-05-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6443: Summary: Fix MiniQJMHACluster related test failures (was: Fix MiniQJMHACluster related tests

[jira] [Updated] (HDFS-6443) Fix MiniQJMHACluster related test failures

2014-05-23 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6443: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0

[jira] [Commented] (HDFS-5682) Heterogeneous Storage phase 2 - APIs to expose Storage Types

2014-05-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5682?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010157#comment-14010157 ] Arpit Agarwal commented on HDFS-5682: - Thanks for the feedback [~wuzesheng]. My

[jira] [Commented] (HDFS-6442) Fix TestEditLogAutoroll failure caused by port conficts

2014-05-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010427#comment-14010427 ] Arpit Agarwal commented on HDFS-6442: - Hi [~wuzesheng], the patch looks good but would

[jira] [Commented] (HDFS-6442) Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts

2014-05-27 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14010609#comment-14010609 ] Arpit Agarwal commented on HDFS-6442: - +1 pending Jenkins. Thanks for incorporating the

[jira] [Updated] (HDFS-6442) Fix TestEditLogAutoroll and TestStandbyCheckpoints failure caused by port conficts

2014-05-28 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6442: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Target

[jira] [Commented] (HDFS-6159) TestBalancerWithNodeGroup.testBalancerWithNodeGroup fails if there is block missing after balancer success

2014-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6159?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025373#comment-14025373 ] Arpit Agarwal commented on HDFS-6159: - Hi [~djp], looks unrelated to HDFS-6362 from a

[jira] [Commented] (HDFS-6482) Use block ID-based block layout on datanodes

2014-06-09 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14025559#comment-14025559 ] Arpit Agarwal commented on HDFS-6482: - {{DFS_DATANODE_NUMBLOCKS_DEFAULT}} is currently

[jira] [Commented] (HDFS-6364) Incorrect check for unknown datanode in Balancer

2014-06-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6364?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14026788#comment-14026788 ] Arpit Agarwal commented on HDFS-6364: - +1 pending Jenkins. Per discussion with Benoy

[jira] [Updated] (HDFS-6364) Incorrect check for unknown datanode in Balancer

2014-06-10 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6364?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6364: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Target

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-06-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028500#comment-14028500 ] Arpit Agarwal commented on HDFS-5851: - [~tlipcon] - I think you mentioned you had

[jira] [Commented] (HDFS-6507) Improve DFSAdmin to support HA cluster better

2014-06-11 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6507?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14028811#comment-14028811 ] Arpit Agarwal commented on HDFS-6507: - bq. In the current implementation, these

[jira] [Commented] (HDFS-5851) Support memory as a storage medium

2014-06-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14029500#comment-14029500 ] Arpit Agarwal commented on HDFS-5851: - Thanks for the pointer, James! Support memory

[jira] [Commented] (HDFS-6521) Improve the readability of 'hadoop fs -help'

2014-06-12 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14029932#comment-14029932 ] Arpit Agarwal commented on HDFS-6521: - bq. I'd give it a +1, but I can't. While a

[jira] [Commented] (HDFS-6530) Fix Balancer documentation

2014-06-13 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14031280#comment-14031280 ] Arpit Agarwal commented on HDFS-6530: - +1 for the patch. Fix Balancer documentation

[jira] [Commented] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-17 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14034042#comment-14034042 ] Arpit Agarwal commented on HDFS-6552: - Thanks for reporting this [~langera]. It looks

[jira] [Commented] (HDFS-6530) Fix Balancer documentation

2014-06-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036103#comment-14036103 ] Arpit Agarwal commented on HDFS-6530: - +1 for the updated patch also. Fix Balancer

[jira] [Commented] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036238#comment-14036238 ] Arpit Agarwal commented on HDFS-6552: - +1 for the patch and thank you for the targeted

[jira] [Updated] (HDFS-6552) add DN storage to a BlockInfo will not replace the different storage from same DN

2014-06-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6552: Resolution: Fixed Fix Version/s: (was: Heterogeneous Storage (HDFS-2832))

[jira] [Commented] (HDFS-6559) Fix wrong option dfsadmin -rollingUpgrade start in the document

2014-06-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036419#comment-14036419 ] Arpit Agarwal commented on HDFS-6559: - +1 I will commit it shortly. Fix wrong option

[jira] [Updated] (HDFS-6559) Fix wrong option dfsadmin -rollingUpgrade start in the document

2014-06-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-6559: Resolution: Fixed Fix Version/s: 2.5.0 3.0.0 Hadoop Flags: Reviewed

[jira] [Commented] (HDFS-6559) Fix wrong option dfsadmin -rollingUpgrade start in the document

2014-06-18 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14036434#comment-14036434 ] Arpit Agarwal commented on HDFS-6559: - My bad, I missed waiting for the Jenkins +1.

<    2   3   4   5   6   7   8   9   10   11   >