date:20120420


[ 
https://issues.apache.org/jira/browse/HADOOP-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258193#comment-13258193
 ] 

Hudson commented on HADOOP-8288:


Integrated in Hadoop-Hdfs-0.23-Build #233 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/233/])
svn merge -c 1328018 from trunk. FIXES: HADOOP-8288. Remove references of 
mapred.child.ulimit etc. since they are not being used any more (Ravi Prakash 
via bobby) (Revision 1328022)

 Result = SUCCESS
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1328022
Files : 
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/mapred-site.xml
* 
/hadoop/common/branches/branch-0.23/hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
* 
/hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestUlimit.java
* 
/hadoop/common/branches/branch-0.23/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/UlimitApp.java


 Remove references of mapred.child.ulimit etc. since they are not being used 
 any more
 

 Key: HADOOP-8288
 URL: https://issues.apache.org/jira/browse/HADOOP-8288
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 0.23.2
Reporter: Ravi Prakash
Assignee: Ravi Prakash
 Fix For: 0.23.3, 2.0.0, 3.0.0

 Attachments: HADOOP-8288.branch-0.23.patch, 
 HADOOP-8288.branch-0.23.patch


 Courtesy Philip Su, we found that (mapred.child.ulimit, mapreduce.map.ulimit, 
 mapreduce.reduce.ulimit) were not being used at all. The configuration exists 
 but is never used. Its also mentioned in mapred-default.xml and 
 templates/../mapred-site.xml . Also the method getUlimitMemoryCommand in 
 Shell.java is now useless and can be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7350) Use ServiceLoader to discover compression codec classes


[ 
https://issues.apache.org/jira/browse/HADOOP-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258206#comment-13258206
 ] 

Hudson commented on HADOOP-7350:


Integrated in Hadoop-Hdfs-trunk #1020 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1020/])
HADOOP-7350. Use ServiceLoader to discover compression codec classes. 
(Revision 1328083)

 Result = FAILURE
tomwhite : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1328083
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/CompressionCodecFactory.java
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/META-INF/services/org.apache.hadoop.io.compress.CompressionCodec
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodecFactory.java


 Use ServiceLoader to discover compression codec classes
 ---

 Key: HADOOP-7350
 URL: https://issues.apache.org/jira/browse/HADOOP-7350
 Project: Hadoop Common
  Issue Type: Improvement
  Components: conf, io
Reporter: Tom White
Assignee: Tom White
 Fix For: 2.0.0

 Attachments: HADOOP-7350.patch, HADOOP-7350.patch, HADOOP-7350.patch, 
 HADOOP-7350.patch, HADOOP-7350.patch, HADOOP-7350.patch, HADOOP-7350.patch, 
 HADOOP-7350.patch


 By using a ServiceLoader users wouldn't have to add codec classes to 
 io.compression.codecs for codecs that aren't shipped with Hadoop (e.g. LZO), 
 since they would be automatically picked up from the classpath.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8288) Remove references of mapred.child.ulimit etc. since they are not being used any more


[ 
https://issues.apache.org/jira/browse/HADOOP-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258211#comment-13258211
 ] 

Hudson commented on HADOOP-8288:


Integrated in Hadoop-Hdfs-trunk #1020 (See 
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/1020/])
HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are 
not being used any more (Ravi Prakash via bobby) (Revision 1328018)

 Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1328018
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/mapred-site.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
* 
/hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestUlimit.java
* 
/hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/UlimitApp.java


 Remove references of mapred.child.ulimit etc. since they are not being used 
 any more
 

 Key: HADOOP-8288
 URL: https://issues.apache.org/jira/browse/HADOOP-8288
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 0.23.2
Reporter: Ravi Prakash
Assignee: Ravi Prakash
 Fix For: 0.23.3, 2.0.0, 3.0.0

 Attachments: HADOOP-8288.branch-0.23.patch, 
 HADOOP-8288.branch-0.23.patch


 Courtesy Philip Su, we found that (mapred.child.ulimit, mapreduce.map.ulimit, 
 mapreduce.reduce.ulimit) were not being used at all. The configuration exists 
 but is never used. Its also mentioned in mapred-default.xml and 
 templates/../mapred-site.xml . Also the method getUlimitMemoryCommand in 
 Shell.java is now useless and can be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-7350) Use ServiceLoader to discover compression codec classes


[ 
https://issues.apache.org/jira/browse/HADOOP-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258227#comment-13258227
 ] 

Hudson commented on HADOOP-7350:


Integrated in Hadoop-Mapreduce-trunk #1055 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1055/])
HADOOP-7350. Use ServiceLoader to discover compression codec classes. 
(Revision 1328083)

 Result = FAILURE
tomwhite : 
http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1328083
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/io/compress/CompressionCodecFactory.java
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/META-INF/services/org.apache.hadoop.io.compress.CompressionCodec
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/resources/core-default.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/test/java/org/apache/hadoop/io/compress/TestCodecFactory.java


 Use ServiceLoader to discover compression codec classes
 ---

 Key: HADOOP-7350
 URL: https://issues.apache.org/jira/browse/HADOOP-7350
 Project: Hadoop Common
  Issue Type: Improvement
  Components: conf, io
Reporter: Tom White
Assignee: Tom White
 Fix For: 2.0.0

 Attachments: HADOOP-7350.patch, HADOOP-7350.patch, HADOOP-7350.patch, 
 HADOOP-7350.patch, HADOOP-7350.patch, HADOOP-7350.patch, HADOOP-7350.patch, 
 HADOOP-7350.patch


 By using a ServiceLoader users wouldn't have to add codec classes to 
 io.compression.codecs for codecs that aren't shipped with Hadoop (e.g. LZO), 
 since they would be automatically picked up from the classpath.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8288) Remove references of mapred.child.ulimit etc. since they are not being used any more


[ 
https://issues.apache.org/jira/browse/HADOOP-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258232#comment-13258232
 ] 

Hudson commented on HADOOP-8288:


Integrated in Hadoop-Mapreduce-trunk #1055 (See 
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/1055/])
HADOOP-8288. Remove references of mapred.child.ulimit etc. since they are 
not being used any more (Ravi Prakash via bobby) (Revision 1328018)

 Result = FAILURE
bobby : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1328018
Files : 
* /hadoop/common/trunk/hadoop-common-project/hadoop-common/CHANGES.txt
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/main/packages/templates/conf/mapred-site.xml
* 
/hadoop/common/trunk/hadoop-common-project/hadoop-common/src/site/apt/DeprecatedProperties.apt.vm
* 
/hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/TestUlimit.java
* 
/hadoop/common/trunk/hadoop-tools/hadoop-streaming/src/test/java/org/apache/hadoop/streaming/UlimitApp.java


 Remove references of mapred.child.ulimit etc. since they are not being used 
 any more
 

 Key: HADOOP-8288
 URL: https://issues.apache.org/jira/browse/HADOOP-8288
 Project: Hadoop Common
  Issue Type: Bug
Affects Versions: 0.23.2
Reporter: Ravi Prakash
Assignee: Ravi Prakash
 Fix For: 0.23.3, 2.0.0, 3.0.0

 Attachments: HADOOP-8288.branch-0.23.patch, 
 HADOOP-8288.branch-0.23.patch


 Courtesy Philip Su, we found that (mapred.child.ulimit, mapreduce.map.ulimit, 
 mapreduce.reduce.ulimit) were not being used at all. The configuration exists 
 but is never used. Its also mentioned in mapred-default.xml and 
 templates/../mapred-site.xml . Also the method getUlimitMemoryCommand in 
 Shell.java is now useless and can be removed.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8294) IPC Connection becomes unusable even if server address was temporarilly unresolvable

2012-04-20 Thread Kihwal Lee (Commented) (JIRA)


[ 
https://issues.apache.org/jira/browse/HADOOP-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258279#comment-13258279
 ] 

Kihwal Lee commented on HADOOP-8294:


Manually ran test patch

 [exec] -1 overall.  
 [exec] 
 [exec] +1 @author.  The patch does not contain any @author tags.
 [exec] 
 [exec] +1 tests included.  The patch appears to include 3 new or 
modified tests.
 [exec] 
 [exec] +1 javadoc.  The javadoc tool did not generate any warning 
messages.
 [exec] 
 [exec] +1 javac.  The applied patch does not increase the total number 
of javac compiler warnings.
 [exec] 
 [exec] -1 findbugs.  The patch appears to introduce 8 new Findbugs 
(version 1.3.9) warnings.

The number of findbugs warnings actually didn't increase.

 IPC Connection becomes unusable even if server address was temporarilly 
 unresolvable
 

 Key: HADOOP-8294
 URL: https://issues.apache.org/jira/browse/HADOOP-8294
 Project: Hadoop Common
  Issue Type: Bug
  Components: ipc
Affects Versions: 1.0.2
Reporter: Kihwal Lee
Assignee: Kihwal Lee
Priority: Critical
 Fix For: 1.0.3, 1.1.0

 Attachments: hadoop-8294.patch


 This is same as HADOOP-7428, but was observed on 1.x data nodes. This can 
 happen more frequently after HADOOP-7472, which allows IPC Connection to 
 re-resolve the name. HADOOP-7428 needs to be back-ported.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8293) The native library's Makefile.am doesn't include JNI path

2012-04-20 Thread Matt Foley (Commented) (JIRA)


[ 
https://issues.apache.org/jira/browse/HADOOP-8293?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258347#comment-13258347
 ] 

Matt Foley commented on HADOOP-8293:


+1.  Looks right.  Thanks.

 The native library's Makefile.am doesn't include JNI path
 -

 Key: HADOOP-8293
 URL: https://issues.apache.org/jira/browse/HADOOP-8293
 Project: Hadoop Common
  Issue Type: Bug
  Components: build
Reporter: Owen O'Malley
Assignee: Owen O'Malley
 Fix For: 1.0.3, 3.0.0

 Attachments: h-8293.patch


 When compiling on centos 6, I get the following error when compiling the 
 native library:
 {code}
  [exec] /usr/bin/ld: cannot find -ljvm
 {code}
 The problem is simply that the Makefile.am libhadoop_la_LDFLAGS doesn't 
 include AM_LDFLAGS.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader

2012-04-20 Thread Sanjay Radia (Updated) (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sanjay Radia updated HADOOP-8285:
-

Attachment: hadoop-8285-3-common.patch

 Use ProtoBuf for RpcPayLoadHeader
 -

 Key: HADOOP-8285
 URL: https://issues.apache.org/jira/browse/HADOOP-8285
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Sanjay Radia
Assignee: Sanjay Radia
 Attachments: hadoop-8285-1-common.patch, hadoop-8285-1.patch, 
 hadoop-8285-2-common.patch, hadoop-8285-2.patch, hadoop-8285-3-common.patch, 
 hadoop-8285-3.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader

2012-04-20 Thread Sanjay Radia (Updated) (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sanjay Radia updated HADOOP-8285:
-

Target Version/s: 2.0.0, 3.0.0  (was: 3.0.0, 2.0.0)
  Status: Open  (was: Patch Available)

 Use ProtoBuf for RpcPayLoadHeader
 -

 Key: HADOOP-8285
 URL: https://issues.apache.org/jira/browse/HADOOP-8285
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Sanjay Radia
Assignee: Sanjay Radia
 Attachments: hadoop-8285-1-common.patch, hadoop-8285-1.patch, 
 hadoop-8285-2-common.patch, hadoop-8285-2.patch, hadoop-8285-3-common.patch, 
 hadoop-8285-3.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader

2012-04-20 Thread Sanjay Radia (Updated) (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sanjay Radia updated HADOOP-8285:
-

Attachment: hadoop-8285-3.patch

 Use ProtoBuf for RpcPayLoadHeader
 -

 Key: HADOOP-8285
 URL: https://issues.apache.org/jira/browse/HADOOP-8285
 Project: Hadoop Common
  Issue Type: Improvement
Reporter: Sanjay Radia
Assignee: Sanjay Radia
 Attachments: hadoop-8285-1-common.patch, hadoop-8285-1.patch, 
 hadoop-8285-2-common.patch, hadoop-8285-2.patch, hadoop-8285-3-common.patch, 
 hadoop-8285-3.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader

2012-04-20 Thread Hadoop QA (Commented) (JIRA)

[
https://issues.apache.org/jira/browse/HADOOP-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258398#comment-13258398
]

Hadoop QA commented on HADOOP-8285:
---

-1 overall. Here are the results of testing the latest attachment

http://issues.apache.org/jira/secure/attachment/12523523/hadoop-8285-3-common.patch
against trunk revision .

+1 @author. The patch does not contain any @author tags.

+1 tests included. The patch appears to include 5 new or modified test
files.

+1 javadoc. The javadoc tool did not generate any warning messages.

+1 javac. The applied patch does not increase the total number of javac
compiler warnings.

+1 eclipse:eclipse. The patch built with eclipse:eclipse.

-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9)
warnings.

+1 release audit. The applied patch does not increase the total number of
release audit warnings.

+1 core tests. The patch passed unit tests in .

+1 contrib tests. The patch passed contrib unit tests.

Test results:
https://builds.apache.org/job/PreCommit-HADOOP-Build/874//testReport/
Findbugs warnings:
https://builds.apache.org/job/PreCommit-HADOOP-Build/874//artifact/trunk/hadoop-common-project/patchprocess/newPatchFindbugsWarningshadoop-common.html
Console output:
https://builds.apache.org/job/PreCommit-HADOOP-Build/874//console

This message is automatically generated.

Use ProtoBuf for RpcPayLoadHeader
-

Key: HADOOP-8285
URL: https://issues.apache.org/jira/browse/HADOOP-8285
Project: Hadoop Common
Issue Type: Improvement
Reporter: Sanjay Radia
Assignee: Sanjay Radia
Attachments: hadoop-8285-1-common.patch, hadoop-8285-1.patch,
hadoop-8285-2-common.patch, hadoop-8285-2.patch, hadoop-8285-3-common.patch,
hadoop-8285-3.patch

[jira] [Updated] (HADOOP-7426) User Guide for how to use viewfs with federation


 [ 
https://issues.apache.org/jira/browse/HADOOP-7426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Eli Collins updated HADOOP-7426:


  Component/s: documentation
 Target Version/s: 2.0.0
Affects Version/s: 2.0.0

Would be great to get this in before 2.0

 User Guide for how to use viewfs with federation
 

 Key: HADOOP-7426
 URL: https://issues.apache.org/jira/browse/HADOOP-7426
 Project: Hadoop Common
  Issue Type: Improvement
  Components: documentation
Affects Versions: 2.0.0
Reporter: Sanjay Radia
Assignee: Sanjay Radia
Priority: Minor
 Attachments: Viewfs Guide.pdf, c7426_20111214.patch, 
 c7426_20111215.patch, c7426_20111215b.patch, c7426_20111218.patch, 
 c7426_20111220.patch, c7426_20111220_site.tar.gz, viewfs_TypicalMountTable.png




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8298) ViewFs merge mounts

Eli Collins created HADOOP-8298:
---

 Summary: ViewFs merge mounts 
 Key: HADOOP-8298
 URL: https://issues.apache.org/jira/browse/HADOOP-8298
 Project: Hadoop Common
  Issue Type: New Feature
  Components: fs
Affects Versions: 2.0.0
Reporter: Eli Collins


A merge mount is a single mount represented by the union of two namespaces. See 
the viewfs docs (HADOOP-7426) and [ViewFs 
javadoc|http://hadoop.apache.org/common/docs/r0.23.0/api/org/apache/hadoop/fs/viewfs/ViewFs.html]
 for details.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Created] (HADOOP-8299) ViewFs doesn't work with a slash mount point

Eli Collins created HADOOP-8299:
---

 Summary: ViewFs doesn't work with a slash mount point
 Key: HADOOP-8299
 URL: https://issues.apache.org/jira/browse/HADOOP-8299
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 2.0.0
Reporter: Eli Collins


We currently assume [a typical viewfs client 
configuration|https://issues.apache.org/jira/secure/attachment/12507504/viewfs_TypicalMountTable.png]
 is a set of non-overlapping mounts. This means every time you want to add a 
new top-level directory you need to update the client-side mountable config. If 
users could specify a slash mount, and then add additional mounts as necessary 
they could add a new top-level directory without updating all client configs 
(as long as the new top-level directory was being created on the NN the slash 
mount points to). This could be achieved by HADOOP-8298 (merge mounts, since 
we're effectively merging all new mount points with slash) or having the notion 
of a default NN for a mount table.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (HADOOP-8299) ViewFs doesn't work with a slash mount point


[ 
https://issues.apache.org/jira/browse/HADOOP-8299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13258597#comment-13258597
 ] 

Eli Collins commented on HADOOP-8299:
-

Here's the exception you get btw if you try to create a slash mount entry. We 
should make this a more friendly error message in the mean time.

{noformat}
java.lang.ArrayIndexOutOfBoundsException: 1
at org.apache.hadoop.fs.viewfs.InodeTree.createLink(InodeTree.java:237)
at org.apache.hadoop.fs.viewfs.InodeTree.init(InodeTree.java:334)
at org.apache.hadoop.fs.viewfs.ViewFileSystem$1.init(ViewFileSystem.java:165)
at 
org.apache.hadoop.fs.viewfs.ViewFileSystem.initialize(ViewFileSystem.java:165)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:2041)
at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:78)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:2075)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2057)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:284)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:151)
{noformat}

 ViewFs doesn't work with a slash mount point
 

 Key: HADOOP-8299
 URL: https://issues.apache.org/jira/browse/HADOOP-8299
 Project: Hadoop Common
  Issue Type: Bug
  Components: fs
Affects Versions: 2.0.0
Reporter: Eli Collins

 We currently assume [a typical viewfs client 
 configuration|https://issues.apache.org/jira/secure/attachment/12507504/viewfs_TypicalMountTable.png]
  is a set of non-overlapping mounts. This means every time you want to add a 
 new top-level directory you need to update the client-side mountable config. 
 If users could specify a slash mount, and then add additional mounts as 
 necessary they could add a new top-level directory without updating all 
 client configs (as long as the new top-level directory was being created on 
 the NN the slash mount points to). This could be achieved by HADOOP-8298 
 (merge mounts, since we're effectively merging all new mount points with 
 slash) or having the notion of a default NN for a mount table.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader

2012-04-20 Thread Tsz Wo (Nicholas), SZE (JIRA)


 [ 
https://issues.apache.org/jira/browse/HADOOP-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tsz Wo (Nicholas), SZE updated HADOOP-8285:
---

 Component/s: ipc
Target Version/s: 2.0.0, 3.0.0  (was: 3.0.0, 2.0.0)
Hadoop Flags: Reviewed

{code}
+  Class name=~org\.apache\.hadoop\.ha\.proto\.RpcPayloadHeaderProtos.*/
{code}
The package should be hadoop.ipc.protobuf.

+1 once the above has been fixed.

 Use ProtoBuf for RpcPayLoadHeader
 -

 Key: HADOOP-8285
 URL: https://issues.apache.org/jira/browse/HADOOP-8285
 Project: Hadoop Common
  Issue Type: Improvement
  Components: ipc
Reporter: Sanjay Radia
Assignee: Sanjay Radia
 Attachments: hadoop-8285-1-common.patch, hadoop-8285-1.patch, 
 hadoop-8285-2-common.patch, hadoop-8285-2.patch, hadoop-8285-3-common.patch, 
 hadoop-8285-3.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader


 [ 
https://issues.apache.org/jira/browse/HADOOP-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sanjay Radia updated HADOOP-8285:
-

Attachment: hadoop-8285-4.patch

 Use ProtoBuf for RpcPayLoadHeader
 -

 Key: HADOOP-8285
 URL: https://issues.apache.org/jira/browse/HADOOP-8285
 Project: Hadoop Common
  Issue Type: Improvement
  Components: ipc
Reporter: Sanjay Radia
Assignee: Sanjay Radia
 Attachments: hadoop-8285-1-common.patch, hadoop-8285-1.patch, 
 hadoop-8285-2-common.patch, hadoop-8285-2.patch, hadoop-8285-3-common.patch, 
 hadoop-8285-3.patch, hadoop-8285-4-common.patch, hadoop-8285-4.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader


 [ 
https://issues.apache.org/jira/browse/HADOOP-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sanjay Radia updated HADOOP-8285:
-

Target Version/s: 2.0.0, 3.0.0  (was: 3.0.0, 2.0.0)
  Status: Patch Available  (was: Open)

 Use ProtoBuf for RpcPayLoadHeader
 -

 Key: HADOOP-8285
 URL: https://issues.apache.org/jira/browse/HADOOP-8285
 Project: Hadoop Common
  Issue Type: Improvement
  Components: ipc
Reporter: Sanjay Radia
Assignee: Sanjay Radia
 Attachments: hadoop-8285-1-common.patch, hadoop-8285-1.patch, 
 hadoop-8285-2-common.patch, hadoop-8285-2.patch, hadoop-8285-3-common.patch, 
 hadoop-8285-3.patch, hadoop-8285-4-common.patch, hadoop-8285-4.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader


 [ 
https://issues.apache.org/jira/browse/HADOOP-8285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sanjay Radia updated HADOOP-8285:
-

Target Version/s: 2.0.0, 3.0.0  (was: 3.0.0, 2.0.0)
  Status: Open  (was: Patch Available)

 Use ProtoBuf for RpcPayLoadHeader
 -

 Key: HADOOP-8285
 URL: https://issues.apache.org/jira/browse/HADOOP-8285
 Project: Hadoop Common
  Issue Type: Improvement
  Components: ipc
Reporter: Sanjay Radia
Assignee: Sanjay Radia
 Attachments: hadoop-8285-1-common.patch, hadoop-8285-1.patch, 
 hadoop-8285-2-common.patch, hadoop-8285-2.patch, hadoop-8285-3-common.patch, 
 hadoop-8285-3.patch, hadoop-8285-4-common.patch, hadoop-8285-4.patch




--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (HADOOP-8285) Use ProtoBuf for RpcPayLoadHeader