Re: Putting the hdfs client as a separate jar

2014-04-03 Thread Steve Loughran
It's not an issue with hdfs/hadoop JARs itself, but the POMs -and the same problem exists with the hadoop core JAR - too much stuff you don't need client side. We can address this -without changing the packaging into an hdfs-client.jar (and so complicating everything related to HDFS code). All

Re: Putting the hdfs client as a separate jar

2014-04-03 Thread Steve Loughran
On 3 April 2014 00:02, Haohui Mai h...@hortonworks.com wrote: The rpc and the web client can stay in one jar for the first cut. Indeed it might introduce some extra dependency, but the downstream projects always have the option to implement the webhdfs protocol themselves if they really need

Re: Putting the hdfs client as a separate jar

2014-04-03 Thread Steve Loughran
to follow up with an example, JIRA on updating dependencies and tuning the POMs https://issues.apache.org/jira/browse/HADOOP-9991 here's a JIRA on dropping ZK from the hadoop-client POM https://issues.apache.org/jira/browse/HADOOP-9905 ​ And there's an mr-client POM where we've been slowly

[jira] [Created] (HDFS-6189) Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon.

2014-04-03 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-6189: --- Summary: Multiple HDFS tests fail on Windows attempting to use a test root path containing a colon. Key: HDFS-6189 URL: https://issues.apache.org/jira/browse/HDFS-6189

[jira] [Created] (HDFS-6190) minor textual fixes in DFSClient

2014-04-03 Thread Charles Lamb (JIRA)
Charles Lamb created HDFS-6190: -- Summary: minor textual fixes in DFSClient Key: HDFS-6190 URL: https://issues.apache.org/jira/browse/HDFS-6190 Project: Hadoop HDFS Issue Type: Improvement

Re: Putting the hdfs client as a separate jar

2014-04-03 Thread Alejandro Abdelnur
Haouhi's suggestion of a hdfs-client JAR with client dependencies only, would be IMO the 'correct' way of doing things, we should have a hdfs-server and hdfs-client JARs. Doing this is practice is not trivial as classes are not properly segregated. So, Steven's suggestion of an hdfs-client seems

[jira] [Created] (HDFS-6191) Disable quota checks when replaying edit log.

2014-04-03 Thread Kihwal Lee (JIRA)
Kihwal Lee created HDFS-6191: Summary: Disable quota checks when replaying edit log. Key: HDFS-6191 URL: https://issues.apache.org/jira/browse/HDFS-6191 Project: Hadoop HDFS Issue Type:

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Azuryy
Did you tested RM failover on Hive? There is bug. Sent from my iPhone5s On 2014年4月4日, at 2:12, Xuan Gong xg...@hortonworks.com wrote: +1 non-binding Built from source code, tested on a single node cluster. Successfully ran a few MR sample jobs. Tested RM failover while job is running.

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Haohui Mai
HDFS-6180 seems to be a blocker of 2.4. I'll post a patch later today. ~Haohui On Thu, Apr 3, 2014 at 3:47 PM, Azuryy azury...@gmail.com wrote: Did you tested RM failover on Hive? There is bug. Sent from my iPhone5s On 2014年4月4日, at 2:12, Xuan Gong xg...@hortonworks.com wrote: +1

[jira] [Created] (HDFS-6192) WebHdfs call for setting quotas

2014-04-03 Thread Romain Rigaux (JIRA)
Romain Rigaux created HDFS-6192: --- Summary: WebHdfs call for setting quotas Key: HDFS-6192 URL: https://issues.apache.org/jira/browse/HDFS-6192 Project: Hadoop HDFS Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Tsuyoshi OZAWA
Azurry, can you file the RM-failover related bug as a JIRA? I'm going to reproduce it in my local. Thanks, - Tsuyoshi On Fri, Apr 4, 2014 at 7:47 AM, Azuryy azury...@gmail.com wrote: Did you tested RM failover on Hive? There is bug. Sent from my iPhone5s On 2014年4月4日, at 2:12, Xuan Gong

Re: [VOTE] Release Apache Hadoop 2.4.0

2014-04-03 Thread Tsuyoshi OZAWA
Hi, Ran tests and confirmed that some tests(TestSymlinkLocalFSFileSystem) fail. The log of the test failure is as follows: https://gist.github.com/oza/9965197 Should we fix or disable the feature? Thanks, - Tsuyoshi On Mon, Mar 31, 2014 at 6:22 PM, Arun C Murthy a...@hortonworks.com wrote: