[jira] [Created] (HADOOP-9493) Replace popen2 module with subprocess in HOD to eliminate deprecation warning

2013-04-23 Thread Jonathan Barber (JIRA)
Jonathan Barber created HADOOP-9493: --- Summary: Replace popen2 module with subprocess in HOD to eliminate deprecation warning Key: HADOOP-9493 URL: https://issues.apache.org/jira/browse/HADOOP-9493

[jira] [Created] (HADOOP-9494) Excluded auto-generated and examples code from clover reports

2013-04-23 Thread Dennis Y (JIRA)
Dennis Y created HADOOP-9494: Summary: Excluded auto-generated and examples code from clover reports Key: HADOOP-9494 URL: https://issues.apache.org/jira/browse/HADOOP-9494 Project: Hadoop Common

Re: Compatibility in Apache Hadoop

2013-04-23 Thread Steve Loughran
On 22 April 2013 18:32, Eli Collins e...@cloudera.com wrote: On Mon, Apr 22, 2013 at 5:42 PM, Steve Loughran ste...@hortonworks.com wrote: There's a separate issue that says we make some guarantee that the behaviour of a interface remains consistent over versions, which is hard to do

Re: Hadoop Scheduling Algorithm

2013-04-23 Thread Steve Loughran
On 23 April 2013 09:13, Chris Smith csmi...@gmail.com wrote: And there is another scheduler, Dynamic Priority Scheduling, lurking in the backwater of 0.21.0 that allows users to 'bid' for additional time. Getting this back into current 1.x may be a great way to understand about scheduling:

[jira] [Created] (HADOOP-9495) Define behaviour of Seekable.seek(), write tests, fix all hadoop implementations for compliance

2013-04-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-9495: -- Summary: Define behaviour of Seekable.seek(), write tests, fix all hadoop implementations for compliance Key: HADOOP-9495 URL:

Re: [VOTE] Release Apache Hadoop 2.0.4-alpha

2013-04-23 Thread Arun C Murthy
With 15 +1s (8 binding), 1 -0 and no -1s the vote passes. Thanks to all who verified the bits, I'll push them out. thanks, Arun On Apr 12, 2013, at 2:56 PM, Arun C Murthy wrote: Folks, I've created a release candidate (RC2) for hadoop-2.0.4-alpha that I would like to release. The RC

CfP 2013 Workshop on Middleware for HPC and Big Data Systems (MHPC'13)

2013-04-23 Thread MHPC 2013
we apologize if you receive multiple copies of this message === CALL FOR PAPERS 2013 Workshop on Middleware for HPC and Big Data Systems MHPC '13 as part of Euro-Par 2013, Aachen, Germany

[jira] [Resolved] (HADOOP-9492) Fix the typo in testConf.xml to make it consistent with FileUtil#copy()

2013-04-23 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HADOOP-9492. Resolution: Fixed Fix Version/s: 1.2.0 Hadoop Flags: Reviewed

Re: Compatibility in Apache Hadoop

2013-04-23 Thread Steve Loughran
On 23 April 2013 09:00, Steve Loughran ste...@hortonworks.com wrote: On 22 April 2013 18:32, Eli Collins e...@cloudera.com wrote: However if a change made FileSystem#close three times slower, this perhaps a smaller semantic change (eg doesn't change what exceptions get thrown) but

Re: Compatibility in Apache Hadoop

2013-04-23 Thread Andrew Purtell
At the risk of hijacking this conversation a bit, what do you think of the notion of moving interfaces like Seekable and PositionedReadable into a new foundational Maven module, perhaps just for such interfaces that define and tag support for core semantics, as their details are better defined and

Re: Compatibility in Apache Hadoop

2013-04-23 Thread Steve Loughran
On 23 April 2013 11:32, Andrew Purtell apurt...@apache.org wrote: At the risk of hijacking this conversation a bit, what do you think of the notion of moving interfaces like Seekable and PositionedReadable into a new foundational Maven module, perhaps just for such interfaces that define and

Re: Compatibility in Apache Hadoop

2013-04-23 Thread Alejandro Abdelnur
Andrew, Or with a twist, why not break/consolidate things as follows? common API common IMPL hdfs CLIENT IMPL hdfs SERVER IMPL hdfs TOOLS other filesystems CLIENT yarn API yarn CLIENT IMPL yarn SERVER IMPL yarn TOOLS mapred API mapred IMPL mapred TOOLS IMO, this would help significantly to

Re: Compatibility in Apache Hadoop

2013-04-23 Thread Karthik Kambatla
On Tue, Apr 23, 2013 at 9:00 AM, Steve Loughran ste...@hortonworks.comwrote: On 22 April 2013 18:32, Eli Collins e...@cloudera.com wrote: On Mon, Apr 22, 2013 at 5:42 PM, Steve Loughran ste...@hortonworks.com wrote: There's a separate issue that says we make some guarantee that the

[jira] [Created] (HADOOP-9496) Bad merge of HADOOP-9450 on branch-2 breaks all bin/hadoop calls that need HADOOP_CLASSPATH

2013-04-23 Thread Gopal V (JIRA)
Gopal V created HADOOP-9496: --- Summary: Bad merge of HADOOP-9450 on branch-2 breaks all bin/hadoop calls that need HADOOP_CLASSPATH Key: HADOOP-9496 URL: https://issues.apache.org/jira/browse/HADOOP-9496

[jira] [Created] (HADOOP-9497) FileSystem.createFileSystem to convert class instantiation problems to meaningful IOEs

2013-04-23 Thread Steve Loughran (JIRA)
Steve Loughran created HADOOP-9497: -- Summary: FileSystem.createFileSystem to convert class instantiation problems to meaningful IOEs Key: HADOOP-9497 URL: https://issues.apache.org/jira/browse/HADOOP-9497

[DISCUSS] Getting to Hadoop 2.X beta

2013-04-23 Thread Roman Shaposhnik
Hi! Now that Hadoop 2.0.4-alpha is released I'd like to open up a discussion on what practical steps would it take for us as a community to get Hadoop 2.X from alpha to beta? There's quite a few preconditions to be met for a piece of software to reach beta status. Quite a few of them are now

[jira] [Resolved] (HADOOP-9496) Bad merge of HADOOP-9450 on branch-2 breaks all bin/hadoop calls that need HADOOP_CLASSPATH

2013-04-23 Thread Harsh J (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsh J resolved HADOOP-9496. - Resolution: Fixed Fix Version/s: 2.0.5-beta Committed revision 1471230 to fix this properly.

[jira] [Resolved] (HADOOP-9484) Genetic Algorithm Library for Hadoop

2013-04-23 Thread Aaron T. Myers (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-9484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aaron T. Myers resolved HADOOP-9484. Resolution: Invalid Hi Vaibhav, While this is potentially very valuable work, this