SystemML Hadoop version support

[Deron Eriksson]

Does SystemML still support Hadoop 1?

I see in MRConfigurationNames a static initialization block for Hadoop
v1/v2 properties. I'd like to remove the current deprecated property
warnings (log messages in the console) that we get with Hadoop v2.4.1 and I
was wondering if I should add the old v1 and new v2 versions to
MRConfigurationNames or if I can just add the new v2 versions and the v1
versions can be removed.

If we still support Hadoop v1, we might want to update the pom with
profiles for Hadoop 1 and 2.

Deron

Re: SystemML Hadoop version support

[Luciano Resende]

On Wed, Jan 20, 2016 at 12:50 PM, Deron Eriksson 
wrote:

> Does SystemML still support Hadoop 1?
>
> I see in MRConfigurationNames a static initialization block for Hadoop
> v1/v2 properties. I'd like to remove the current deprecated property
> warnings (log messages in the console) that we get with Hadoop v2.4.1 and I
> was wondering if I should add the old v1 and new v2 versions to
> MRConfigurationNames or if I can just add the new v2 versions and the v1
> versions can be removed.
>
> If we still support Hadoop v1, we might want to update the pom with
> profiles for Hadoop 1 and 2.
>
> Deron
>

Even Spark is moving away of supporting some old versions of Hadoop, etc...

I would really like us to be moving kind of together with other
dependencies, in the sense of supporting Hadoop 2.6 and up, and Spark 1.6
and maybe 1.5.2 as well.

-- 
Luciano Resende
http://people.apache.org/~lresende
http://twitter.com/lresende1975
http://lresende.blogspot.com/