Bigtop
> > > > build,
> > > > > > > >> shuffling
> > > > > > > >> >>>> jars
> > > > > > > >> >>>>>> from here and there. And that's quite crazy, honestly
> > ;)
> > > > &
; > > >> >> Hadoop
> > > > > > >> >>>>>> Accelerator and Fabric builds (correct me if I miss
> > > > something):
> > > > > > >> >>>>>>
> > > &
;> >>>>>> - Additional scripts, configs and instructions included
> in
> > > > Hadoop
> > > > > >> >>>>>> Accelerator.
> > > > > >> >>>>>>
> > > > > >> >>>>>> And the list of in
rk are mandatory. Even if
> we
> > > need
> > > > >> them
> > > > >> >>>>>> for Hadoop Acceleration (which I doubt), are they really
> > > required
> > > > >> or
> > > > >> >>>> can
>
o use Hadoop
> > > Accelerator
> > > >> >>>> with
> > > >> >>>>>> S3 discovery?
> > > >> >>>>>> - Etc.
> > > >> >>>>>>
> > > >> >
t;>>>>> couple of scripts and config files. If so, there is no reason
> to
> > >> have
> > >> >>>> two
> > >> >>>>>> builds.
> > >> >>>>>>
> > >> >>>>>> -Val
> > >> >
>>>> On the separate note, in the Bigtop, we start looking into
> changing
> >> >> the
> >> >>>>>>
> >> >>>>>> way we
> >> >>>>>>
> >> >>>>>> deliver Ignite and we'll likely to s
as a part of the standard
> >>>>>> fabric binary putting hadoop-accelerator libs under ‘optional’
> folder?
> >>>>>>
> >>>>>> —
> >>>>>> Denis
> >>>>>>
> >>>>>> On Nov 21,
the performance of more than just MR compute of the Hadoop
>> stack,
>>>>>>
>>>>>> IIRC.
>>>>>>
>>>>>> For what it worth, Spark is considered a part of Hadoop at large.
>>>>>>
>>>>&g
gt; >>>> way we
> >>>>
> >>>> deliver Ignite and we'll likely to start offering the whole 'data
> >> fabric'
> >>>> experience instead of the mere "hadoop-acceleration".
> >>>>
> >>>> Cos
> >&
the map-reduce accelerator but
>>>>
>>>> Ignite
>>>>
>>>> Hadoop File System component as well. The latter can be used in
>>>>
>>>> deployments
>>>>
>>>> like HDFS+IGFS+Ignite Spark + Spark.
>>>&
>> 2.10
> >>
> >> and 2.11 ignite-spark modules under ‘optional’ folder of Ignite Hadoop
> >> Accelerator distribution.
> >> https://issues.apache.org/jira/browse/IGNITE-4254 <
> >>
> >> https://issues.apache.org/jira/browse/IGNITE-4254&g
>
>>
>>
>> BTW, this task may be affected or related to the following ones:
>> https://issues.apache.org/jira/browse/IGNITE-3596 <
>>
>> https://issues.apache.org/jira/browse/IGNITE-3596>
>>
>> https://issues.apache.org/jira/browse/IGNITE-38
enko <
>
> valentin.kuliche...@gmail.com> wrote:
>
>
> Hadoop Accelerator is a plugin to Ignite and this plugin is used by
>
> Hadoop
>
> when running its jobs. ignite-spark module only provides IgniteRDD
>
> which
>
> Hadoop obviously will never use.
>
&g
>> https://issues.apache.org/jira/browse/IGNITE-3822
>>>>>
>>>>> —
>>>>> Denis
>>>>>
>>>>>> On Nov 19, 2016, at 1:26 PM, Valentin Kulichenko <
>>> valentin.kuliche...@gmail.com> wrote:
>>>>>>
rator is a plugin to Ignite and this plugin is used by
> > Hadoop
> > >>> when running its jobs. ignite-spark module only provides IgniteRDD
> > which
> > >>> Hadoop obviously will never use.
> > >>>
> > >>> Is there another use
se for Hadoop Accelerator which I'm missing?
> >>>
> >>> -Val
> >>>
> >>> On Sat, Nov 19, 2016 at 3:12 AM, Dmitriy Setrakyan <
> dsetrak...@apache.org>
> >>> wrote:
> >>>
> >>>> Why do you think tha
at, Nov 19, 2016 at 3:12 AM, Dmitriy Setrakyan <dsetrak...@apache.org>
> > wrote:
> >
> >> Why do you think that spark module is not needed in our hadoop build?
> >>
> >> On Fri, Nov 18, 2016 at 5:44 PM, Valentin Kulichenko <
> >> valentin.kuliche...
..@apache.org>
> wrote:
>
>> Why do you think that spark module is not needed in our hadoop build?
>>
>> On Fri, Nov 18, 2016 at 5:44 PM, Valentin Kulichenko <
>> valentin.kuliche...@gmail.com> wrote:
>>
>>> Folks,
>>>
>>> Is
d in our hadoop build?
>
> On Fri, Nov 18, 2016 at 5:44 PM, Valentin Kulichenko <
> valentin.kuliche...@gmail.com> wrote:
>
> > Folks,
> >
> > Is there anyone who understands the purpose of including ignite-spark
> > module in the Hadoop Accelera
Fri, Nov 18, 2016 at 5:44 PM, Valentin Kulichenko <
>> valentin.kuliche...@gmail.com> wrote:
>>
>>> Folks,
>>>
>>> Is there anyone who understands the purpose of including ignite-spark
>>> module in the Hadoop Accelerator build? I can't figure out
o understands the purpose of including ignite-spark
> > module in the Hadoop Accelerator build? I can't figure out a use case for
> > which it's needed.
> >
> > In case we actually need it there, there is an issue then. We actually
> have
> > two ignite-spark mod
Why do you think that spark module is not needed in our hadoop build?
On Fri, Nov 18, 2016 at 5:44 PM, Valentin Kulichenko <
valentin.kuliche...@gmail.com> wrote:
> Folks,
>
> Is there anyone who understands the purpose of including ignite-spark
> module in the Hadoop Accelera
Folks,
Is there anyone who understands the purpose of including ignite-spark
module in the Hadoop Accelerator build? I can't figure out a use case for
which it's needed.
In case we actually need it there, there is an issue then. We actually have
two ignite-spark modules, for 2.10 and 2.11
24 matches
Mail list logo
