Re: Applying transformations on a JavaRDD using reflection

[Robin East]

Have you got some code already that demonstrates the problem?
> On 9 Sep 2015, at 04:45, Nirmal Fernando  wrote:
> 
> Any thoughts?
> 
> On Tue, Sep 8, 2015 at 3:37 PM, Nirmal Fernando  > wrote:
> Hi All,
> 
> I'd like to apply a chain of Spark transformations (map/filter) on a given 
> JavaRDD. I'll have the set of Spark transformations as Function, and 
> even though I can determine the classes of T and A at the runtime, due to the 
> type erasure, I cannot call JavaRDD's transformations as they expect 
> generics. Any idea on how to resolve this?
> 
> -- 
> 
> Thanks & regards,
> Nirmal
> 
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733 
> Blog: http://nirmalfdo.blogspot.com/ 
> 
> 
> 
> 
> 
> -- 
> 
> Thanks & regards,
> Nirmal
> 
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733
> Blog: http://nirmalfdo.blogspot.com/ 
> 
> 

Re: Applying transformations on a JavaRDD using reflection

[Nirmal Fernando]

Any thoughts?

On Tue, Sep 8, 2015 at 3:37 PM, Nirmal Fernando  wrote:

> Hi All,
>
> I'd like to apply a chain of Spark transformations (map/filter) on a given
> JavaRDD. I'll have the set of Spark transformations as Function, and
> even though I can determine the classes of T and A at the runtime, due to
> the type erasure, I cannot call JavaRDD's transformations as they expect
> generics. Any idea on how to resolve this?
>
> --
>
> Thanks & regards,
> Nirmal
>
> Team Lead - WSO2 Machine Learner
> Associate Technical Lead - Data Technologies Team, WSO2 Inc.
> Mobile: +94715779733
> Blog: http://nirmalfdo.blogspot.com/
>
>
>


-- 

Thanks & regards,
Nirmal

Team Lead - WSO2 Machine Learner
Associate Technical Lead - Data Technologies Team, WSO2 Inc.
Mobile: +94715779733
Blog: http://nirmalfdo.blogspot.com/