Re: reduceByKey as Action or Transformation

2016-04-25 Thread Sumedh Wale
On Monday 25 April 2016 11:28 PM, Weiping Qu wrote: Dear Ted, You are right. ReduceByKey is transformation. My fault. I would rephrase my question using following code snippet. object ScalaApp {   def main(args:

Re: reduceByKey as Action or Transformation

2016-04-25 Thread Weiping Qu
to:q...@informatik.uni-kl.de <mailto:q...@informatik.uni-kl.de>] Sent: Monday, April 25, 2016 11:05 AM To: u...@spark.incubator.apache.org <mailto:u...@spark.incubator.apache.org> Subject: reduceByKey as Action or Transformation Hi,

Re: reduceByKey as Action or Transformation

2016-04-25 Thread Ted Yu
--- >> From: Weiping Qu [mailto:q...@informatik.uni-kl.de] >> Sent: Monday, April 25, 2016 11:05 AM >> To: u...@spark.incubator.apache.org >> Subject: reduceByKey as Action or Transformation >> >> Hi, >> >> I'd like just to verify

Re: reduceByKey as Action or Transformation

2016-04-25 Thread Weiping Qu
To: u...@spark.incubator.apache.org Subject: reduceByKey as Action or Transformation Hi, I'd like just to verify that whether reduceByKey is transformation or actions. As written in RDD papers, spark flow will not be triggered only if actions are reached. I tried and saw that the my flow

reduceByKey as Action or Transformation

2016-04-25 Thread Weiping Qu
Hi, I'd like just to verify that whether reduceByKey is transformation or actions. As written in RDD papers, spark flow will not be triggered only if actions are reached. I tried and saw that the my flow will be executed once there is a reduceByKey while it is categorized into transformations