Re: RDD firstParent

2015-04-08 Thread Reynold Xin
Why is this a bug? Each RDD implementation should know whether they have a parent or not. For example, if you are a MapPartitionedRDD, there is always a parent since it is a unary operator. On Wed, Apr 8, 2015 at 6:19 AM, Zoltán Zvara wrote: > Is does not seem to be safe to call RDD.firstParen

RDD firstParent

2015-04-08 Thread Zoltán Zvara
Is does not seem to be safe to call RDD.firstParent from anywhere, as it might throw a java.util.NoSuchElementException: "head of empty list". This seems to be a bug for a consumer of the RDD API. Zvara Zoltán mail, hangout, skype: zoltan.zv...@gmail.com mobile, viber: +36203129543 bank: 1091