Re: Spark: Order by Failed, java.lang.NullPointerException

2014-10-24 Thread arthur.hk.c...@gmail.com
Hi, Added “l_linestatus” it works, THANK YOU!! sqlContext.sql("select l_linestatus, l_orderkey, l_linenumber, l_partkey, l_quantity, l_shipdate, L_RETURNFLAG, L_LINESTATUS from lineitem order by L_LINESTATUS limit 10").collect().foreach(println); 14/10/25 07:03:24 INFO DAGScheduler: Stage 12 (

Re: Spark: Order by Failed, java.lang.NullPointerException

2014-10-24 Thread Michael Armbrust
Usually when the SparkContext throws an NPE it means that it has been shut down due to some earlier failure. On Wed, Oct 22, 2014 at 5:29 PM, arthur.hk.c...@gmail.com < arthur.hk.c...@gmail.com> wrote: > Hi, > > I got java.lang.NullPointerException. Please help! > > > sqlContext.sql("select l_ord

Re: Spark: Order by Failed, java.lang.NullPointerException

2014-10-24 Thread Akhil Das
Not sure if this would help, but make sure you are having the column l_linestatus in the data. Thanks Best Regards On Thu, Oct 23, 2014 at 5:59 AM, arthur.hk.c...@gmail.com < arthur.hk.c...@gmail.com> wrote: > Hi, > > I got java.lang.NullPointerException. Please help! > > > sqlContext.sql("selec

Spark: Order by Failed, java.lang.NullPointerException

2014-10-22 Thread arthur.hk.c...@gmail.com
Hi, I got java.lang.NullPointerException. Please help! sqlContext.sql("select l_orderkey, l_linenumber, l_partkey, l_quantity, l_shipdate, L_RETURNFLAG, L_LINESTATUS from lineitem limit 10").collect().foreach(println); 2014-10-23 08:20:12,024 INFO [sparkDriver-akka.actor.default-dispatcher-3