RE: Window Functions with SQLContext

2016-08-31 Thread Saurabh Dubey
Hi Divya,   Then, how can https://issues.apache.org/jira/browse/SPARK-11001 be resolved.   Thanks, Saurabh   From: Divya Gehlot [mailto:divya.htco...@gmail.com] Sent: 01 September 2016 11:33 To: saurabh3d Cc: user @spark Subject: Re: Window Functions with SQLContext   Hi Saurabh

Re: Window Functions with SQLContext

2016-08-31 Thread Divya Gehlot
Hi Saurabh, Even I am using Spark 1.6+ version ..and when I didnt create hiveContext it threw the same error . So have to create HiveContext to access windows function Thanks, Divya On 1 September 2016 at 13:16, saurabh3d wrote: > Hi All, > > As per SPARK-11001

RE: Window Functions with SQLContext

2016-08-31 Thread Saurabh Dubey
alect.parse(ParserDialect.scala:67)     at org.apache.spark.sql.SQLContext$$anonfun$2.apply(SQLContext.scala:211)     at org.apache.spark.sql.SQLContext$$anonfun$2.apply(SQLContext.scala:211)   Thanks   From: ayan guha [mailto:guha.a...@gmail.com] Sent: 01 September 2016 11:

Re: Window Functions with SQLContext

2016-08-31 Thread ayan guha
I think you can write the SQL query and run it usin sqlContext. like select *,row_number() over(partitin by assetid order by assetid) rn from t On Thu, Sep 1, 2016 at 3:16 PM, saurabh3d wrote: > Hi All, > > As per SPARK-11001 > , > Window

RE: Window Functions with SQLContext

2016-08-31 Thread Saurabh Dubey
ue here is about using SQLContext instead of HiveContext. Thanks, Saurabh -Original Message- From: Adline Dsilva [mailto:adline.dsi...@mimos.my] Sent: 01 September 2016 11:05 To: saurabh3d; user@spark.apache.org Subject: RE: Window Functions with SQLContext Hi, Use function rowNumber

RE: Window Functions with SQLContext

2016-08-31 Thread Adline Dsilva
Hi, Use function rowNumber instead of row_number df1.withColumn("row_number", rowNumber.over(w)); Regards, Adline From: saurabh3d [saurabh.s.du...@oracle.com] Sent: 01 September 2016 13:16 To: user@spark.apache.org Subject: Window Functions with SQLConte