BTW I forgot to mention that this was added through SPARK-11736 which went
into the upcoming 1.6.0 release
FYI
On Mon, Dec 7, 2015 at 12:53 PM, Ted Yu wrote:
> scala> val test=sqlContext.sql("select monotonically_increasing_id() from
> t").show
> +---+
> |_c0|
> +---+
> | 0|
> | 1|
> | 2|
>
scala> val test=sqlContext.sql("select monotonically_increasing_id() from
t").show
+---+
|_c0|
+---+
| 0|
| 1|
| 2|
+---+
Cheers
On Mon, Dec 7, 2015 at 12:48 PM, sri hari kali charan Tummala <
kali.tumm...@gmail.com> wrote:
> Hi Ted,
>
> Gave and exception am I following right approach ?
>
>
Hi Ted,
Gave and exception am I following right approach ?
val test=sqlContext.sql("select *, monotonicallyIncreasingId() from kali")
On Mon, Dec 7, 2015 at 4:52 PM, Ted Yu wrote:
> Have you tried using monotonicallyIncreasingId ?
>
> Cheers
>
> On Mon, Dec 7, 2015 at 7:56 AM, Sri wrote:
>
Have you tried using monotonicallyIncreasingId ?
Cheers
On Mon, Dec 7, 2015 at 7:56 AM, Sri wrote:
> Thanks , I found the right function current_timestamp().
>
> different Question:-
> Is there a row_number() function in spark SQL ? Not in Data frame just
> spark SQL?
>
>
> Thanks
> Sri
>
> Sen
ensure that this email is virus free,
therefore neither Peridale Ltd, its subsidiaries nor their employees accept any
responsibility.
From: Ted Yu [mailto:yuzhih...@gmail.com]
Sent: 07 December 2015 15:49
To: kali.tumm...@gmail.com
Cc: user
Subject: Re: spark sql current time stamp function
Thanks , I found the right function current_timestamp().
different Question:-
Is there a row_number() function in spark SQL ? Not in Data frame just spark
SQL?
Thanks
Sri
Sent from my iPhone
> On 7 Dec 2015, at 15:49, Ted Yu wrote:
>
> Does unix_timestamp() satisfy your needs ?
> See sql/co
Does unix_timestamp() satisfy your needs ?
See sql/core/src/test/scala/org/apache/spark/sql/DateFunctionsSuite.scala
On Mon, Dec 7, 2015 at 6:54 AM, kali.tumm...@gmail.com <
kali.tumm...@gmail.com> wrote:
> I found a way out.
>
> import java.text.SimpleDateFormat
> import java.util.Date;
>
> val
I found a way out.
import java.text.SimpleDateFormat
import java.util.Date;
val format = new SimpleDateFormat("-M-dd hh:mm:ss")
val testsql=sqlContext.sql("select column1,column2,column3,column4,column5
,'%s' as TIME_STAMP from TestTable limit 10".format(format.format(new
Date(
Thanks
