Re: Concatenate a string to a Column of type string in DataFrame

2015-12-14 Thread Michael Armbrust
In earlier versions you should be able to use callUdf or callUDF (depending on which version) and call the hive function "concat". On Sun, Dec 13, 2015 at 3:05 AM, Yanbo Liang wrote: > Sorry, it was added since 1.5.0. > > 2015-12-13 2:07 GMT+08:00 Satish

Re: Concatenate a string to a Column of type string in DataFrame

2015-12-13 Thread Yanbo Liang
Sorry, it was added since 1.5.0. 2015-12-13 2:07 GMT+08:00 Satish : > Hi, > Will the below mentioned snippet work for Spark 1.4.0 > > Thanks for your inputs > > Regards, > Satish > -- > From: Yanbo Liang > Sent:

Concatenate a string to a Column of type string in DataFrame

2015-12-12 Thread satish chandra j
HI, I am trying to update a column value in DataFrame, incrementing a column of integer data type than the below code works val new_df=old_df.select(df("Int_Column")+10) If I implement the similar approach for appending a string to a column of string datatype as below than it does not error out

Re: Concatenate a string to a Column of type string in DataFrame

2015-12-12 Thread Yanbo Liang
Hi Satish, You can refer the following code snippet: df.select(concat(col("String_Column"), lit("00:00:000"))) Yanbo 2015-12-12 16:01 GMT+08:00 satish chandra j : > HI, > I am trying to update a column value in DataFrame, incrementing a column > of integer data type

RE: Concatenate a string to a Column of type string in DataFrame

2015-12-12 Thread Satish
Hi, Will the below mentioned snippet work for Spark 1.4.0 Thanks for your inputs Regards, Satish -Original Message- From: "Yanbo Liang" Sent: ‎12-‎12-‎2015 20:54 To: "satish chandra j" Cc: "user" Subject: Re: