Re: Re: Re: how to change datatype by useing StructType

2017-01-12 Thread lk_spark
} else { ab += attributes(i) } } new GenericRow(ab.toArray) } } 2017-01-13 lk_spark 发件人:"lk_spark" 发送时间:2017-01-13 09:49 主题:Re: Re: Re: how to change datatype by useing StructType 收件人:"Nicholas Hakobian" 抄送:"user.sp

Re: Re: Re: how to change datatype by useing StructType

2017-01-12 Thread lk_spark
Thank you Nicholas , if the sourcedata was csv format ,CSV reader works well. 2017-01-13 lk_spark 发件人:Nicholas Hakobian 发送时间:2017-01-13 08:35 主题:Re: Re: Re: how to change datatype by useing StructType 收件人:"lk_spark" 抄送:"ayan guha","user.spark" Have you t

Re: Re: Re: how to change datatype by useing StructType

2017-01-12 Thread Nicholas Hakobian
feProjection.apply(Unknown Source) > at org.apache.spark.sql.catalyst.encoders.ExpressionEncoder. > toRow(ExpressionEncoder.scala:290) > all the file was Any, what should I do? > > > > 2017-01-12 > ---------- > lk_spark > ---

Re: Re: Re: how to change datatype by useing StructType

2017-01-12 Thread lk_spark
")).map(attributes => Row(attributes(0),attributes(1),attributes(2))) but I need read data by configurable. 2017-01-12 lk_spark 发件人:ayan guha 发送时间:2017-01-12 14:34 主题:Re: how to change datatype by useing StructType 收件人:"lk_spark","user.spark" 抄送: Do you have yea

Re: Re: how to change datatype by useing StructType

2017-01-11 Thread lk_spark
spark 发件人:ayan guha 发送时间:2017-01-12 14:34 主题:Re: how to change datatype by useing StructType 收件人:"lk_spark","user.spark" 抄送: Do you have year in your data? On Thu, 12 Jan 2017 at 5:24 pm, lk_spark wrote: hi,all I have a txt file ,and

Re: how to change datatype by useing StructType

2017-01-11 Thread ayan guha
Do you have year in your data? On Thu, 12 Jan 2017 at 5:24 pm, lk_spark wrote: > > > > > > > > > > > > > > > > > > > hi,all > > > I have a txt file ,and I want to process it as dataframe > > : > > > > > > data like this : > > >name1,30 > > >name2,18 > > > > > > val sch