Hi Divya, Are you using or have you tried Spark CSV datasource https://github.com/databricks/spark-csv ?
Thanks! 2015-12-28 18:42 GMT+09:00 Divya Gehlot <divya.htco...@gmail.com>: > Hi, > I have input data set which is CSV file where I have date columns. > My output will also be CSV file and will using this output CSV file as > for hive table creation. > I have few queries : > 1.I tried using custom schema using Timestamp but it is returning empty > result set when querying the dataframes. > 2.Can I use String datatype in Spark for date column and while creating > table can define it as date type ? Partitioning of my hive table will be > date column. > > Would really appreciate if you share some sample code for timestamp in > Dataframe whereas same can be used while creating the hive table. > > > > Thanks, > Divya >
