Hi, I have input data set which is CSV file where I have date columns. My output will also be CSV file and will using this output CSV file as for hive table creation. I have few queries : 1.I tried using custom schema using Timestamp but it is returning empty result set when querying the dataframes. 2.Can I use String datatype in Spark for date column and while creating table can define it as date type ? Partitioning of my hive table will be date column.
Would really appreciate if you share some sample code for timestamp in Dataframe whereas same can be used while creating the hive table. Thanks, Divya
