Can spark convert String to Integer when reading using schema in structured streaming

2019-11-22 Thread Aniruddha P Tekade
Hi, I am new to spark and learning spark structured streaming. I am using structured streaming with schema specified with the help of case class and encoders to get the streaming dataframe. case class SampleLogEntry( dateTime: Timestamp, c

Re: SparkR integration with Hive 3 spark-r

2019-11-22 Thread Alfredo Marquez
Does anyone else have some insight to this question? Thanks, Alfredo On Mon, Nov 18, 2019, 3:00 PM Alfredo Marquez wrote: > Hello Nicolas, > > Well the issue is that with Hive 3, Spark gets it's own metastore, > separate from the Hive 3 metastore. So how do you reconcile this > separation of