Re: Avoiding SQL Injection in Spark SQL

>> execution engine). >> >> On Thu, Sep 10, 2015 at 12:10 AM, Sean Owen wrote: >> >>> I don't think this is Spark-specific. Mostly you need to escape / >>> quote user-supplied values as with any SQL engine. >>> >>> On Thu, Sep 10,

Avoiding SQL Injection in Spark SQL

Hi, What is the preferred way of avoiding SQL Injection while using Spark SQL? In our use case we have to take the parameters directly from the users and prepare the SQL Statement.I was not able to find any API for preparing the SQL statement safely avoiding injection. Thanks, Dinesh Philips Indi

Spark SQL parallel query submission via single HiveContext

Hi, As per my use case I need to submit multiple queries to Spark SQL in parallel but due to HiveContext being thread safe the jobs are getting submitted sequentially. I could see many threads are waiting for HiveContext. "on-spray-can-akka.actor.default-dispatcher-26" - Thread t@149 java.lang

Is HiveContext Thread Safe?

Hi, I have a HiveContext which I am using in multiple threads to submit a Spark SQL query using *sql* method. I just wanted to know whether this method is thread-safe or not?Will all my queries be submitted at the same time independent of each other or will be submitted sequential one after the o

Write ahead Logs and checkpoint

Hi, My spark streaming application is pulling data from Kafka.To prevent data loss I have implemented WAL and enable checkpointing.On killing my application and restarting it I am able to prevent data loss now but however I am getting duplicate messages. Is it because the application got killed b