Mismatched datatype in Case statement

2017-02-04 Thread Aviral Agarwal
? If yes, which version ? Thanks and Regards, Aviral Agarwal

[SparkSQL] Project using NamedExpression

2017-03-21 Thread Aviral Agarwal
. Thanks and Regards, Aviral Agarwal

Spark SQL Skip and Log bad records

2017-03-15 Thread Aviral Agarwal
Hi guys, Is there a way to skip some bad records and log them when using DataFrame API ? Thanks and Regards, Aviral Agarwal

JDBC RDD Timestamp Parsing Issue

2017-06-21 Thread Aviral Agarwal
. Any leads on how that can be done ? Thanks and Regards, Aviral Agarwal

RE: JDBC RDD Timestamp Parsing Issue

2017-06-21 Thread Aviral Agarwal
The exception is happening in JDBC RDD code where getNext() is called to get the next row. I do not have access to the result set. I am operating on a DataFrame. Thanks and Regards, Aviral Agarwal On Jun 21, 2017 17:19, "Mahesh Sawaiker" <mahesh_sawai...@persistent.com> wrote:

Re: JDBC RDD Timestamp Parsing Issue

2017-06-21 Thread Aviral Agarwal
This woks. Thanks ! - Aviral Agarwal On Wed, Jun 21, 2017 at 6:07 PM, Eduardo Mello <eedu.me...@gmail.com> wrote: > You can add "?zeroDateTimeBehavior=convertToNull" to the connection > string. > > On Wed, Jun 21, 2017 at 9:04 AM, Aviral Agarwal <

Re: ORC Transaction Table - Spark

2017-08-24 Thread Aviral Agarwal
Are there any plans to include it in the future releases of Spark ? Regards, Aviral Agarwal On Thu, Aug 24, 2017 at 3:11 PM, Akhil Das <ak...@hacked.work> wrote: > How are you reading the data? Its clearly saying > *java.lang.NumberFormatException: > For input string

Fwd: ORC Transaction Table - Spark

2017-08-22 Thread Aviral Agarwal
k.java:122) at java.util.concurrent.FutureTask.get(FutureTask.java:192) at org.apache.hadoop.hive.ql.io.orc.OrcInputFormat.generateSplitsInfo( OrcInputFormat.java:998) ... 118 more Any help would be appreciated. Thanks and Regards, Aviral Agarwal