Re: Elasticsearch support for Spark 3.x

2023-09-08 Thread Dipayan Dev
@Alfie Davidson : Awesome, it worked with "“org.elasticsearch.spark.sql”" But as soon as I switched to *elasticsearch-spark-20_2.12, *"es" also worked. On Fri, Sep 8, 2023 at 12:45 PM Dipayan Dev wrote: > > Let me try that and get back. Just wondering, if there a ch

Re: Elasticsearch support for Spark 3.x

2023-09-08 Thread Dipayan Dev
t; > Sent from my iPhone > > On 8 Sep 2023, at 03:10, Dipayan Dev wrote: > >  > > ++ Dev > > On Thu, 7 Sep 2023 at 10:22 PM, Dipayan Dev > wrote: > >> Hi, >> >> Can you please elaborate your last response? I don’t have any external >> depende

Re: Elasticsearch support for Spark 3.x

2023-09-07 Thread Dipayan Dev
++ Dev On Thu, 7 Sep 2023 at 10:22 PM, Dipayan Dev wrote: > Hi, > > Can you please elaborate your last response? I don’t have any external > dependencies added, and just updated the Spark version as mentioned below. > > Can someone help me with this? > > On Fri, 1 Se

Feature to restart Spark job from previous failure point

2023-09-04 Thread Dipayan Dev
that point, and on a retry, resume the operation from that point? With Best Regards, Dipayan Dev

Re: [VOTE] Release Apache Spark 3.5.0 (RC3)

2023-08-30 Thread Dipayan Dev
Can we fix this bug in Spark 3.5.0? https://issues.apache.org/jira/browse/SPARK-44884 On Wed, Aug 30, 2023 at 11:51 AM Sean Owen wrote: > It looks good except that I'm getting errors running the Spark Connect > tests at the end (Java 17, Scala 2.13) It looks like I missed something > necessary

Probable Bug in Spark 3.3.0

2023-08-20 Thread Dipayan Dev
this in Spark 3.3.0. Happy to contribute if you suggest. Thanks Dipayan -- With Best Regards, Dipayan Dev Author of *Deep Learning with Hadoop <https://www.amazon.com/Deep-Learning-Hadoop-Dipayan-Dev/dp/1787124762>* M.Tech (AI), IISc, Bangalore