Re: Interested in contributing to SPARK-24815

2023-07-25 Thread Kent Yao
Hi Pavan, Refer to the ASF Source Header and Copyright Notice Policy[1], code directly submitted to ASF should include the Apache license header without any additional copyright notice. Kent Yao [1] https://www.apache.org/legal/src-headers.html#headers Sean Owen 于2023年7月25日周二 07:22写道: > > Wh

Map Partition is called Multiple Times

2023-07-25 Thread Deepak Patankar
I am trying to run a spark job which performs some database operations and saves passed records in one table and the failed ones in another. Here is the code for the same: ``` log.info("Starting the spark job {}"); String sparkAppName = generateSparkAppName("reading-graph"); SparkConf sparkConf