zuston opened a new issue, #665:
URL: https://github.com/apache/incubator-uniffle/issues/665

   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of 
Conduct](https://www.apache.org/foundation/policies/conduct)
   
   
   ### Search before asking
   
   - [X] I have searched in the 
[issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and 
found no similar issues.
   
   
   ### What would you like to be improved?
   
   Handle when key or value is null in one record. like this:
   
   ```
   23/02/27 15:43:06 ERROR Executor: Exception in task 31.3 in stage 2.0 (TID 
2067)
   java.lang.NullPointerException
        at 
org.apache.spark.shuffle.writer.WriteBufferManager.addRecord(WriteBufferManager.java:116)
        at 
org.apache.spark.shuffle.writer.RssShuffleWriter.doWrite(RssShuffleWriter.java:211)
        at 
org.apache.spark.shuffle.writer.RssShuffleWriter.write(RssShuffleWriter.java:170)
        at 
org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)
        at 
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
        at 
org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
        at org.apache.spark.scheduler.Task.run(Task.scala:131)
        at 
org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:497)
        at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1439)
        at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:500)
        at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
        at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   23/02/27 15:43:06 INFO YarnCoarseGrainedExecutorBackend: Got assigned task 
2302
   23/02/27 15:43:06 INFO Executor: Running task 409.0 in stage 2.0 (TID 2302)
   ```
   
   ### How should we improve?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [X] Yes I am willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@uniffle.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to