[GitHub] carbondata pull request #2984: [CARBONDATA-3165]Protection of Bloom Null Exc...

[qiuchenjian]

GitHub user qiuchenjian opened a pull request:

    https://github.com/apache/carbondata/pull/2984

    [CARBONDATA-3165]Protection of Bloom Null Exception

    Problem：
    24274.0 (TID 664711) | 
org.apache.spark.internal.Logging$class.logError(Logging.scala:91)
    java.lang.NullPointerException
            at java.util.ArrayList.<init>(ArrayList.java:177)
            at 
org.apache.carbondata.datamap.bloom.BloomCoarseGrainDataMap.prune(BloomCoarseGrainDataMap.java:230)
            at 
org.apache.carbondata.core.datamap.TableDataMap.prune(TableDataMap.java:379)
            at 
org.apache.carbondata.core.datamap.DistributableDataMapFormat$1.initialize(DistributableDataMapFormat.java:108)
            at 
org.apache.carbondata.spark.rdd.DataMapPruneRDD.internalCompute(SparkDataMapJob.scala:77)
            at 
org.apache.carbondata.spark.rdd.CarbonRDD.compute(CarbonRDD.scala:82)
            at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:324)
            at org.apache.spark.rdd.RDD.iterator(RDD.scala:288)
            at 
org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
            at org.apache.spark.scheduler.Task.run(Task.scala:99)
            at 
org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:325)
            at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:748)
    
    Solution：
    when filteredShard is empty, return arraylist<>(), and protect null 
exception of other scenes
    
     - [ ] Any interfaces changed?
     
     - [ ] Any backward compatibility impacted?
     
     - [ ] Document update required?
    
     - [ ] Testing done
            protection of null exception, existing test cases are fine
           
     - [ ] For large changes, please consider breaking it into sub-tasks under 
an umbrella JIRA. 
    


You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/qiuchenjian/carbondata CARBONDATA-3165

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/carbondata/pull/2984.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #2984
    
----
commit fe7f87d2a5e049c030d800f845a8d3be13323873
Author: qiuchenjian <807169000@...>
Date:   2018-12-12T08:43:31Z

    [CARBONDATA-3165]Protection of Bloom Null Exception

----


---