[GitHub] carbondata issue #2267: [CARBONDATA-2433] [Lucene GC Issue] Executor OOM bec...

[jackylk]

Github user jackylk commented on the issue:

    https://github.com/apache/carbondata/pull/2267
  
    Hi, I tried this PR in a table with 60M row table, and I added log in the 
loop you add, it prints
    18/05/04 10:42:30 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Searching for l_comment:packages with top 59986052 result
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Finished searching, preparing result
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 1
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 2
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 3
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 4
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 5
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 6
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 7
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 8
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 9
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop 10
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 Loop end
    18/05/04 10:42:37 INFO LuceneFineGrainDataMap: Executor task launch worker 
for task 0 About to searchAfter, remainingHits: 4418435, 
numberOfDocumentsToBeQueried: 10
    
    And the program calls indexSearcher.searchAfter and not returning



---