Wang Ken created KYLIN-2932:
-------------------------------

             Summary: Simplify the thread model for in-memory cubing
                 Key: KYLIN-2932
                 URL: https://issues.apache.org/jira/browse/KYLIN-2932
             Project: Kylin
          Issue Type: Improvement
          Components: Job Engine
    Affects Versions: v2.1.0
            Reporter: Wang Ken
            Assignee: Dong Li


The current implementation uses split threads, task threads and main thread to 
do the cube building, there is complex join and error handling logic.

The new implement leverages the ForkJoinPool from JDK,  the event split logic 
is handled in
main thread. Cuboid task and sub-tasks are handled in fork join pool, cube 
results are collected
async and can be write to output earlier.





--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Reply via email to