Hi: I’m sorry the picture is dead again. I upload it as attachment this time
-- Best regards, Xi Chen From: 陈熹(chenxi07)-技术产品中心 <chenx...@qiyi.com> Sent: Monday, November 5, 2018 3:04 PM To: dev@kylin.apache.org Subject: How to increase split number for Fact distinct columns when using spark engine?(picture added) Hi, ALL: I’m using spark engine to build cube. Now I found the bottleneck of build time lies in the #3 Step Name: Extract Fact Table Distinct Columns. When I look into the spark application, I found there is only two splits regardless of how large the input sequence file is. I wonder how to increase the number of split for this step? I’m new to spark and any help will be great thanks! P.S. Spark job of #3 Step Name: Extract Fact Table Distinct Columns. [cid:image001.png@01D47518.C74E9D70] [cid:image002.png@01D47518.C74E9D70] [cid:image003.png@01D47518.C74E9D70] [cid:image004.png@01D47518.C74E9D70] -- Best regards, Xi Chen