[
https://issues.apache.org/jira/browse/KYLIN-4688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17180264#comment-17180264
]
ASF GitHub Bot commented on KYLIN-4688:
---------------------------------------
ITzhangqiang commented on a change in pull request #1360:
URL: https://github.com/apache/kylin/pull/1360#discussion_r472617186
##########
File path:
storage-hbase/src/main/java/org/apache/kylin/storage/hbase/steps/CubeHFileJob.java
##########
@@ -101,6 +102,7 @@ public int run(String[] args) throws Exception {
// Automatic config !
HFileOutputFormat3.configureIncrementalLoad(job, htable);
+ tmpPartitionFilePath = new
Path(TotalOrderPartitioner.getPartitionFile(job.getConfiguration()));
Review comment:
I‘m sure，that‘s why I put 'TotalOrderPartitioner.getPartitionFile' up
on the 'reconfigurePartitions'.
##########
File path:
core-common/src/main/java/org/apache/kylin/common/util/HadoopUtil.java
##########
@@ -69,13 +68,6 @@ public static Configuration getCurrentConfiguration() {
}
public static Configuration healSickConfig(Configuration conf) {
- // https://issues.apache.org/jira/browse/KYLIN-953
Review comment:
I checked,there is no affects on others.Because these two configurations
belong to Hbase, where Hbase is used, HbaseConnection is used to get the
configuration.And in HBaseConnection#newHBaseConfiguration,special treatment is
given to these two configurations in this method.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Too many tmp files in HDFS tmp dictionary
> -----------------------------------------
>
> Key: KYLIN-4688
> URL: https://issues.apache.org/jira/browse/KYLIN-4688
> Project: Kylin
> Issue Type: Bug
> Components: Others
> Affects Versions: all
> Reporter: QiangZhang
> Priority: Major
> Attachments: image-2020-08-06-18-07-00-377.png,
> image-2020-08-06-18-29-28-503.png, image-2020-08-06-18-58-00-355.png,
> image-2020-08-06-19-34-22-515.png, image-2020-08-10-19-38-28-913.png,
> image-2020-08-10-20-06-01-526.png, image-2020-08-10-20-14-53-854.png,
> image-2020-08-10-20-18-10-513.png, image-2020-08-10-20-20-07-899.png,
> image-2020-08-10-20-21-44-137.png, image-2020-08-10-20-49-46-354.png
>
>
> Too many tmp files in HDFS tmp dictionary,and Kylin doesn't clean up
> automatically
> !image-2020-08-06-18-07-00-377.png!
> 2. when I debug ,I found : !image-2020-08-06-18-29-28-503.png!
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
