[
https://issues.apache.org/jira/browse/KYLIN-3406?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16709899#comment-16709899
]
XiaoXiang Yu edited comment on KYLIN-3406 at 12/5/18 11:46 AM:
---------------------------------------------------------------
h2. Test evidence
* Remove this file : /execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-10
* Update code and restart server.
* Visit the "monitor" page.
{quote}⚡ root@sandbox ~/clyne master ● hadoop fs -ls
/kylin/kylin_metadata3406/resources/execute_output
Found 15 items
-rw-r--r-- 3 root hdfs 308 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85
-rw-r--r-- 3 root hdfs 3332 2018-12-05 10:51
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-00
-rw-r--r-- 3 root hdfs 2675 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-01
-rw-r--r-- 3 root hdfs 260 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-02
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-03
-rw-r--r-- 3 root hdfs 260 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-04
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-05
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:53
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-06
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:53
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-07
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:53
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-08
-rw-r--r-- 3 root hdfs 2522 2018-12-05 10:54
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-09
-rw-r--r-- 3 root hdfs 260 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-11
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-12
-rw-r--r-- 3 root hdfs 529 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-13
-rw-r--r-- 3 root hdfs 661 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-14
{quote}
!Lost Execute Output.png!
!image-2018-12-05-18-45-32-923.png!
was (Author: hit_lacus):
h2. Test evidence
Remove this file : /execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-10
{quote}⚡ root@sandbox ~/clyne master ● hadoop fs -ls
/kylin/kylin_metadata3406/resources/execute_output
Found 15 items
-rw-r--r-- 3 root hdfs 308 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85
-rw-r--r-- 3 root hdfs 3332 2018-12-05 10:51
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-00
-rw-r--r-- 3 root hdfs 2675 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-01
-rw-r--r-- 3 root hdfs 260 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-02
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-03
-rw-r--r-- 3 root hdfs 260 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-04
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:52
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-05
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:53
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-06
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:53
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-07
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:53
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-08
-rw-r--r-- 3 root hdfs 2522 2018-12-05 10:54
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-09
-rw-r--r-- 3 root hdfs 260 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-11
-rw-r--r-- 3 root hdfs 254 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-12
-rw-r--r-- 3 root hdfs 529 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-13
-rw-r--r-- 3 root hdfs 661 2018-12-05 10:56
/kylin/kylin_metadata3406/resources/execute_output/3b27b7df-aece-ba28-e986-3758fe8b9a85-14
{quote}
!Lost Execute Output.png!
!image-2018-12-05-18-45-32-923.png!
> When the /execute_output/ metadata file sinking to HDFS is deleted, the
> monitoring page does not display any tasks.
> -------------------------------------------------------------------------------------------------------------------
>
> Key: KYLIN-3406
> URL: https://issues.apache.org/jira/browse/KYLIN-3406
> Project: Kylin
> Issue Type: Bug
> Components: Metadata
> Affects Versions: v2.3.1
> Reporter: yujie.sun
> Assignee: XiaoXiang Yu
> Priority: Major
> Fix For: v2.6.0
>
> Attachments: Lost Execute Output.png, Step which lost execute
> output.png, image-2018-12-05-13-22-42-456.png,
> image-2018-12-05-18-45-32-923.png
>
>
> *{color:#24292e}Issue description:{color}*
> When a single file of Hbase metadata is greater than a certain value, the
> file is sunk into HDFS for storage. When files in execute_output/ are deleted
> in HDFS, the monitoring page will not display any tasks.
> *{color:#24292e}Reproduction step:{color}*
> {color:#24292e}1.Use Hbase as metadata storage{color}
> {color:#24292e}2.Modify the hbase configuration ,configure
> "hbase.client.keyvalue.maxsize" into a small value, such as 524288.{color}
> {color:#24292e}3.Create a new build task, after the build task finished,find
> the /execute_output hbase metadata path on HDFS,
> /\{working_dir}/\{metadata_url}/resources/execute_output/..., and delete one
> of the files.{color}
> {color:#24292e}4.At this time,{color:#333333}the monitoring page will not
> display any tasks.{color}{color}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
