[
https://issues.apache.org/jira/browse/KYLIN-4442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17082089#comment-17082089
]
Sonu Singh edited comment on KYLIN-4442 at 4/13/20, 6:22 AM:
-------------------------------------------------------------
[~hit_lacus]
Hadoop version 3.0.1 and I am not using HDP. Its plain Hadoop environment.
show partitions kylin.HIVE_METRICS_JOB_QA;
output - show partitions KYLIN.HIVE_METRICS_JOB_QA;
OK
Time taken: 0.112 seconds
show create table KYLIN.HIVE_METRICS_JOB_QA;
output -
hive> show create table KYLIN.HIVE_METRICS_JOB_QA;
OK
CREATE TABLE `KYLIN.HIVE_METRICS_JOB_QA`(
`job_id` string,
`host` string,
`kuser` string,
`project` string,
`cube_name` string,
`job_type` string,
`cubing_type` string,
`duration` bigint,
`table_size` bigint,
`cube_size` bigint,
`per_bytes_time_cost` double,
`wait_resource_time` bigint,
`step_duration_distinct_columns` bigint,
`step_duration_dictionary` bigint,
`step_duration_inmem_cubing` bigint,
`step_duration_hfile_convert` bigint,
`ktimestamp` bigint,
`kyear_begin_date` string,
`kmonth_begin_date` string,
`kweek_begin_date` string,
`kday_time` string,
`ktime_hour` int,
`ktime_minute` int,
`ktime_second` int)
PARTITIONED BY (
`kday_date` string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
WITH SERDEPROPERTIES (
'field.delim'=',',
'serialization.format'=',')
STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
LOCATION
'hdfs://dev-2:8020/apps/hive/warehouse/kylin.db/hive_metrics_job_qa'
TBLPROPERTIES (
'bucketing_version'='2',
'transient_lastDdlTime'='1586603256')
Time taken: 0.111 seconds, Fetched: 41 row
was (Author: sonusingh):
[~hit_lacus]
Hadoop version 3.0.1 and I am not using HDP. Its plain Hadoop environment.
show partitions kylin.HIVE_METRICS_JOB_QA;
output - show partitions KYLIN.HIVE_METRICS_JOB_QA;
OK
Time taken: 0.112 seconds
show create table KYLIN.HIVE_METRICS_JOB_QA;
output -
hive> show create table KYLIN.HIVE_METRICS_JOB_QA;
OK
CREATE TABLE `KYLIN.HIVE_METRICS_JOB_QA`(
`job_id` string,
`host` string,
`kuser` string,
`project` string,
`cube_name` string,
`job_type` string,
`cubing_type` string,
`duration` bigint,
`table_size` bigint,
`cube_size` bigint,
`per_bytes_time_cost` double,
`wait_resource_time` bigint,
`step_duration_distinct_columns` bigint,
`step_duration_dictionary` bigint,
`step_duration_inmem_cubing` bigint,
`step_duration_hfile_convert` bigint,
`ktimestamp` bigint,
`kyear_begin_date` string,
`kmonth_begin_date` string,
`kweek_begin_date` string,
`kday_time` string,
`ktime_hour` int,
`ktime_minute` int,
`ktime_second` int)
PARTITIONED BY (
`kday_date` string)
ROW FORMAT SERDE
'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
WITH SERDEPROPERTIES (
'field.delim'=',',
'serialization.format'=',')
STORED AS INPUTFORMAT
'org.apache.hadoop.mapred.TextInputFormat'
OUTPUTFORMAT
'org.apache.hadoop.hive.ql.io.HiveIgnoreKeyTextOutputFormat'
LOCATION
'hdfs://dev-2:8020/apps/hive/warehouse/qubz.db/hive_metrics_job_qa'
TBLPROPERTIES (
'bucketing_version'='2',
'transient_lastDdlTime'='1586603256')
Time taken: 0.111 seconds, Fetched: 41 row
> Kylin System Cube Hive tables not able to update
> -------------------------------------------------
>
> Key: KYLIN-4442
> URL: https://issues.apache.org/jira/browse/KYLIN-4442
> Project: Kylin
> Issue Type: Bug
> Affects Versions: v3.0.0
> Reporter: Sonu Singh
> Priority: Blocker
>
> Kylin System Cube Hive table is not updating. I am using Kylin hadoop3 code
> and running on vanilla hadoop3.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
