ChangjiGuo created HIVE-24834:
---------------------------------

             Summary: Cannot add comment for kafka table
                 Key: HIVE-24834
                 URL: https://issues.apache.org/jira/browse/HIVE-24834
             Project: Hive
          Issue Type: Bug
          Components: kafka integration
    Affects Versions: 3.1.2
            Reporter: ChangjiGuo
            Assignee: ChangjiGuo


when using kafka-handler to create a kafka table, no matter whether the user 
specifies column comment or not, the comment will become 'from deserializer' 
when the 'show create table' command is used to view the table structure.
You can refer to the following example:
{code:sql}
CREATE EXTERNAL TABLE `kafka_table`(
  `id` string, 
  `info` string comment 'comment 1', 
  `jsoninfo` struct<id:string,info:string> comment 'comment 2')
ROW FORMAT SERDE 
  'org.apache.hadoop.hive.kafka.KafkaSerDe' 
STORED BY 
  'org.apache.hadoop.hive.kafka.KafkaStorageHandler' 
WITH SERDEPROPERTIES ( 
  'serialization.format'='1')
LOCATION
  'hdfs://offlinehdfs/user/hive/warehouse/kafka_table'
TBLPROPERTIES (
  'properties.bootstrap.servers'='xxxx', 
  'topic'='xxxx'
  ..........)
{code}
The result is as follows:

{code:sql}
CREATE EXTERNAL TABLE `kafka_table`(
  `id` string COMMENT 'from deserializer', 
  `info` string COMMENT 'from deserializer', 
  `jsoninfo` struct<id:string,info:string> COMMENT 'from deserializer', 
  `__key` binary COMMENT 'from deserializer', 
  `__partition` int COMMENT 'from deserializer', 
  `__offset` bigint COMMENT 'from deserializer', 
  `__timestamp` bigint COMMENT 'from deserializer')
ROW FORMAT SERDE 
  'org.apache.hadoop.hive.kafka.KafkaSerDe' 
STORED BY 
  'org.apache.hadoop.hive.kafka.KafkaStorageHandler' 
WITH SERDEPROPERTIES ( 
  'serialization.format'='1')
LOCATION
  'hdfs://offlinehdfs/user/hive/warehouse/kafka_table'
TBLPROPERTIES (
  .......)
{code}




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Reply via email to