求问Hive DDL TBLPROPERTIES不生效

Thu, 08 Apr 2021 03:07:26 -0700 

SET table.sql-dialect=hive;
CREATE TABLE hive_catalog.test_db.test_insert_tb (
    id BIGINT,
    type INT,
    user_id BIGINT,
    title STRING,
    ts TIMESTAMP
) PARTITIONED BY (add_date STRING, add_hour STRING) STORED AS orc
TBLPROPERTIES (
    'sink.partition-commit.trigger' = 'process-time',
    'sink.partition-commit.delay' = '0s',
    'sink.partition-commit.policy.kind' = 'metastore,success-file',
    'partition.time-extractor.kind' = 'custom',
    'partition.time-extractor.timestamp-pattern' = '$add_date $add_hour',
    'partition.time-extractor.class' = 'xxxx.YMDPartTimeExtractor'
);

如上在hive-dialect里建了一张表，启动任务后从kafka读然后写入，貌似TBLPROPERTIES里的参数一个都没生效，数据能从hdfs上看到，但是hive没有partition，分区也没有按照我class写的进行（我的class需要把分区弄成
yyyyMMdd, HH这种日期格式，同时修复+8时区），TM
JM也没有任何exception，请问有见过这种情况的吗？是不是某个参数没搞对所以都没生效



--
Sent from: http://apache-flink.147419.n8.nabble.com/

回复