Re: flink 1.13.1, metrics指标中表名称为 Unnamed

Thu, 29 Jul 2021 19:54:45 -0700 

Hi！

显示 Unnamed 的 sink 一般是 data stream api 的 sink。这个作业之前的数据是不是从 data stream api
里来的呢？

Asahi Lee <[email protected]> 于2021年7月29日周四 下午9:25写道：

> Hi！
> 我执行如下sql任务时，打开度量报告，其中我的输出表度量指标中，表名显示为Unnamed，这是否为一个bug？
> 指标信息如下：
> node103.taskmanager.container_1627469681067_0030_01_000002.e621b91ec4a34ababeb6b0e2c4d6f22b.Source:
> HiveSource-qc_test_t_student_score -&gt; Calc(select=[id,
> CAST(_UTF-16LE'Bob':VARCHAR(2147483647) CHARACTER SET "UTF-16LE") AS name,
> class_id, class_name, score,
> _UTF-16LE'9bdb0e98cc5b4800ae3b56575c442225':VARCHAR(2147483647) CHARACTER
> SET "UTF-16LE" AS rule_id, _UTF-16LE'测试33333':VARCHAR(2147483647) CHARACTER
> SET "UTF-16LE" AS task_batch_id], where=[(name =
> _UTF-16LE'Bob':VARCHAR(2147483647) CHARACTER SET "UTF-16LE")]) -&gt; Map
> -&gt; Sink: Unnamed.0.Shuffle.Netty.Input.Buffers.inputFloatingBuffersUsage
>
>
> node103.taskmanager.container_1627469681067_0030_01_000002.e621b91ec4a34ababeb6b0e2c4d6f22b.Source:
> HiveSource-qc_test_t_student_score -&gt; Calc(select=[id,
> CAST(_UTF-16LE'Bob':VARCHAR(2147483647) CHARACTER SET "UTF-16LE") AS name,
> class_id, class_name, score,
> _UTF-16LE'9bdb0e98cc5b4800ae3b56575c442225':VARCHAR(2147483647) CHARACTER
> SET "UTF-16LE" AS rule_id, _UTF-16LE'测试33333':VARCHAR(2147483647) CHARACTER
> SET "UTF-16LE" AS task_batch_id], where=[(name =
> _UTF-16LE'Bob':VARCHAR(2147483647) CHARACTER SET "UTF-16LE")]) -&gt; Map
> -&gt; Sink: Unnamed.0.Shuffle.Netty.Input.Buffers.inPoolUsage
>
>
>
> node103.taskmanager.container_1627469681067_0030_01_000002.e621b91ec4a34ababeb6b0e2c4d6f22b.Sink:
> Unnamed.0.numRecordsIn
>
>
> 任务sql如下：
> CREATE CATALOG `qc_hive_catalog` WITH ( 'type' = 'hive',
> 'default-database' = 'qc_test' );
> USE CATALOG `qc_hive_catalog`;
> CREATE TABLE
> IF
>         NOT EXISTS QC_RESULT_T_STUDENT_SCORE ( id STRING, NAME STRING,
> class_id STRING, class_name STRING, score INTEGER, rule_id STRING,
> task_batch_id STRING ) WITH ( 'is_generic' = 'false', 'connector' = 'hive'
> );
> INSERT INTO QC_RESULT_T_STUDENT_SCORE SELECT
> id,
> NAME,
> class_id,
> class_name,
> score,
> cast( '9bdb0e98cc5b4800ae3b56575c442225' AS STRING ) AS rule_id,
> cast( '测试33333' AS STRING ) AS task_batch_id&nbsp;
> FROM
>         t_student_score&nbsp;
> WHERE
>         t_student_score.NAME = 'Bob';

回复