Hi, dongwoo
You can check the SqlClient log first, I think the exception has been
logged in SqlClient log file.
Best,
Ron
Dongwoo Kim <dongwoo7....@gmail.com> 于2023年7月31日周一 22:38写道：
>
>
> ---------- Forwarded message ---------
> 보낸사람: Dongwoo Kim <dongwoo7....@gmail.com>
> Date: 2023년 7월 31일 (월) 오후 11:36
> Subject: Re: Flink sql client doesn't work with "partition by" clause
> To: liu ron <ron9....@gmail.com>
>
>
> Hi, ron.
>
> Actually I'm not receiving any exception message when executing the *partition
> by* clause in the Flink SQL Client.
>
> The job does not fail, but it finishes quickly without executing the
> expected query job.
>
> I'm suspecting that the Flink SQL Client is not recognizing the partition
> by field(*`hour`*) properly.
>
> This is because when I input an obviously incorrect field(*hourr*) as the
> partition by field, the job behaves in the same manner - it does not fail,
> but also doesn't perform any operations(reading file ) and ends the query.
>
>
> *e.g) *This below query also doesn't fail but ends right after submission.
>
> CREATE TABLE source_table
> (
> id STRING,
> status STRING,
> type STRING,
> hourr INT
> ) PARTITIONED BY (`hourr`) WITH (
> 'connector' = 'filesystem',
> 'path' = 'hdfs://${our_data_path}month=202307/day=20230714',
> 'format' = 'parquet'
> );
>
> SELECT hourr
> FROM source_table
> GROUP BY hourr;
>
>
> To provide better context
> I was using this sql-runner
> <https://github.com/apache/flink-kubernetes-operator/blob/main/examples/flink-sql-runner-example/src/main/java/org/apache/flink/examples/SqlRunner.java>
> to test the partition by clause and it worked as expected, but didn't work
> when I deployed the flink-session cluster by flink kubernetes operator and
> executed sql-client.sh in the jobmanger pod.
>
> Since as you said this is not an expected behavior, I'll investigate the
> source code.
>
> Thanks
>
>
> Best,
> dongwoo
>
>
>
> 2023년 7월 31일 (월) 오후 5:47, liu ron <ron9....@gmail.com>님이 작성:
>
>> Hi, dongwoo
>>
>> Can you give the exception message about SqlClient, it would be helpful
>> to find the root cause. In theory, it should work for both cases.
>>
>> Best,
>> Ron
>>
>> Dongwoo Kim <dongwoo7....@gmail.com> 于2023年7月28日周五 21:24写道：
>>
>>> Hello all, I've realized that the previous mail had some error which
>>> caused invisible text. So I'm resending the mail below.
>>>
>>> Hello all, I have found that the Flink sql client doesn't work with the
>>> *"partition
>>> by"* clause.
>>> Is this a bug?
>>> It's a bit weird since when I execute the same sql with
>>> *"tableEnv.executeSql(statement)"* code it works as expected.
>>> Has anyone tackled this kind of issue?
>>> I have tested in flink 1.16.1 version.
>>>
>>> Thanks in advance
>>>
>>>
>>>
>>> *- This below code only works with executeSql method in table api but
>>> not with sql client cli.*
>>>
>>> CREATE TABLE source_table
>>> (
>>> id STRING,
>>> status STRING,
>>> type STRING,
>>> `hour` INT
>>> ) PARTITIONED BY (`hour`) WITH (
>>> 'connector' = 'filesystem',
>>> 'path' = 'hdfs://${our_data_path}month=202307/day=20230714',
>>> 'format' = 'parquet'
>>> );
>>>
>>> SELECT `hour`
>>> FROM source_table
>>> GROUP BY `hour`;
>>>
>>>
>>> *- This below query works both on the executeSql() method in table api
>>> and sql client query.*
>>>
>>> CREATE TABLE source_table_2
>>> (
>>> id STRING,
>>> status STRING,
>>> type STRING
>>> ) WITH (
>>> 'connector' = 'filesystem',
>>> 'path' = 'hdfs://${out_data_path}/month=202307/day=20230714',
>>> 'format' = 'parquet'
>>> );
>>>
>>> SELECT status
>>> FROM source_table_2
>>> GROUP BY status;
>>>
>>>
>>>
>>> Best,
>>> dongwoo
>>>
>>> 2023년 7월 28일 (금) 오후 6:19, Dongwoo Kim <dongwoo7....@gmail.com>님이 작성:
>>>
>>>> Hello all, I have found that flink sql client doesn't work with
>>>> "partition by" clause.
>>>> Is this bug? It's bit weird since when I execute same sql with
>>>> tableEnv.executeSql(statement) code it works as expected. Has anyone
>>>> tackled this kind of issue? I have tested in flink 1.16.1 version.
>>>> Thanks in advance
>>>>
>>>>
>>>> - This below code only works with executeSql method in table api but
>>>> not with sql client cli.
>>>>
>>>> CREATE TABLE source_table
>>>>
>>>> (
>>>>
>>>> id STRING,
>>>>
>>>> status STRING,
>>>>
>>>> type STRING,
>>>>
>>>> `hour` INT
>>>>
>>>> ) PARTITIONED BY (`hour`) WITH (
>>>>
>>>> 'connector' = 'filesystem',
>>>>
>>>> 'path' = 'hdfs://${our_data_path}month=202307/day=20230714',
>>>>
>>>> 'format' = 'parquet'
>>>>
>>>> );
>>>>
>>>>
>>>> SELECT `hour`
>>>>
>>>> FROM source_table
>>>>
>>>> GROUP BY `hour`;
>>>>
>>>>
>>>>
>>>> - This below query works both on executeSql method in table api and
>>>> sql client query.
>>>>
>>>>
>>>> CREATE TABLE source_table_2
>>>>
>>>> (
>>>>
>>>> id STRING,
>>>>
>>>> status STRING,
>>>>
>>>> type STRING
>>>>
>>>> ) WITH (
>>>>
>>>> 'connector' = 'filesystem',
>>>>
>>>> 'path' = 'hdfs://${out_data_path}/month=202307/day=20230714',
>>>>
>>>> 'format' = 'parquet'
>>>>
>>>> );
>>>>
>>>>
>>>> SELECT status
>>>>
>>>> FROM source_table_2
>>>>
>>>> GROUP BY status;
>>>>
>>>>
>>>>
>>>> Best,
>>>>
>>>> dongwoo
>>>>
>>>>
>>>>
