[jira] [Created] (FLINK-22341) Describe table doesn't work with hive dialect
Rui Li created FLINK-22341: -- Summary: Describe table doesn't work with hive dialect Key: FLINK-22341 URL: https://issues.apache.org/jira/browse/FLINK-22341 Project: Flink Issue Type: Bug Components: Connectors / Hive Reporter: Rui Li Fix For: 1.13.0 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22340) Concurrent access to ThresholdMeter may lead to NPE
Xintong Song created FLINK-22340: Summary: Concurrent access to ThresholdMeter may lead to NPE Key: FLINK-22340 URL: https://issues.apache.org/jira/browse/FLINK-22340 Project: Flink Issue Type: Bug Components: Runtime / Coordination Affects Versions: 1.13.0 Reporter: Xintong Song Fix For: 1.13.0 It is reported on github [1] that NPE is thrown from ThreasholdMeter, which is likely caused by concurrent accesses. [1] https://github.com/apache/flink/commit/b9e576fb845b817d804da3d68471ff8a4723dcf3#commitcomment-49681105 -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22339) Fix some encoding exceptions were not thrown in cython coders
Huang Xingbo created FLINK-22339: Summary: Fix some encoding exceptions were not thrown in cython coders Key: FLINK-22339 URL: https://issues.apache.org/jira/browse/FLINK-22339 Project: Flink Issue Type: Bug Components: API / Python Affects Versions: 1.12.2, 1.13.0 Reporter: Huang Xingbo Assignee: Huang Xingbo -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22338) Clear watermark output when test finished for FromElementSourceFunctionWithWatermark
Shengkai Fang created FLINK-22338: - Summary: Clear watermark output when test finished for FromElementSourceFunctionWithWatermark Key: FLINK-22338 URL: https://issues.apache.org/jira/browse/FLINK-22338 Project: Flink Issue Type: Bug Components: Table SQL / Planner Affects Versions: 1.13.0 Reporter: Shengkai Fang -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22337) Support 'ALTER TABLE ADD' statement
Jane Chan created FLINK-22337: - Summary: Support 'ALTER TABLE ADD' statement Key: FLINK-22337 URL: https://issues.apache.org/jira/browse/FLINK-22337 Project: Flink Issue Type: Sub-task Components: Table SQL / API, Table SQL / Client Affects Versions: 1.14.0 Reporter: Jane Chan -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22336) [umbrella] Enhance testing for built-in functions
Jingsong Lee created FLINK-22336: Summary: [umbrella] Enhance testing for built-in functions Key: FLINK-22336 URL: https://issues.apache.org/jira/browse/FLINK-22336 Project: Flink Issue Type: Test Components: Table SQL / Runtime Reporter: Jingsong Lee Fix For: 1.14.0 We can complement the testing for existing functions, from the following aspects: * test all support types * test normal value, random value, extreme value and illegal value of parameters * test null value of parameters * test return null value -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (FLINK-22335) Increase default resource wait timeout for the adaptive scheduler
Xintong Song created FLINK-22335:
Summary: Increase default resource wait timeout for the adaptive
scheduler
Key: FLINK-22335
URL: https://issues.apache.org/jira/browse/FLINK-22335
Project: Flink
Issue Type: Improvement
Components: Runtime / Configuration, Runtime / Coordination
Reporter: Xintong Song
Fix For: 1.13.0
As discussed in FLINK-22135, the current default value {{10s}} for
{{jobmanager.adaptive-scheduler.resource-wait-timeout}} is too short and can
easily lead to job failures when working with active resource managers. We'd
like to increase the default value to {{5min}}, aligning with
{{slot.request.timeout}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (FLINK-22334) Fail to translate the hive-sql in STREAMING mode
Shengkai Fang created FLINK-22334:
-
Summary: Fail to translate the hive-sql in STREAMING mode
Key: FLINK-22334
URL: https://issues.apache.org/jira/browse/FLINK-22334
Project: Flink
Issue Type: Bug
Components: Connectors / Hive
Affects Versions: 1.13.0
Reporter: Shengkai Fang
Fix For: 1.13.0
The failed statement
{code:java}
// Some comments here
insert into dest(y,x) select x,y from foo cluster by x
{code}
Exception stack:
{code:java}
org.apache.calcite.plan.RelOptPlanner$CannotPlanException: There are not enough
rules to produce a node with desired properties: convention=LOGICAL,
FlinkRelDistributionTraitDef=any, MiniBatchIntervalTraitDef=None: 0,
ModifyKindSetTraitDef=[NONE], UpdateKindTraitDef=[NONE].
Missing conversion is LogicalDistribution[convention: NONE -> LOGICAL]
There is 1 empty subset: rel#5176:RelSubset#43.LOGICAL.any.None:
0.[NONE].[NONE], the relevant part of the original plan is as follows
5174:LogicalDistribution(collation=[[0 ASC-nulls-first]], dist=[[]])
5172:LogicalProject(subset=[rel#5173:RelSubset#42.NONE.any.None:
0.[NONE].[NONE]], x=[$0])
5106:LogicalTableScan(subset=[rel#5171:RelSubset#41.NONE.any.None:
0.[NONE].[NONE]], table=[[myhive, default, foo]])
Root: rel#5176:RelSubset#43.LOGICAL.any.None: 0.[NONE].[NONE]
Original rel:
FlinkLogicalLegacySink(subset=[rel#4254:RelSubset#8.LOGICAL.any.None:
0.[NONE].[NONE]], name=[collect], fields=[_o__c0]): rowcount = 1.0E8,
cumulative cost = {1.0E8 rows, 1.0E8 cpu, 0.0 io, 0.0 network, 0.0 memory}, id
= 4276
FlinkLogicalCalc(subset=[rel#4275:RelSubset#7.LOGICAL.any.None:
0.[NONE].[NONE]], select=[CASE(IS NULL($f1), 0:BIGINT, $f1) AS _o__c0]):
rowcount = 1.0E8, cumulative cost = {1.0E8 rows, 1.0E8 cpu, 0.0 io, 0.0
network, 0.0 memory}, id = 4288
FlinkLogicalJoin(subset=[rel#4272:RelSubset#6.LOGICAL.any.None:
0.[NONE].[NONE]], condition=[=($0, $1)], joinType=[left]): rowcount = 1.0E8,
cumulative cost = {1.0E8 rows, 1.0856463237676364E8 cpu, 4.0856463237676364E8
io, 0.0 network, 0.0 memory}, id = 4271
FlinkLogicalTableSourceScan(subset=[rel#4270:RelSubset#1.LOGICAL.any.None:
0.[NONE].[NONE]], table=[[myhive, default, bar, project=[i]]], fields=[i]):
rowcount = 1.0E8, cumulative cost = {1.0E8 rows, 1.0E8 cpu, 4.0E8 io, 0.0
network, 0.0 memory}, id = 4279
FlinkLogicalAggregate(subset=[rel#4268:RelSubset#5.LOGICAL.any.None:
0.[NONE].[NONE]], group=[{1}], agg#0=[COUNT($0)]): rowcount =
8564632.376763644, cumulative cost = {9.0E7 rows, 1.89E8 cpu, 7.2E8 io, 0.0
network, 0.0 memory}, id = 4286
FlinkLogicalCalc(subset=[rel#4283:RelSubset#3.LOGICAL.any.None:
0.[NONE].[NONE]], select=[x, y], where=[IS NOT NULL(y)]): rowcount = 9.0E7,
cumulative cost = {9.0E7 rows, 0.0 cpu, 0.0 io, 0.0 network, 0.0 memory}, id =
4282
FlinkLogicalTableSourceScan(subset=[rel#4262:RelSubset#2.LOGICAL.any.None:
0.[NONE].[NONE]], table=[[myhive, default, foo]], fields=[x, y]): rowcount =
1.0E8, cumulative cost = {1.0E8 rows, 1.0E8 cpu, 8.0E8 io, 0.0 network, 0.0
memory}, id = 4261
Sets:
Set#41, type: RecordType(INTEGER x, INTEGER y)
rel#5171:RelSubset#41.NONE.any.None: 0.[NONE].[NONE], best=null
rel#5106:LogicalTableScan.NONE.any.None:
0.[NONE].[NONE](table=[myhive, default, foo]), rowcount=1.0E8, cumulative
cost={inf}
rel#5179:RelSubset#41.LOGICAL.any.None: 0.[NONE].[NONE], best=rel#5178
rel#5178:FlinkLogicalTableSourceScan.LOGICAL.any.None:
0.[NONE].[NONE](table=[myhive, default, foo],fields=x, y), rowcount=1.0E8,
cumulative cost={1.0E8 rows, 1.0E8 cpu, 8.0E8 io, 0.0 network, 0.0 memory}
Set#42, type: RecordType(INTEGER x)
rel#5173:RelSubset#42.NONE.any.None: 0.[NONE].[NONE], best=null
rel#5172:LogicalProject.NONE.any.None:
0.[NONE].[NONE](input=RelSubset#5171,inputs=0), rowcount=1.0E8, cumulative
cost={inf}
rel#5180:LogicalTableScan.NONE.any.None:
0.[NONE].[NONE](table=[myhive, default, foo, project=[x]]), rowcount=1.0E8,
cumulative cost={inf}
rel#5182:LogicalCalc.NONE.any.None:
0.[NONE].[NONE](input=RelSubset#5171,expr#0..1={inputs},0=$t0), rowcount=1.0E8,
cumulative cost={inf}
rel#5184:RelSubset#42.LOGICAL.any.None: 0.[NONE].[NONE], best=rel#5183
rel#5183:FlinkLogicalTableSourceScan.LOGICAL.any.None:
0.[NONE].[NONE](table=[myhive, default, foo, project=[x]],fields=x),
rowcount=1.0E8, cumulative cost={1.0E8 rows, 1.0E8 cpu, 4.0E8 io, 0.0 network,
0.0 memory}
rel#5185:FlinkLogicalCalc.LOGICAL.any.None:
0.[NONE].[NONE](input=RelSubset#5179,select=x), rowcount=1.0E8, cumulative
cost={2.0E8 rows, 1.0E8 cpu, 8.0E8 io, 0.0 network, 0.0 memory}
Set#43, type: RecordType(INTEGER x)
rel#5175:RelSubset#43.NONE.any.None: 0.[NONE].[NONE], best=null
[VOTE] Release 1.13.0, release candidate #1
Hi everyone, Currently there are still some on-going efforts for 1.13.0. However we think the current state is stable enough for the community to test. The earlier the test, the more time we can fix unexpected issues if there is any. We also cut out the release-1.13 branch, so any fix needs to be submitted to both the master and release-1.13. Please review and vote on the release candidate #1 for the version 1.13.0, as follows: [ ] +1, Approve the release [ ] -1, Do not approve the release (please provide specific comments) The complete staging area is available for your review, which includes: * the official Apache source release and binary convenience releases to be deployed to dist.apache.org [1], which are signed with the key with fingerprint D7C86B9C[2], * all artifacts to be deployed to the Maven Central Repository [3], * source code tag "release-1.13.0-rc1" [4], The vote will be open for at least 72 hours. It is adopted by majority approval, with at least 3 PMC affirmative votes. Your help testing the release will be greatly appreciated! [1] https://dist.apache.org/repos/dist/dev/flink/flink-1.13.0-rc1/ [2] https://dist.apache.org/repos/dist/release/flink/KEYS [3] https://repository.apache.org/content/repositories/orgapacheflink-1418/ [4] https://github.com/apache/flink/tree/release-1.13.0-rc1 Best, Guowei
