[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Ge updated FLINK-20036: Fix Version/s: 1.19.0 (was: 1.18.0) > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.19.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-20036: - Fix Version/s: 1.18.0 (was: 1.17.0) > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.18.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Godfrey He updated FLINK-20036: --- Fix Version/s: 1.17.0 (was: 1.16.0) > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.17.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yun Gao updated FLINK-20036: Fix Version/s: 1.16.0 > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.15.0, 1.16.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.20.1#820001)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xintong Song updated FLINK-20036: - Fix Version/s: (was: 1.14.0) 1.15.0 > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.15.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-20036: --- Labels: auto-deprioritized-major (was: stale-major) Priority: Minor (was: Major) This issue was labeled "stale-major" 7 ago and has not received any updates so it is being deprioritized. If this ticket is actually Major, please raise the priority and ask a committer to assign you the issue or revive the public discussion. > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Minor > Labels: auto-deprioritized-major > Fix For: 1.14.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Flink Jira Bot updated FLINK-20036: --- Labels: stale-major (was: ) I am the [Flink Jira Bot|https://github.com/apache/flink-jira-bot/] and I help the community manage its development. I see this issues has been marked as Major but is unassigned and neither itself nor its Sub-Tasks have been updated for 30 days. I have gone ahead and added a "stale-major" to the issue". If this ticket is a Major, please either assign yourself or give an update. Afterwards, please remove the label or in 7 days the issue will be deprioritized. > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Major > Labels: stale-major > Fix For: 1.14.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-20036: Fix Version/s: (was: 1.13.0) 1.14.0 > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Major > Fix For: 1.14.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-20036: Fix Version/s: (was: 1.12.0) 1.13.0 > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Bug > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Major > Fix For: 1.13.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-20036: Issue Type: Improvement (was: Bug) > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Improvement > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Major > Fix For: 1.13.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (FLINK-20036) Join Has NoUniqueKey when using mini-batch
[ https://issues.apache.org/jira/browse/FLINK-20036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jark Wu updated FLINK-20036: Fix Version/s: 1.12.0 > Join Has NoUniqueKey when using mini-batch > -- > > Key: FLINK-20036 > URL: https://issues.apache.org/jira/browse/FLINK-20036 > Project: Flink > Issue Type: Bug > Components: Table SQL / Planner >Affects Versions: 1.11.2 >Reporter: Rex Remind >Priority: Major > Fix For: 1.12.0 > > > Hello, > > We tried out mini-batch mode and our Join suddenly had NoUniqueKey. > Join: > {code:java} > Table membershipsTable = tableEnv.from(SOURCE_MEMBERSHIPS) > .renameColumns($("id").as("membership_id")) > .select($("*")).join(usersTable, $("user_id").isEqual($("id"))); > {code} > Mini-batch config: > {code:java} > configuration.setString("table.exec.mini-batch.enabled", "true"); // enable > mini-batch optimization > configuration.setString("table.exec.mini-batch.allow-latency", "5 s"); // use > 5 seconds to buffer input records > configuration.setString("table.exec.mini-batch.size", "5000"); // the maximum > number of records can be buffered by each aggregate operator task > {code} > > Join with mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, > group_id, user_id, uuid, owner, id0, deleted_at], > leftInputSpec=[NoUniqueKey], rightInputSpec=[NoUniqueKey]) > {code} > Join without mini-batch: > {code:java} > Join(joinType=[InnerJoin], where=[(user_id = id0)], select=[id, group_id, > user_id, uuid, owner, id0, deleted_at], leftInputSpec=[HasUniqueKey], > rightInputSpec=[JoinKeyContainsUniqueKey]) > {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)