Bowen Li created FLINK-17392:
--------------------------------
Summary: enable configuring minicluster in Flink SQL in IDE
Key: FLINK-17392
URL: https://issues.apache.org/jira/browse/FLINK-17392
Project: Flink
Issue Type: Improvement
Components: Table SQL / API
Affects Versions: 1.11.0
Reporter: Bowen Li
Assignee: Kurt Young
Fix For: 1.11.0
It's very common case that users who want to learn and test Flink SQL will try
to run a SQL job in IDE like Intellij, with Flink minicluster. Currently it's
fine to do so with a simple job requiring only one task slot, which is the
default resource config of minicluster.
However, users cannot run even a little bit more complicated job since they
cannot configure task slots of minicluster thru Flink SQL, e.g. single
parallelism job requires shuffle. This incapability has been very frustrating
to new users.
There are two solutions to this problem:
- in minicluster, if it is single parallelism job, then chain all operators
together
- enable configuring minicluster in Flink SQL in IDE.
The latter feels more proper.
Expected: users can configure minicluster resources via either SQL ("set
...=...") or TableEnvironment ("tEnv.setMiniclusterResources(..., ...)").
[~jark] [~lzljs3620320]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
