Re: [DISCUSS] Bump required Maven version to 3.1.1 (from 3.0.3)

2019-04-26 Thread vino yang
Hi Robert, +1 for your proposal. Best, Vino Robert Metzger 于2019年4月26日周五 下午9:43写道: > Hey, > > I recently merged the new Flink UI [1]. After merging it, I was made aware > that the frontend-maven-plugin requires at least Maven 3.1.0. > There was a discussion about bumping the maven version

Re: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-04-26 Thread vino yang
Hi Elias, I agree with your opinion that "*Flink jobs don't sufficiently meet these requirements to work as a replacement for a data store.*". Actually, I think it's obviously not Flink's goal. If we think that the database contains the main two parts(inexactitude): data query and data store.

Re: [DISCUSS] Improve Queryable State and introduce aQueryServerProxy component

2019-04-26 Thread vino yang
Hi Jiayi, Thanks for your reply and glad to hear that you have taken some effort for it, the potential contribution is also welcome. I also want to explore it in depth. Currently, let's listen to the community's opinions. Best, Vino. bupt_ljy 于2019年4月26日周五 下午9:54写道: > Hi yang, > +1 for this

申请 JIRA Contributor 权限

2019-04-26 Thread 叶问
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is yd.

[jira] [Created] (FLINK-12343) Allow set hdfs.replication in FlinkYarnSessionCli

2019-04-26 Thread Zhenqiu Huang (JIRA)
Zhenqiu Huang created FLINK-12343: - Summary: Allow set hdfs.replication in FlinkYarnSessionCli Key: FLINK-12343 URL: https://issues.apache.org/jira/browse/FLINK-12343 Project: Flink Issue

[jira] [Created] (FLINK-12342) Yarn Resource Manager Acquire Too Many Containers

2019-04-26 Thread Zhenqiu Huang (JIRA)
Zhenqiu Huang created FLINK-12342: - Summary: Yarn Resource Manager Acquire Too Many Containers Key: FLINK-12342 URL: https://issues.apache.org/jira/browse/FLINK-12342 Project: Flink Issue

Re: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-04-26 Thread Elias Levy
On Fri, Apr 26, 2019 at 1:41 AM vino yang wrote: > You are right, currently, the queryable state has few users. And I totally > agree with you, it makes the streaming works more like a DB. > Alas, I don't think queryable state will really be used much in production other than for ad hoc queries

[jira] [Created] (FLINK-12341) Add CLI command for rescaling

2019-04-26 Thread Gary Yao (JIRA)
Gary Yao created FLINK-12341: Summary: Add CLI command for rescaling Key: FLINK-12341 URL: https://issues.apache.org/jira/browse/FLINK-12341 Project: Flink Issue Type: New Feature

[jira] [Created] (FLINK-12340) Cache frontend-maven-plugin npm artifacts

2019-04-26 Thread Robert Metzger (JIRA)
Robert Metzger created FLINK-12340: -- Summary: Cache frontend-maven-plugin npm artifacts Key: FLINK-12340 URL: https://issues.apache.org/jira/browse/FLINK-12340 Project: Flink Issue Type:

Re: [DISCUSS] Improve Queryable State and introduce aQueryServerProxy component

2019-04-26 Thread bupt_ljy
Hi yang, +1 for this proposal. Queryable state is a very common usage in our scenarios when we debug and query the realtime status in streaming process like CEP. And we’ve done a lot to improve the “user experience” of this feature like exposing the taskmanager’s proxy port in TaskManagerInfo.

RE: kafka partitions, data locality

2019-04-26 Thread Smirnov Sergey Vladimirovich (39833)
Hi, Dawid, great, thanks! Any plans to make it stable? 1.9? Regards, Sergey From: Dawid Wysakowicz [mailto:dwysakow...@apache.org] Sent: Thursday, April 25, 2019 10:54 AM To: Smirnov Sergey Vladimirovich (39833) ; Ken Krugler Cc: u...@flink.apache.org; dev@flink.apache.org Subject: Re: kafka

[DISCUSS] Bump required Maven version to 3.1.1 (from 3.0.3)

2019-04-26 Thread Robert Metzger
Hey, I recently merged the new Flink UI [1]. After merging it, I was made aware that the frontend-maven-plugin requires at least Maven 3.1.0. There was a discussion about bumping the maven version already last year [2]. In that thread, Stephan mentions that some Linux distributions still have

[jira] [Created] (FLINK-12339) Modify the wrong variable name of topSeed in example

2019-04-26 Thread jianlong miao (JIRA)
jianlong miao created FLINK-12339: - Summary: Modify the wrong variable name of topSeed in example Key: FLINK-12339 URL: https://issues.apache.org/jira/browse/FLINK-12339 Project: Flink Issue

[jira] [Created] (FLINK-12338) Update Apache Avro test to use try-with-resources

2019-04-26 Thread Fokko Driesprong (JIRA)
Fokko Driesprong created FLINK-12338: Summary: Update Apache Avro test to use try-with-resources Key: FLINK-12338 URL: https://issues.apache.org/jira/browse/FLINK-12338 Project: Flink

[jira] [Created] (FLINK-12337) [TableSQL/Planner] InsertInto method should configure TableSink

2019-04-26 Thread Artsem Semianenka (JIRA)
Artsem Semianenka created FLINK-12337: - Summary: [TableSQL/Planner] InsertInto method should configure TableSink Key: FLINK-12337 URL: https://issues.apache.org/jira/browse/FLINK-12337 Project:

How to let Flink 1.7.X run Flink session cluster on YARN in Java 7 default environment

2019-04-26 Thread 胡逸才
At present, all YARN clusters adopt JAVA 7 environment. While trying to use FLINK to handle the deployment of flow processing business scenarios, it was found that FLINK ON YARN mode always failed to perform a session task. The application log of YARN shows Unsupported major. minor version

[jira] [Created] (FLINK-12336) Handle HTTPS InfluxDB database

2019-04-26 Thread Etienne Carriere (JIRA)
Etienne Carriere created FLINK-12336: Summary: Handle HTTPS InfluxDB database Key: FLINK-12336 URL: https://issues.apache.org/jira/browse/FLINK-12336 Project: Flink Issue Type:

[jira] [Created] (FLINK-12335) Improvement the performance of class SegmentsUtil

2019-04-26 Thread Liya Fan (JIRA)
Liya Fan created FLINK-12335: Summary: Improvement the performance of class SegmentsUtil Key: FLINK-12335 URL: https://issues.apache.org/jira/browse/FLINK-12335 Project: Flink Issue Type:

Containers are not released after job failed

2019-04-26 Thread 刘建刚
I run flink 1.6.2 on yarn. At some time, job is failed becuase of: org.apache.flink.util.FlinkException: The assigned slot container_e708_1555051789618_2644286_01_61_0 was removed Then the job restarts. After some time, the container container_e708_1555051789618_2644286_01_61

Re: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-04-26 Thread vino yang
Hi Paul, Thanks for your reply. You are right, currently, the queryable state has few users. And I totally agree with you, it makes the streaming works more like a DB. About the architecture and the problem you concern: yes, it maybe affect the JobManager if they are deployed together. I think

Re: kafka partitions, data locality

2019-04-26 Thread Stefan Richter
Hi Sergey, The point why this I flagged as beta is actually less about stability but more about the fact that this is supposed to be more of a "power user" feature because bad things can happen if your data is not 100% correctly partitioned in the same way as Flink would partition it. This is

Re: [DISCUSS] Improve Queryable State and introduce a QueryServerProxy component

2019-04-26 Thread Paul Lam
Hi Vino, Thanks a lot for bringing up the discussion! Queryable state has been at beta version for a long time, and due to its complexity and instability I think there are not many users, but there’s a great value in it which makes state as database one step closer. WRT the architecture, I’d