Re: [DISCUSS] Create a Flink ecosystem website

2019-04-24 Thread Becket Qin
Thanks for the update, Robert. Looking forward to the website. If there is already a list of software we need to run the website, we can ask Apache infra team to prepare the VM for us, as that may also take some time. On Wed, Apr 24, 2019 at 11:57 PM Robert Metzger wrote: > Hey all, > > quick up

[jira] [Created] (FLINK-12329) Netty thread deadlock bug of the SpilledSubpartitionView

2019-04-24 Thread Yingjie Cao (JIRA)
Yingjie Cao created FLINK-12329: --- Summary: Netty thread deadlock bug of the SpilledSubpartitionView Key: FLINK-12329 URL: https://issues.apache.org/jira/browse/FLINK-12329 Project: Flink Issue

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-24 Thread jincheng sun
Hi Robert, In addition to the questions described by Dian, I also want to know what difficult problems Py4j's solution will encounter in add UDF support, which you mentioned as follows: Using something like Py4j is an easy way to get up an running, especially > for a very faithful API, but the in

Apply for contributor permission

2019-04-24 Thread Shi Quan
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is quan Best regards

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-24 Thread Dian Fu
Thanks everyone for the discussion here. Regarding to the Java/Scala UDF and the built-in UDF to execute in the current Flink way (directly in JVM, not via RPC), I share the same thoughts with Max and Robert and I think it will not be a big problem. From the design doc, I guess the main reason

[jira] [Created] (FLINK-12328) Invalid Express

2019-04-24 Thread chauncy (JIRA)
chauncy created FLINK-12328: --- Summary: Invalid Express Key: FLINK-12328 URL: https://issues.apache.org/jira/browse/FLINK-12328 Project: Flink Issue Type: Improvement Affects Versions: 1.8.0

JIRA Contributor Permission Application

2019-04-24 Thread 张俸铭
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is zm12397. I would like to thank you for your generous help in this matter.

[jira] [Created] (FLINK-12327) Add simplicity support for submitting Python Table API job in CliFrontend, i.e. `flink run -py wordcount.py` can be work(with simple test).

2019-04-24 Thread sunjincheng (JIRA)
sunjincheng created FLINK-12327: --- Summary: Add simplicity support for submitting Python Table API job in CliFrontend, i.e. `flink run -py wordcount.py` can be work(with simple test). Key: FLINK-12327 URL: https://i

[jira] [Created] (FLINK-12326) Add a basic test framework, just like the existing Java TableAPI, abstract some TestBase.

2019-04-24 Thread sunjincheng (JIRA)
sunjincheng created FLINK-12326: --- Summary: Add a basic test framework, just like the existing Java TableAPI, abstract some TestBase. Key: FLINK-12326 URL: https://issues.apache.org/jira/browse/FLINK-12326

[jira] [Created] (FLINK-12325) Statsd reporter gives wrong metrics when using negative numbers

2019-04-24 Thread Richard Deurwaarder (JIRA)
Richard Deurwaarder created FLINK-12325: --- Summary: Statsd reporter gives wrong metrics when using negative numbers Key: FLINK-12325 URL: https://issues.apache.org/jira/browse/FLINK-12325 Project

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-24 Thread Robert Bradshaw
Thanks for the meeting summary, Stephan. Sound like you covered a lot of ground. Some more comments below, adding onto what Max has said. On Wed, Apr 24, 2019 at 3:20 PM Maximilian Michels wrote: > > Hi Stephan, > > This is excited! Thanks for sharing. The inter-process communication > code looks

[jira] [Created] (FLINK-12324) Remove ActorGateway interface

2019-04-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-12324: - Summary: Remove ActorGateway interface Key: FLINK-12324 URL: https://issues.apache.org/jira/browse/FLINK-12324 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] Create a Flink ecosystem website

2019-04-24 Thread Robert Metzger
Hey all, quick update on this project: The frontend and backend code have been put together into this repository: https://github.com/sorahn/flink-ecosystem We also just agreed on an API specification, and will now work on finishing the backend. It will probably take a few more weeks for this to f

Re: Contribute to Flink

2019-04-24 Thread Robert Metzger
Hi, I gave you the permission. On Wed, Apr 17, 2019 at 2:58 PM QingA Li wrote: > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is moqi. >

Re: Request for JIRA Contributor Permission

2019-04-24 Thread Robert Metzger
Hi, I gave you the permissions. On Wed, Apr 17, 2019 at 3:18 PM DONG, Weike wrote: > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > > My JIRA ID is kyledong > > Thanks : ) >

Re: Apply for contributor permission

2019-04-24 Thread Robert Metzger
Hi, I gave you the permissions. On Thu, Apr 18, 2019 at 5:05 PM peng2251 wrote: > Hi, > > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is TonySu. > Thanks.

Re: Apply for contributor permission

2019-04-24 Thread Robert Metzger
Hi, I gave you the permission. On Sat, Apr 20, 2019 at 12:24 PM Dillon Zhang wrote: > Hi, > > I've been interested in flink for a long time and have worked on a few > internal features mainly in flink-runtime. > > I'd like to apply for contributor permission so that I could join feature > develo

Re: Apply for contributor permission

2019-04-24 Thread Robert Metzger
Hi, I gave you the permission. On Mon, Apr 22, 2019 at 12:45 PM 张军 wrote: > Hi, > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is zhangjun > Thanks.

Re: I want to apply Flink JIRA contributor

2019-04-24 Thread Robert Metzger
Hi, I gave you the permission. On Mon, Apr 22, 2019 at 12:57 PM Armstrong wrote: > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is Armstrongya. >

Re: contributor

2019-04-24 Thread Robert Metzger
Hi, I gave you the permission. On Wed, Apr 24, 2019 at 12:42 PM cc c wrote: > Hi, > > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is chauncy >

Re: Contributor permission Request

2019-04-24 Thread Robert Metzger
Hi, Welcome to the Flink community. I gave you the permissions. On Wed, Apr 24, 2019 at 2:28 PM Sean Mao wrote: > Hi, > I want to contribute to Apache Flink. > Would you please give me the contributor permission? > My JIRA ID is seancxmao ( > https://issues.apache.org/jira/secure/ViewProfile.jsp

[jira] [Created] (FLINK-12323) Remove legacy ActorGateway implementations

2019-04-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-12323: - Summary: Remove legacy ActorGateway implementations Key: FLINK-12323 URL: https://issues.apache.org/jira/browse/FLINK-12323 Project: Flink Issue Type: Sub-

[jira] [Created] (FLINK-12322) Remove legacy ActorTaskManagerGateway

2019-04-24 Thread Till Rohrmann (JIRA)
Till Rohrmann created FLINK-12322: - Summary: Remove legacy ActorTaskManagerGateway Key: FLINK-12322 URL: https://issues.apache.org/jira/browse/FLINK-12322 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12321) Supports sub-plan reuse

2019-04-24 Thread godfrey he (JIRA)
godfrey he created FLINK-12321: -- Summary: Supports sub-plan reuse Key: FLINK-12321 URL: https://issues.apache.org/jira/browse/FLINK-12321 Project: Flink Issue Type: Bug Components: Tab

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-24 Thread Maximilian Michels
Hi Stephan, This is excited! Thanks for sharing. The inter-process communication code looks like the most natural choice as a common ground. To go further, there are indeed some challenges to solve. => Biggest question is whether the language-independent DAG is expressive enough to capture

[jira] [Created] (FLINK-12320) Flink bucketing sink restart with save point cause data loss when using SequenceFile.CompressionType.BLOCK

2019-04-24 Thread shin chen (JIRA)
shin chen created FLINK-12320: - Summary: Flink bucketing sink restart with save point cause data loss when using SequenceFile.CompressionType.BLOCK Key: FLINK-12320 URL: https://issues.apache.org/jira/browse/FLINK-123

[jira] [Created] (FLINK-12319) StackOverFlowError in cep.nfa.sharedbuffer.SharedBuffer

2019-04-24 Thread Marco Pfatschbacher (JIRA)
Marco Pfatschbacher created FLINK-12319: --- Summary: StackOverFlowError in cep.nfa.sharedbuffer.SharedBuffer Key: FLINK-12319 URL: https://issues.apache.org/jira/browse/FLINK-12319 Project: Flink

Contributor permission Request

2019-04-24 Thread Sean Mao
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is seancxmao ( https://issues.apache.org/jira/secure/ViewProfile.jspa?name=seancxmao) Thanks, Chenxiao Mao

Re: [DISCUSS] Temporarily remove support for job rescaling via CLI action "modify"

2019-04-24 Thread Gary Yao
The idea is to also remove the rescaling code in the JobMaster. This will make it easier to remove the ExecutionGraph reference from the JobMaster which is needed for the scheduling rework [1]. [1] https://issues.apache.org/jira/browse/FLINK-12231 On Wed, Apr 24, 2019 at 12:14 PM Shuai Xu wrote:

Re: [DISCUSS] FLIP-33: Standardize connector metrics

2019-04-24 Thread Stephan Ewen
I think this sounds reasonable. Let's keep the "reconfiguration without stopping the job" out of this, because that would be a super big effort and if we approach that, then in more generic way rather than specific to connector metrics. I would suggest to look at the following things before start

contributor

2019-04-24 Thread cc c
Hi, I want to contribute to Apache Flink. Would you please give me the contributor permission? My JIRA ID is chauncy

Re: [DISCUSS] Temporarily remove support for job rescaling via CLI action "modify"

2019-04-24 Thread Shuai Xu
Will we only remove command support in client side or the code in job master will also be removed? Till Rohrmann 于2019年4月24日周三 下午4:12写道: > +1 for temporarily removing support for the modify command. > > Eventually, we have to add it again in order to support auto scaling. The > next time we add

[jira] [Created] (FLINK-12318) TimestampITCase deadlocks on Java 9

2019-04-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12318: Summary: TimestampITCase deadlocks on Java 9 Key: FLINK-12318 URL: https://issues.apache.org/jira/browse/FLINK-12318 Project: Flink Issue Type: Sub-t

[jira] [Created] (FLINK-12317) SynchronousCheckpointITCase fails on Java 9

2019-04-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12317: Summary: SynchronousCheckpointITCase fails on Java 9 Key: FLINK-12317 URL: https://issues.apache.org/jira/browse/FLINK-12317 Project: Flink Issue Typ

[jira] [Created] (FLINK-12316) JDBCFullTest fails on Java 9

2019-04-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12316: Summary: JDBCFullTest fails on Java 9 Key: FLINK-12316 URL: https://issues.apache.org/jira/browse/FLINK-12316 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-12315) SynchronousCheckpointITCase deadlocks on Travis

2019-04-24 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-12315: Summary: SynchronousCheckpointITCase deadlocks on Travis Key: FLINK-12315 URL: https://issues.apache.org/jira/browse/FLINK-12315 Project: Flink Issue

[jira] [Created] (FLINK-12314) Translate "Types Serializationn" into Chinese

2019-04-24 Thread YangFei (JIRA)
YangFei created FLINK-12314: --- Summary: Translate "Types Serializationn" into Chinese Key: FLINK-12314 URL: https://issues.apache.org/jira/browse/FLINK-12314 Project: Flink Issue Type: Sub-task

Re: [DISCUSS] A more restrictive JIRA workflow

2019-04-24 Thread vino yang
also +1 for option 2. I think auto-close a PR sometimes a bit impertinency. The reasons just like Stephan mentioned. Stephan Ewen 于2019年4月24日周三 下午4:08写道: > About auto-closing PRs from unassigned issues, consider the following case > that has happened quite a bit. > > - a user reports a small

Re: [DISCUSS] FLIP-38 Support python language in flink TableAPI

2019-04-24 Thread jincheng sun
Hi Stephan, Thanks for your summary, from the points of my view, we are on the same page about the conclusion of the discussion! I completely agree that we can divide the support of the Python Table API into short-term and long-term goals, and the design of short-term goals should be smoothly upg

[jira] [Created] (FLINK-12313) SynchronousCheckpointITCase.taskCachedThreadPoolAllowsForSynchronousCheckpoints is unstable

2019-04-24 Thread Ufuk Celebi (JIRA)
Ufuk Celebi created FLINK-12313: --- Summary: SynchronousCheckpointITCase.taskCachedThreadPoolAllowsForSynchronousCheckpoints is unstable Key: FLINK-12313 URL: https://issues.apache.org/jira/browse/FLINK-12313

Re: [DISCUSS] Temporarily remove support for job rescaling via CLI action "modify"

2019-04-24 Thread Till Rohrmann
+1 for temporarily removing support for the modify command. Eventually, we have to add it again in order to support auto scaling. The next time we add it, we should address the known limitations. Cheers, Till On Wed, Apr 24, 2019 at 9:06 AM Paul Lam wrote: > Hi Gary, > > + 1 to remove it for n

Re: [DISCUSS] A more restrictive JIRA workflow

2019-04-24 Thread Stephan Ewen
About auto-closing PRs from unassigned issues, consider the following case that has happened quite a bit. - a user reports a small bug and immediately wants to provide a fix for it - it makes sense to not stall the user for a few days until a committer assigned the issue - not auto-closing t

[jira] [Created] (FLINK-12312) Remove CLI command for rescaling

2019-04-24 Thread Gary Yao (JIRA)
Gary Yao created FLINK-12312: Summary: Remove CLI command for rescaling Key: FLINK-12312 URL: https://issues.apache.org/jira/browse/FLINK-12312 Project: Flink Issue Type: Sub-task Compo

Re: [DISCUSS] A more restrictive JIRA workflow

2019-04-24 Thread Stephan Ewen
+1 for option #2 Seems to me that this does not contradict option #1, it only extends this a bit. I think there is a good case for that, to help frequent contributors on a way to committership. @Konstantin: Trivial fixes (typos, docs, javadocs, ...) should still be possible as "hotfixes". On Mon

[jira] [Created] (FLINK-12311) Add base python framework and Add Scan, Projection, and Filter operator support

2019-04-24 Thread sunjincheng (JIRA)
sunjincheng created FLINK-12311: --- Summary: Add base python framework and Add Scan, Projection, and Filter operator support Key: FLINK-12311 URL: https://issues.apache.org/jira/browse/FLINK-12311 Project

[jira] [Created] (FLINK-12310) shade user facing common libraries in flink-connector-hive

2019-04-24 Thread Bowen Li (JIRA)
Bowen Li created FLINK-12310: Summary: shade user facing common libraries in flink-connector-hive Key: FLINK-12310 URL: https://issues.apache.org/jira/browse/FLINK-12310 Project: Flink Issue Type

Re: Flink connectors to Oracle Cloud Infrastructure services

2019-04-24 Thread Becket Qin
Hi Mikhail, Thanks a lot for being interested in contributing! Connectors are crucial to Flink ecosystem, the contribution is more than welcome. Right now there are some ongoing changes to the way we manage Flink connectors. The basic idea is to maintain the connectors separately from the Flink c

Re: [DISCUSS] Temporarily remove support for job rescaling via CLI action "modify"

2019-04-24 Thread Paul Lam
Hi Gary, + 1 to remove it for now. Actually some users are not aware of that it’s still experimental, and ask quite a lot about the problem it causes. Best, Paul Lam > 在 2019年4月24日,14:49,Stephan Ewen 写道: > > Sounds reasonable to me. If it is a broken feature, then there is not much > value i