Re: Need guidance for write a client connector for 'Flink'

Hi Fabian, Thanks for providing those information. On Mon, Jan 16, 2017 at 2:36 PM, Fabian Hueske wrote: > Hi Pawan, > > this sounds like you need to implement a custom InputFormat [1]. > An InputFormat is basically executed in two phases. In the first phase it > generates

Re: Need guidance for write a client connector for 'Flink'

Hi Pawan, this sounds like you need to implement a custom InputFormat [1]. An InputFormat is basically executed in two phases. In the first phase it generates InputSplits. An InputSplit references a a chunk of data that needs to be read. Hence, InputSplits define how the input data is split to be

[jira] [Created] (FLINK-5501) Determine whether the job starts from last JobManager failure

Zhijiang Wang created FLINK-5501: Summary: Determine whether the job starts from last JobManager failure Key: FLINK-5501 URL: https://issues.apache.org/jira/browse/FLINK-5501 Project: Flink

Flink Code Base Best Practices

Hey all, I've just created a Wiki page with a loose collection of some coding "best practices" for the Flink project. The list was the result of a discussion with other PMCs, committers, and contributors. It is not a set of enforced rules, but a general list of tips, links to Flink utilities,

Re: Taking time off

Hi Max, thank you for all your work! Enjoy your time off and hope to have you back with us soon ^^ Cheers, -Vasia. On 14 January 2017 at 09:03, Maximilian Michels wrote: > Dear Squirrels, > > Thank you! It's been very exciting to see the Flink community grow and > flourish

Re: 答复: [DISCUSS] Apache Flink 1.2.0 RC0 (Non-voting testing release candidate)

A user reported that outer joins on the Table API and SQL compute wrong results: https://issues.apache.org/jira/browse/FLINK-5498 2017-01-15 20:23 GMT+01:00 Till Rohrmann : > I found two problematic issues with Mesos HA mode which breaks it: > >

[jira] [Created] (FLINK-5504) mesos-appmaster.sh logs to wrong directory

Till Rohrmann created FLINK-5504: Summary: mesos-appmaster.sh logs to wrong directory Key: FLINK-5504 URL: https://issues.apache.org/jira/browse/FLINK-5504 Project: Flink Issue Type: Bug

[DISCUSS] (Not) tagging reviewers

Hi! I have seen that recently many pull requests designate reviews by writing "@personA review please" or so. I am personally quite strongly against that, I think it hurts the community work: - The same few people get usually "designated" and will typically get overloaded and often not do the

[jira] [Created] (FLINK-5507) remove queryable list state sink

Nico Kruber created FLINK-5507: -- Summary: remove queryable list state sink Key: FLINK-5507 URL: https://issues.apache.org/jira/browse/FLINK-5507 Project: Flink Issue Type: Improvement

Re: [DISCUSS] (Not) tagging reviewers

On 16 January 2017 at 12:59:04, Paris Carbone (par...@kth.se) wrote: > > Though, when someone has started reviewing a PR and shows interest > it probably makes sense to finish doing so. Wouldn’t tagging > be acceptable there? > In those case tagging triggers direct notifications, so that >

[jira] [Created] (FLINK-5502) Add documentation about migrating from 1.1 to 1.2

Kostas Kloudas created FLINK-5502: - Summary: Add documentation about migrating from 1.1 to 1.2 Key: FLINK-5502 URL: https://issues.apache.org/jira/browse/FLINK-5502 Project: Flink Issue

[jira] [Created] (FLINK-5505) Rename recovery.zookeeper.path.mesos-workers into high-availability.zookeeper.path.mesos-workers

Till Rohrmann created FLINK-5505: Summary: Rename recovery.zookeeper.path.mesos-workers into high-availability.zookeeper.path.mesos-workers Key: FLINK-5505 URL: https://issues.apache.org/jira/browse/FLINK-5505

Re: Flink CEP development is stalling

Hi Ivan! Thank you for bringing this thread up. I agree, we need to do something about how some modules are currently handled. The CEP library definitely needs more active committers. Adding new committers will be necessary, I think, but as you mentioned, it needs at least one (better more)

[jira] [Created] (FLINK-5503) mesos-appmaster.sh script could print return value message

Till Rohrmann created FLINK-5503: Summary: mesos-appmaster.sh script could print return value message Key: FLINK-5503 URL: https://issues.apache.org/jira/browse/FLINK-5503 Project: Flink

Re: [DISCUSS] (Not) tagging reviewers

Thanks for bringing this up Stephan. I completely agree with you. Cheers, Fabian 2017-01-16 12:42 GMT+01:00 Stephan Ewen : > Hi! > > I have seen that recently many pull requests designate reviews by writing > "@personA review please" or so. > > I am personally quite strongly

Re: [DISCUSS] (Not) tagging reviewers

I also agree with all the points, especially when it comes to new PRs. Though, when someone has started reviewing a PR and shows interest it probably makes sense to finish doing so. Wouldn’t tagging be acceptable there? In those case tagging triggers direct notifications, so that people already

[jira] [Created] (FLINK-5506) Java 8 - CommunityDetection.java:158 - java.lang.NullPointerException

Miguel Carvalho Valente Esaguy Coimbra created FLINK-5506: - Summary: Java 8 - CommunityDetection.java:158 - java.lang.NullPointerException Key: FLINK-5506 URL:

Re: Flink Code Base Best Practices

Very nice, thanks Ufuk! On Mon, Jan 16, 2017 at 12:05 PM, Ufuk Celebi wrote: > Hey all, > > I've just created a Wiki page with a loose collection of some coding > "best practices" for the Flink project. The list was the result of a > discussion with other PMCs, committers,

[jira] [Created] (FLINK-5510) Replace Scala Future with FlinkFuture in QueryableStateClient

Ufuk Celebi created FLINK-5510: -- Summary: Replace Scala Future with FlinkFuture in QueryableStateClient Key: FLINK-5510 URL: https://issues.apache.org/jira/browse/FLINK-5510 Project: Flink

Re: [DISCUSS] (Not) tagging reviewers

Thanks for the comments. @Paris - Ufuk has it right, tagging as a reminder (or just because it helps with referring to the comment from a specific reviewer) makes total sense to me, I would keep doing that. On Mon, Jan 16, 2017 at 1:36 PM, Ufuk Celebi wrote: > On 16 January

[jira] [Created] (FLINK-5509) Replace QueryableStateClient keyHashCode argument

Ufuk Celebi created FLINK-5509: -- Summary: Replace QueryableStateClient keyHashCode argument Key: FLINK-5509 URL: https://issues.apache.org/jira/browse/FLINK-5509 Project: Flink Issue Type:

Re: [DISCUSS] (Not) tagging reviewers

Hi all View from my prospective: in middle of summer - 150 PR in middle of autumn - 180 now 206. This is mix of bugfixes and improvements. I understand that work on new features important, but when small and trivial fixes stay in states of PR more then 2-3 month, then all users think about

[jira] [Created] (FLINK-5508) Remove Mesos dynamic class loading

Till Rohrmann created FLINK-5508: Summary: Remove Mesos dynamic class loading Key: FLINK-5508 URL: https://issues.apache.org/jira/browse/FLINK-5508 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-5511) Add support for outer joins with local predicates

lincoln.lee created FLINK-5511: -- Summary: Add support for outer joins with local predicates Key: FLINK-5511 URL: https://issues.apache.org/jira/browse/FLINK-5511 Project: Flink Issue Type:

[jira] [Created] (FLINK-5513) Remove relocation of internal API classes

Till Rohrmann created FLINK-5513: Summary: Remove relocation of internal API classes Key: FLINK-5513 URL: https://issues.apache.org/jira/browse/FLINK-5513 Project: Flink Issue Type:

Re: Flink Code Base Best Practices

Ufuk, Thanks a lot for noting down all those "good to know" and sharing them to the community. On Mon, Jan 16, 2017 at 7:05 PM, Ufuk Celebi wrote: > Hey all, > > I've just created a Wiki page with a loose collection of some coding > "best practices" for the Flink project. The

[jira] [Created] (FLINK-5514) Implement an efficient physical execution for CUBE/ROLLUP/GROUPING SETS

Timo Walther created FLINK-5514: --- Summary: Implement an efficient physical execution for CUBE/ROLLUP/GROUPING SETS Key: FLINK-5514 URL: https://issues.apache.org/jira/browse/FLINK-5514 Project: Flink

RE: [DISCUSS] (Not) tagging reviewers

Hi, Alexey I will check abandoned PRs to reduce obviously outdated ones and add them to a cleanup list https://issues.apache.org/jira/browse/FLINK-5384 -Original Message- From: Alexey Demin [mailto:diomi...@gmail.com] Sent: Monday, January 16, 2017 5:05 PM To: dev@flink.apache.org

[jira] [Created] (FLINK-5515) fix unused kvState.getSerializedValue call in KvStateServerHandler

Nico Kruber created FLINK-5515: -- Summary: fix unused kvState.getSerializedValue call in KvStateServerHandler Key: FLINK-5515 URL: https://issues.apache.org/jira/browse/FLINK-5515 Project: Flink

[jira] [Created] (FLINK-5518) HadoopInputFormat throws NPE when close() is called before open()

Jakub Havlik created FLINK-5518: --- Summary: HadoopInputFormat throws NPE when close() is called before open() Key: FLINK-5518 URL: https://issues.apache.org/jira/browse/FLINK-5518 Project: Flink

[jira] [Created] (FLINK-5519) scala-maven-plugin version all change to 3.2.2

shijinkui created FLINK-5519: Summary: scala-maven-plugin version all change to 3.2.2 Key: FLINK-5519 URL: https://issues.apache.org/jira/browse/FLINK-5519 Project: Flink Issue Type: Improvement

答复: States split over to external storage

Dear Chen Qin: I am liuxinchun, and email is liuxinc...@huawei.com ( the email address in the "Copy To" is wrong). I have leave a message in FLINK-4266 using name SyinChwun Leo. We meet the similar problem in the applications. I hope we can develop this feature together. The following is my

[jira] [Created] (FLINK-5520) Disable outer joins with non-equality predicates

Fabian Hueske created FLINK-5520: Summary: Disable outer joins with non-equality predicates Key: FLINK-5520 URL: https://issues.apache.org/jira/browse/FLINK-5520 Project: Flink Issue Type:

[Dev] Dependencies issue related to implementing InputFormat Interface

Hi, I'm currently working on Flink InputFormat Interface implementation. I'm writing a java program to read data from a file using InputputFormat Interface. I used maven project and I have added following dependencies to the pom.xml. org.apache.flink flink-core

States split over to external storage

Hi there, I would like to discuss split over local states to external storage. The use case is NOT another external state backend like HDFS, rather just to expand beyond what local disk/ memory can hold when large key space exceeds what task managers could handle. Realizing FLINK-4266 might be

[jira] [Created] (FLINK-5516) Hardcoded paths in flink-python

Felix seibert created FLINK-5516: Summary: Hardcoded paths in flink-python Key: FLINK-5516 URL: https://issues.apache.org/jira/browse/FLINK-5516 Project: Flink Issue Type: Improvement

Re: Flink CEP development is stalling

Hi Stephan! Thank you for your answer. I appreciate your efforts and I know how busy you and other Flink committers are. I am looking forward for the upcoming discussion of Flink modules! Best regards, Ivan. On Mon, 16 Jan 2017 at 11:32 Stephan Ewen wrote: > Hi Ivan! > >

[jira] [Created] (FLINK-5517) Upgrade hbase version to 1.3.0

Ted Yu created FLINK-5517: - Summary: Upgrade hbase version to 1.3.0 Key: FLINK-5517 URL: https://issues.apache.org/jira/browse/FLINK-5517 Project: Flink Issue Type: Improvement Reporter: