[jira] [Created] (FLINK-19664) Upload logs before end to end tests time out

2020-10-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19664: -- Summary: Upload logs before end to end tests time out Key: FLINK-19664 URL: https://issues.apache.org/jira/browse/FLINK-19664 Project: Flink Issue Type

[jira] [Created] (FLINK-19658) Local recovery and sticky scheduling end-to-end test hangs with "Expected to find info here."

2020-10-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19658: -- Summary: Local recovery and sticky scheduling end-to-end test hangs with "Expected to find info here." Key: FLINK-19658 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-19657) YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents: netty failed with java.io.IOException: Broken pipe

2020-10-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19657: -- Summary: YARNSessionCapacitySchedulerITCase.checkForProhibitedLogContents: netty failed with java.io.IOException: Broken pipe Key: FLINK-19657 URL: https://issues.apache.org

[jira] [Created] (FLINK-19635) HBaseConnectorITCase.testTableSourceSinkWithDDL is unstable with a result mismatch

2020-10-14 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19635: -- Summary: HBaseConnectorITCase.testTableSourceSinkWithDDL is unstable with a result mismatch Key: FLINK-19635 URL: https://issues.apache.org/jira/browse/FLINK-19635

Re: [DISCUSS][Release 1.12] Stale blockers and build instabilities

2020-10-12 Thread Robert Metzger
sues.apache.org/jira/browse/FLINK-19340> > AggregateITCase.testListAggWithDistinct failed with "expected: 2,B, 3,C#A, 4,EF)> but was:" > - HBase connector >https://issues.apache.org/jira/browse/FLINK-18570 < > https://issues.apache.org/jira/browse/FLINK-18570&g

[jira] [Created] (FLINK-19585) UnalignedCheckpointCompatibilityITCase.test:97->runAndTakeSavepoint

2020-10-12 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19585: -- Summary: UnalignedCheckpointCompatibilityITCase.test:97->runAndTakeSavepoint Key: FLINK-19585 URL: https://issues.apache.org/jira/browse/FLINK-19585 Proj

[jira] [Created] (FLINK-19552) JobManager dies with IllegalStateException SharedSlot (physical request SlotRequestId{%}) has been released

2020-10-09 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19552: -- Summary: JobManager dies with IllegalStateException SharedSlot (physical request SlotRequestId{%}) has been released Key: FLINK-19552 URL: https://issues.apache.org/jira

[jira] [Created] (FLINK-19534) build_wheels: linux failed with "ValueError: Incompatible component merge"

2020-10-08 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19534: -- Summary: build_wheels: linux failed with "ValueError: Incompatible component merge" Key: FLINK-19534 URL: https://issues.apache.org/jira/browse/F

[jira] [Created] (FLINK-19518) Duration of running job is shown as 0 in web UI

2020-10-07 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19518: -- Summary: Duration of running job is shown as 0 in web UI Key: FLINK-19518 URL: https://issues.apache.org/jira/browse/FLINK-19518 Project: Flink Issue

[ANNOUNCE] Apache flink-shaded 12.0 released

2020-10-06 Thread Robert Metzger
of the Apache Flink community who made this release possible! Regards, Robert Metzger

[RESULT][VOTE] Release flink-shaded 12.0

2020-10-05 Thread Robert Metzger
Thank you all for voting. The wait time has passed. We have the following binding +1 votes: - Chesnay - Gordon - Robert There were no -1 votes. I'll proceed with releasing flink-shaded 12.0. On Mon, Oct 5, 2020 at 1:57 PM Robert Metzger wrote: > +1 > > - Checked diffs between 1.11

[jira] [Created] (FLINK-19506) UnalignedCheckpointITCase.shouldPerformUnalignedCheckpointOnNonParallelLocalChannel: "Exceeded checkpoint tolerable failure threshold"

2020-10-05 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19506: -- Summary: UnalignedCheckpointITCase.shouldPerformUnalignedCheckpointOnNonParallelLocalChannel: "Exceeded checkpoint tolerable failure threshold" Key: FLINK-19506

Re: [VOTE] Release flink-shaded 12.0

2020-10-05 Thread Robert Metzger
es > - Built from source (mvn clean verify) > > Cheers, > Gordon > > On Mon, Oct 5, 2020, 4:33 PM Chesnay Schepler wrote: > >> +1 >> >> Checked signatures, license files, and that the listed changes are in >> the release. >> >> On 9/30/2020 4:5

[ANNOUNCE] New PMC member: Zhu Zhu

2020-10-04 Thread Robert Metzger
Hi all! I'm very happy to announce that Zhu Zhu has joined the Flink PMC! Zhu is helping the community a lot with creating and validating releases, contributing to FLIP discussions and good code contributions to the scheduler and related components. Congratulations and welcome Zhu Zhu!

[VOTE] Release flink-shaded 12.0

2020-09-30 Thread Robert Metzger
release [6]. The vote will be open for at least 72 hours. It is adopted by majority approval, with at least 3 PMC affirmative votes. Thanks, Robert Metzger [1] https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12315522=12348339 [2] https://dist.apache.org/repos/dist/dev/flink/flink-s

[jira] [Created] (FLINK-19461) yarn-sesson.sh -jm -tm arguments have no effect

2020-09-29 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19461: -- Summary: yarn-sesson.sh -jm -tm arguments have no effect Key: FLINK-19461 URL: https://issues.apache.org/jira/browse/FLINK-19461 Project: Flink Issue

[jira] [Created] (FLINK-19459) flink-dist won't build locally with newer (3.3+) maven versions

2020-09-29 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19459: -- Summary: flink-dist won't build locally with newer (3.3+) maven versions Key: FLINK-19459 URL: https://issues.apache.org/jira/browse/FLINK-19459 Project: Flink

Re: [DISCUSS] Release flink-shaded 12.0

2020-09-29 Thread Robert Metzger
It seems that we have consensus to create a flink-shaded release. I'll soon propose a RC. On Fri, Sep 25, 2020 at 9:11 AM Konstantin Knauf wrote: > +1 > > > > On Wed, Sep 23, 2020 at 9:13 AM Yu Li wrote: > > > +1 > > > > Best Regards, > > Yu > &

[jira] [Created] (FLINK-19458) ZooKeeperLeaderElectionITCase.testJobExecutionOnClusterWithLeaderChange: ZooKeeper unexpectedly modified

2020-09-29 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19458: -- Summary: ZooKeeperLeaderElectionITCase.testJobExecutionOnClusterWithLeaderChange: ZooKeeper unexpectedly modified Key: FLINK-19458 URL: https://issues.apache.org/jira/browse

[jira] [Created] (FLINK-19379) Submitting job to running YARN session fails

2020-09-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19379: -- Summary: Submitting job to running YARN session fails Key: FLINK-19379 URL: https://issues.apache.org/jira/browse/FLINK-19379 Project: Flink Issue Type

[jira] [Created] (FLINK-19378) Running "./bin/flink run" without HADOOP_CLASSPATH to submit job to running YARN session fails

2020-09-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19378: -- Summary: Running "./bin/flink run" without HADOOP_CLASSPATH to submit job to running YARN session fails Key: FLINK-19378 URL: https://issues.apache.org/jira/br

Re: [DISCUSS] Release flink-shaded 12.0

2020-09-22 Thread Robert Metzger
No concerns from my side. On Fri, Sep 18, 2020 at 8:25 AM Chesnay Schepler wrote: > Hello, > > I'd like to kickoff the next release of flink-shaded, which will contain > a bump to netty (4.1.49) and snakeyaml (1.27). > > Any concerns? Any other dependency people want upgrade for the 1.12? > >

Re: [DISCUSS][Release 1.12] Stale blockers and build instabilities

2020-09-21 Thread Robert Metzger
.org/jira/browse/FLINK-19237> (down 7 from 2 weeks ago). I have pinged people to help addressing frequent or critical issues. Best, Robert On Mon, Sep 7, 2020 at 10:37 AM Robert Metzger wrote: > Hi all, > > another two weeks have passed. We now have 5 blockers > <https://is

[jira] [Created] (FLINK-19259) Use classloader release hooks with Kinesis producer to avoid metaspace leak

2020-09-16 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19259: -- Summary: Use classloader release hooks with Kinesis producer to avoid metaspace leak Key: FLINK-19259 URL: https://issues.apache.org/jira/browse/FLINK-19259

[jira] [Created] (FLINK-19246) TableSourceITCase.testStreamScanParallelism fails on private Azure accounts

2020-09-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19246: -- Summary: TableSourceITCase.testStreamScanParallelism fails on private Azure accounts Key: FLINK-19246 URL: https://issues.apache.org/jira/browse/FLINK-19246

[jira] [Created] (FLINK-19241) Forward ClusterEntrypoint ioExecutor to ResourceManager

2020-09-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19241: -- Summary: Forward ClusterEntrypoint ioExecutor to ResourceManager Key: FLINK-19241 URL: https://issues.apache.org/jira/browse/FLINK-19241 Project: Flink

[jira] [Created] (FLINK-19219) Run JobManager initialization in a separate thread, to make it cancellable

2020-09-14 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19219: -- Summary: Run JobManager initialization in a separate thread, to make it cancellable Key: FLINK-19219 URL: https://issues.apache.org/jira/browse/FLINK-19219

[ANNOUNCE] New Apache Flink Committer - Niels Basjes

2020-09-14 Thread Robert Metzger
users and giving talks at conferences. Please join me in congratulating Niels for becoming a Flink committer! Best, Robert Metzger

Re: [VOTE] Release 1.11.2, release candidate #1

2020-09-14 Thread Robert Metzger
Thanks a lot for putting a release candidate together! +1 Checks: - Manually checked the git diff https://github.com/apache/flink/compare/release-1.11.1..release-1.11.2-rc1 - in flink-kubernetes, the shading configuration got changed, but the NOTICE file is correct (checked the shade plugin

Re: How to schedule Flink Batch Job periodically or daily

2020-09-11 Thread Robert Metzger
Hi Sunitha, (Note: You've emailed both the dev@ and user@ mailing list. Please only use the user@ mailing list for questions on how to use Flink. I'm moving the dev@ list to bcc) Flink does not have facilities for scheduling batch jobs, and there are no plans to add such a feature (this is not

[jira] [Created] (FLINK-19158) Revisit java e2e download timeouts

2020-09-07 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19158: -- Summary: Revisit java e2e download timeouts Key: FLINK-19158 URL: https://issues.apache.org/jira/browse/FLINK-19158 Project: Flink Issue Type

Re: [DISCUSS][Release 1.12] Stale blockers and build instabilities

2020-09-07 Thread Robert Metzger
> > https://issues.apache.org/jira/browse/FLINK-9992> < > > >> https://issues.apache.org/jira/browse/FLINK-9992 < > > https://issues.apache.org/jira/browse/FLINK-9992>>) > > >> FsStorageLocationReferenceTest#testEncodeAndDecode failed in CI > > >

Re: HadoopOutputFormat has issues with LocalExecutionEnvironment?

2020-09-03 Thread Robert Metzger
Hi Ken, sorry for the late reply. This could be a bug in Flink. Does the issue also occur on Flink 1.11? Have you set a breakpoint in the HadoopOutputFormat.finalizeGlobal() when running locally to validate that this method doesn't get called? What do you mean by "algorithm version 2"? Where can

Re: [ANNOUNCE] New PMC member: Dian Fu

2020-08-27 Thread Robert Metzger
Congratulations Dian! On Thu, Aug 27, 2020 at 3:09 PM Congxian Qiu wrote: > Congratulations Dian > Best, > Congxian > > > Xintong Song 于2020年8月27日周四 下午7:50写道: > > > Congratulations Dian~! > > > > Thank you~ > > > > Xintong Song > > > > > > > > On Thu, Aug 27, 2020 at 7:42 PM Jark Wu wrote: >

[jira] [Created] (FLINK-19064) HBaseRowDataInputFormat is leaking resources

2020-08-27 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19064: -- Summary: HBaseRowDataInputFormat is leaking resources Key: FLINK-19064 URL: https://issues.apache.org/jira/browse/FLINK-19064 Project: Flink Issue Type

Re: [ANNOUNCE] Weekly Community Update 2020/31-34

2020-08-27 Thread Robert Metzger
Thanks a lot for doing these updates! On Tue, Aug 25, 2020 at 10:23 PM Konstantin Knauf wrote: > Dear community, > > The "weekly" community update is back after a short summer break! This time > I've tried to cover most of what happened during the last four weeks, but I > might pick up some

Re: Next Stateful Functions Release

2020-08-27 Thread Robert Metzger
+1 to release Statefun 2.2 On Tue, Aug 25, 2020 at 2:16 PM David Anderson wrote: > Igal, > > The feature set you propose sounds great to me -- as a user I see > plenty there to get excited about. As for the feature freeze date, I > don't really have an informed opinion. > > David > > On Mon,

[jira] [Created] (FLINK-19049) TableEnvironmentImpl.executeInternal() does not wait for the final job status

2020-08-25 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19049: -- Summary: TableEnvironmentImpl.executeInternal() does not wait for the final job status Key: FLINK-19049 URL: https://issues.apache.org/jira/browse/FLINK-19049

[jira] [Created] (FLINK-19037) Introduce proper IO executor in Dispatcher

2020-08-24 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19037: -- Summary: Introduce proper IO executor in Dispatcher Key: FLINK-19037 URL: https://issues.apache.org/jira/browse/FLINK-19037 Project: Flink Issue Type

[jira] [Created] (FLINK-19012) E2E test fails with "Cannot register Closeable, this subtaskCheckpointCoordinator is already closed. Closing argument."

2020-08-21 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19012: -- Summary: E2E test fails with "Cannot register Closeable, this subtaskCheckpointCoordinator is already closed. Closing argument." Key: FLINK-19012

[jira] [Created] (FLINK-19000) Forward JobStatus.INITIALIZING timestamp to ExecutionGraph

2020-08-19 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-19000: -- Summary: Forward JobStatus.INITIALIZING timestamp to ExecutionGraph Key: FLINK-19000 URL: https://issues.apache.org/jira/browse/FLINK-19000 Project: Flink

Re: [VOTE] Release 1.10.2, release candidate #2

2020-08-17 Thread Robert Metzger
Thanks a lot for creating another release candidate! +1 (binding) - checked diff: https://github.com/apache/flink/compare/release-1.10.1...release-1.10.2-rc2 - kubernetes client was upgraded from 4.5.2 to 4.9.2 + some shading changes > verified NOTICE file with shade output - source

[ANNOUNCE] New Flink Committer: David Anderson

2020-08-12 Thread Robert Metzger
Hi everyone, On behalf of the PMC, I'm very happy to announce David Anderson as a new Apache Flink committer. David has been a Flink community member for a long time. His first commit dates back to 2016, code changes mostly involve the documentation, in particular with the recent contribution of

[jira] [Created] (FLINK-18893) Python tests fails with "AppendStreamTableSink requires that Table has only insert changes."

2020-08-11 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18893: -- Summary: Python tests fails with "AppendStreamTableSink requires that Table has only insert changes." Key: FLINK-18893 URL: https://issues.apache.org/jira/browse/F

Re: Error with Flink-Gelly, lastJobExecutionResult is null

2020-08-11 Thread Robert Metzger
Does this mean this is a valid issue? If so, we could track it as a starter issue? On Mon, Aug 3, 2020 at 10:59 AM Aljoscha Krettek wrote: > Thanks for the pointer! > > On 03.08.20 10:29, Till Rohrmann wrote: > > Hi Xia Rui, > > > > thanks for reporting this issue. I think FLINK-15116 [1]

Re: [DISCUSS][Release 1.12] Stale blockers and build instabilities

2020-08-11 Thread Robert Metzger
t;Kafka cluster did not start after 120 seconds" - FLINK-17511 <https://issues.apache.org/jira/browse/FLINK-17511> "RocksDB Memory Management end-to-end test" fails with "Current block cache usage 202123272 larger than expected memory limit 2" On Mon, Jul 27,

Re: Status of FLIPs

2020-08-10 Thread Robert Metzger
Thanks for cleaning up our Wiki. Seth and Timo: Can you check the status of the FLIPs mentioned in (3) ? On Wed, Aug 5, 2020 at 9:23 AM jincheng sun wrote: > Good job Dian! > Thank you for helping to maintain the state of FLIPs which is very > important for the community to understand the

Re: [DISCUSS] Upgrade HBase connector to 2.2.x

2020-08-10 Thread Robert Metzger
ood time to have a > "apache/flink-connectors" repository, and move both HBase 1.x and 2.x to > it. > It would also be a good place to accept the contribution of pulsar > connector and other connectors. > > Best, > Jark > > > On Fri, 7 Aug 2020 at 17:54

Re: [DISCUSS] Planning Flink 1.12

2020-08-10 Thread Robert Metzger
gt; > creating the release branch, but every coin has its two sides (smile) > > > > Best Regards, > > Yu > > > > > > On Wed, 5 Aug 2020 at 20:12, Robert Metzger wrote: > > > > > Thanks all for your opinion. > > > > > > @Chesna

Re: Adding a new "Docker Images" component to Jira

2020-08-10 Thread Robert Metzger
ker, Dockerfiles and Release System / > Docker into Docker. > > Cheers, > Till > > On Fri, Aug 7, 2020 at 12:18 PM Robert Metzger > wrote: > > Hi all, > > we now have 3 components containing the word "docker": > - Deployment / Docker > < &

[jira] [Created] (FLINK-18869) Batch SQL end-to-end test unstable due to terminated process

2020-08-10 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18869: -- Summary: Batch SQL end-to-end test unstable due to terminated process Key: FLINK-18869 URL: https://issues.apache.org/jira/browse/FLINK-18869 Project: Flink

Re: Adding a new "Docker Images" component to Jira

2020-08-07 Thread Robert Metzger
Hi all, we now have 3 components containing the word "docker": - Deployment / Docker (63 issues) - Dockerfiles

Re: [DISCUSS] Upgrade HBase connector to 2.2.x

2020-08-07 Thread Robert Metzger
ugh >> review and testing. >> >> Cheers, >> Gyula >> >> On Fri, 7 Aug 2020 at 09:30, Robert Metzger wrote: >> >>> It seems that this thead is not on dev@ anymore. Adding it back ... >>> >>> On Fri, Aug 7, 2020 at 9

Re: [DISCUSS] Upgrade HBase connector to 2.2.x

2020-08-07 Thread Robert Metzger
It seems that this thead is not on dev@ anymore. Adding it back ... On Fri, Aug 7, 2020 at 9:23 AM Robert Metzger wrote: > I would like to revive this discussion. There's a new JIRA[1] + PR[2] for > adding HBase 2 support. > > it seems that there is demand for a HBase 2 connector, a

Re: [DISCUSS] Releasing Flink 1.10.2

2020-08-07 Thread Robert Metzger
Thanks for taking care of this Zhu Zhu. The list of bugs from your list certainly justifies pushing out a bugfix release. I would propose to wait until Monday for people to speak up if they want to have a fix included in the release. Otherwise, we could create the first RC on Monday evening (China

[jira] [Created] (FLINK-18829) Remove logback-related codepaths and configuration file

2020-08-05 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18829: -- Summary: Remove logback-related codepaths and configuration file Key: FLINK-18829 URL: https://issues.apache.org/jira/browse/FLINK-18829 Project: Flink

Re: [DISCUSS] Planning Flink 1.12

2020-08-05 Thread Robert Metzger
Aug 4, 2020 at 9:46 PM Stephan Ewen wrote: > >>> > >>>> The end of October sounds good from my side, unless it collides with > >> some > >>>> holidays that affect many committers. > >>>> > >>>> Feature-wise, I believe

[jira] [Created] (FLINK-18815) AbstractCloseableRegistryTest.testClose unstable

2020-08-04 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18815: -- Summary: AbstractCloseableRegistryTest.testClose unstable Key: FLINK-18815 URL: https://issues.apache.org/jira/browse/FLINK-18815 Project: Flink Issue

Re: [DISCUSS] Planning Flink 1.12

2020-08-04 Thread Robert Metzger
the > end of October could be a candidate feature freeze date. > > Best, > Kurt > > > On Tue, Jul 28, 2020 at 2:41 AM Robert Metzger > wrote: > > > Hi all, > > > > Thanks a lot for the responses so far. I've put them into this Wiki page: > > https://

[jira] [Created] (FLINK-18787) Add a "cluster-info" command to the Flink command line client

2020-07-31 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18787: -- Summary: Add a "cluster-info" command to the Flink command line client Key: FLINK-18787 URL: https://issues.apache.org/jira/browse/FLINK-18787 Proj

[DISCUSS][Release 1.12] Stale blockers and build instabilities

2020-07-27 Thread Robert Metzger
Hi team, We would like to use this thread as a permanent thread for regularly syncing on stale blockers (need to have somebody assigned within a week and progress, or a good plan) and build instabilities (need to check if its a blocker). Recent test-instabilities: -

Re: [DISCUSS] Planning Flink 1.12

2020-07-27 Thread Robert Metzger
y > > encouraged > > > > > > > > > Prasanna kumar 于2020年7月23日周四 > 上午12:10写道: > > > > > > > Hi Flink Dev Team, > > > > > > > > Dynamic AutoScaling Based on the incoming data load would be a great > > > > featu

Re: Functions in Flick

2020-07-24 Thread Robert Metzger
Hi David, 1. Here's an example on how to deploy Stateful Functions on Kubernetes: https://github.com/apache/flink-statefun/tree/master/statefun-examples/statefun-python-k8s-example You don't need to install anything in a serverless environment for using it. 2. Since the underlying processing

Re: [DISCUSS] Adding Azure Platform Support in DataStream, Table and SQL Connectors

2020-07-24 Thread Robert Metzger
it for users. We will take time to make sure the docs and tests > for the connectors are solid and then we can bring them one at a time into > the core code base. > > [1] https://github.com/apache/flink/tree/master/flink-connectors > > [2] https://issues.apache.org/jira/browse/FLINK-18

[jira] [Created] (FLINK-18697) Adding flink-table-api-java-bridge_2.11 to a Flink job kills the IDE logging

2020-07-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18697: -- Summary: Adding flink-table-api-java-bridge_2.11 to a Flink job kills the IDE logging Key: FLINK-18697 URL: https://issues.apache.org/jira/browse/FLINK-18697

[jira] [Created] (FLINK-18696) Java 14 Records are not recognized as POJOs

2020-07-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18696: -- Summary: Java 14 Records are not recognized as POJOs Key: FLINK-18696 URL: https://issues.apache.org/jira/browse/FLINK-18696 Project: Flink Issue Type

[jira] [Created] (FLINK-18685) JobClient.getAccumulators() blocks until streaming job has finished in local environment

2020-07-23 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18685: -- Summary: JobClient.getAccumulators() blocks until streaming job has finished in local environment Key: FLINK-18685 URL: https://issues.apache.org/jira/browse/FLINK-18685

Re: [DISCUSS] Adding Azure Platform Support in DataStream, Table and SQL Connectors

2020-07-23 Thread Robert Metzger
Hi Israel, thanks a lot for reaching out! I'm very excited about your efforts to bring additional Azure support into Flink. There are ~50 threads on the user@ mailing list mentioning Azure -- that's good evidence that our users use Flink in Azure. Regarding your questions: Do I need to create a

[DISCUSS] Planning Flink 1.12

2020-07-22 Thread Robert Metzger
Hi all, Now that the 1.11 release is out, it is time to plan for the next major Flink release. Some items: 1. Dian Fu and me volunteer to be the release managers for Flink 1.12. 1. Timeline: We propose to stick to our approximate 4 month release cycle, thus the release

[jira] [Created] (FLINK-18669) Remove testing-related code from production code in PubSub connector

2020-07-22 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18669: -- Summary: Remove testing-related code from production code in PubSub connector Key: FLINK-18669 URL: https://issues.apache.org/jira/browse/FLINK-18669 Project

Re: [DISCUSS] Leverage Maven Wrapper

2020-07-03 Thread Robert Metzger
dependency bundled with > separate packages), add exclusions to the shaded dependencies. (this is > essentially what the shade-plugin does for the dependency-reduced pom) > > On 03/07/2020 10:12, Robert Metzger wrote: > > I just reached out to the users@maven mailing list again to check

Re: [DISCUSS] Leverage Maven Wrapper

2020-07-03 Thread Robert Metzger
I just reached out to the users@maven mailing list again to check if there's any resolution for shading behavior post 3.2.5 [1] [1] https://lists.apache.org/thread.html/8b2dcf462de814d06d8e30bafce2c886217c5790a3ee07d33d0b8dfc%40%3Cusers.maven.apache.org%3E On Thu, Jun 4, 2020 at 3:08 PM Chesnay

Re: Moving in and Modify Dependency Source

2020-07-03 Thread Robert Metzger
ddresses this? > > > > Best + thanks again, > > Austin > > > > [1]: https://tldrlegal.com/license/apache-license-2.0-%28apache-2.0%29 > > > > On Mon, Jun 15, 2020 at 4:20 AM Robert Metzger > > wrote: > > > >> Hi Austin, > >> Th

Re: [DISCUSS] Semantics of our JIRA fields

2020-07-03 Thread Robert Metzger
Since there were no further comments on this discussion, I removed the "draft" label from the Wiki page and I consider the Jira semantics proposal agreed upon. On Mon, Jun 15, 2020 at 9:49 AM Piotr Nowojski wrote: > > > On 12 Jun 2020, at 15:44, Robert Metzger wrote: >

Re: Does FlinkKinesisConsumer not retry on NoHttpResponseException?

2020-07-03 Thread Robert Metzger
For the others on the dev@ list: I responded on SO. On Tue, Jun 16, 2020 at 7:56 AM Singh Aulakh, Karanpreet KP wrote: > Hello! > > (Apache Flink1.8 on AWS EMR release label 5.28.x) > > Our data source is an AWS Kinesis stream (with 450 shards if that > matters). We use the FlinkKinesisConsumer

Re: [DISCUSS] Drop connectors for 5.x and restart the flink es source connector

2020-07-03 Thread Robert Metzger
The discussion on dropping the ES5 connector was not conclusive, when we discussed it in February 2020. We wanted to revisit it for the 1.12 release. >From maven central, we have the following download numbers ES2: 500 downloads ES5: 10500 downloads (the es5_2.10:1.3.1 had 8000 downloads last

Re: [VOTE] Release 1.11.0, release candidate #4

2020-07-02 Thread Robert Metzger
+1 (binding) Checks: - source archive compiles - checked artifacts in staging repo - flink-azure-fs-hadoop-1.11.0.jar seems to have a correct NOTICE file - versions in pom seem correct - checked some other jars - deployed Flink on YARN on Azure HDInsight (which uses Hadoop 3.1.1) -

[jira] [Created] (FLINK-18474) Flink on YARN produces WARN log statements about the configuration

2020-07-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18474: -- Summary: Flink on YARN produces WARN log statements about the configuration Key: FLINK-18474 URL: https://issues.apache.org/jira/browse/FLINK-18474 Project

Re: [VOTE] Release 1.11.0, release candidate #4

2020-07-02 Thread Robert Metzger
urther > > debug it. Again I agree with Robert to not block the release on it at the > > moment. > > > > @Jark: How much of a problem is FLINK-18461? Will it make the CDC feature > > completely unusable or will only make a subset of the use cases to not > > wor

[jira] [Created] (FLINK-18471) flink-runtime lists "org.uncommons.maths:uncommons-maths:1.2.2a" as a bundled dependency, but it isn't

2020-07-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18471: -- Summary: flink-runtime lists "org.uncommons.maths:uncommons-maths:1.2.2a" as a bundled dependency, but it isn't Key: FLINK-18471 URL: https://issues.apache.org/j

[jira] [Created] (FLINK-18468) TaskExecutorITCase.testJobReExecutionAfterTaskExecutorTermination fails with

2020-07-02 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18468: -- Summary: TaskExecutorITCase.testJobReExecutionAfterTaskExecutorTermination fails with Key: FLINK-18468 URL: https://issues.apache.org/jira/browse/FLINK-18468

Re: [VOTE] Release 1.11.0, release candidate #4

2020-07-02 Thread Robert Metzger
Thanks a lot for the thorough testing Thomas! This is really helpful! @Chesnay: I would not block the release on this. The web submission does not seem to be the documented / preferred way of job submission. It is unlikely to harm the beginner's experience (and they would anyways not read the

Re: [ANNOUNCE] Apache Flink 1.11.0, release candidate #2

2020-06-18 Thread Robert Metzger
Thanks a lot for creating another RC. The good news first: WordCount works on my Mac :) I didn't find this information in the email: This is the commit the RC is based on: https://github.com/apache/flink/commit/c4132de4a50ab9b8f653c69af1ba15af44ff29a2 Additionally, I've created [1] a docker

[jira] [Created] (FLINK-18370) Test Flink on Azure-hosted VMs nightly

2020-06-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18370: -- Summary: Test Flink on Azure-hosted VMs nightly Key: FLINK-18370 URL: https://issues.apache.org/jira/browse/FLINK-18370 Project: Flink Issue Type

[jira] [Created] (FLINK-18368) HadoopRecoverableWriterOldHadoopWithNoTruncateSupportTest.createHDFS fails with "Running in secure mode, but config doesn't have a keytab"

2020-06-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18368: -- Summary: HadoopRecoverableWriterOldHadoopWithNoTruncateSupportTest.createHDFS fails with "Running in secure mode, but config doesn't have a keytab" Key: FLINK-18368

[jira] [Created] (FLINK-18366) Track E2E test durations centrally

2020-06-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18366: -- Summary: Track E2E test durations centrally Key: FLINK-18366 URL: https://issues.apache.org/jira/browse/FLINK-18366 Project: Flink Issue Type

[jira] [Created] (FLINK-18358) TableEnvironmentITCase.testSqlUpdateAndToDataSetWithTableSource:245 unstable: result mismatch

2020-06-18 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18358: -- Summary: TableEnvironmentITCase.testSqlUpdateAndToDataSetWithTableSource:245 unstable: result mismatch Key: FLINK-18358 URL: https://issues.apache.org/jira/browse/FLINK

[jira] [Created] (FLINK-18351) ModuleManager creates a lot of duplicate/similar log messages

2020-06-17 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18351: -- Summary: ModuleManager creates a lot of duplicate/similar log messages Key: FLINK-18351 URL: https://issues.apache.org/jira/browse/FLINK-18351 Project: Flink

Re: [DISCUSS] Re-renaming "Flink Master" back to JobManager

2020-06-17 Thread Robert Metzger
Thanks a lot for looking into this! +1 to your proposal On Wed, Jun 17, 2020 at 10:55 AM David Anderson wrote: > Aljoscha, > > I think this is a step in the right direction. > > In some cases it may be difficult to talk concretely about the > differences between different deployment models

[jira] [Created] (FLINK-18321) AbstractCloseableRegistryTest.testClose unstable

2020-06-16 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18321: -- Summary: AbstractCloseableRegistryTest.testClose unstable Key: FLINK-18321 URL: https://issues.apache.org/jira/browse/FLINK-18321 Project: Flink Issue

Re: Moving in and Modify Dependency Source

2020-06-15 Thread Robert Metzger
Hi Austin, Thanks for working on the RMQ connector! There seem to be a few users affected by that issue. The GitHub page confirms that users can choose from the three licenses: https://github.com/rabbitmq/rabbitmq-java-client#license: > This means that the user can consider the library to be

Re: request create flip permission for flink es bounded source/lookup source connector

2020-06-15 Thread Robert Metzger
is "You'll need to ask permission to insert files here" > Could you also help me give the permission for uploading images to FLIP > iki? > > Robert Metzger wrote > > Hi, > > I gave you access to the Wiki! > > > > On Fri, Jun 12, 2020 at 11:50 AM Jacky Lau

[jira] [Created] (FLINK-18291) Streaming File Sink s3 end-to-end test stalls

2020-06-15 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18291: -- Summary: Streaming File Sink s3 end-to-end test stalls Key: FLINK-18291 URL: https://issues.apache.org/jira/browse/FLINK-18291 Project: Flink Issue Type

[jira] [Created] (FLINK-18290) Kafka011ProducerExactlyOnceITCase sometimes crashes with exit code 239

2020-06-14 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18290: -- Summary: Kafka011ProducerExactlyOnceITCase sometimes crashes with exit code 239 Key: FLINK-18290 URL: https://issues.apache.org/jira/browse/FLINK-18290 Project

Re: [DISCUSS] Add Japanese translation of the flink.apache.org website

2020-06-12 Thread Robert Metzger
English docs are reorganized, > > > contents > > > > > are > > > > > > moved across pages, and also small pieces of details are > modified. > > It > > > > is > > > > > > not always possible for people who work on the English d

Re: [DISCUSS] Update our EditorConfig file

2020-06-12 Thread Robert Metzger
It seems that nobody cares about the file, as it has been basically never touched after its creation in late 2015. I would be fine adding the changes you are proposing to the codebase. On Thu, Jun 11, 2020 at 4:47 AM tison wrote: > > is anyone actually using our .editorconfig file? > > I

Re: [DISCUSS] Semantics of our JIRA fields

2020-06-12 Thread Robert Metzger
the > community worked in the past. > > Cheers, > Till > > On Tue, May 26, 2020 at 4:30 PM Robert Metzger > wrote: > > > Hi, > > > > 1. I'm okay with updating the definition of the priorities for the reason > > you've mentioned. > > > > 2. &

Re: request create flip permission for flink es bounded source/lookup source connector

2020-06-12 Thread Robert Metzger
Hi, I gave you access to the Wiki! On Fri, Jun 12, 2020 at 11:50 AM Jacky Lau wrote: > Hi Jack: >Thank you so much. My wiki name is jackylau > > > Jark Wu-2 wrote > > Hi Jacky, > > > > What's your username in wiki? So that I can give the permission to you. > > > > Best, > > Jark > > > >

[jira] [Created] (FLINK-18271) Move run-nightly-tests.sh

2020-06-12 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18271: -- Summary: Move run-nightly-tests.sh Key: FLINK-18271 URL: https://issues.apache.org/jira/browse/FLINK-18271 Project: Flink Issue Type: Task

[jira] [Created] (FLINK-18270) ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper unstable

2020-06-11 Thread Robert Metzger (Jira)
Robert Metzger created FLINK-18270: -- Summary: ResumeCheckpointManuallyITCase.testExternalizedFSCheckpointsWithLocalRecoveryZookeeper unstable Key: FLINK-18270 URL: https://issues.apache.org/jira/browse/FLINK

<    1   2   3   4   5   6   7   8   9   10   >