Re: [ANNOUNCE] Jiangjie (Becket) Qin has been added as a committer to the Flink project

Congratulations Becket! Kostas On Thu, Jul 18, 2019 at 11:21 AM Guowei Ma wrote: > Congrats Becket! > > Best, > Guowei > > > Terry Wang 于2019年7月18日周四 下午5:17写道： > > > Congratulations Becket! > > > > > 在 2019年7月18日，下午5:09，Dawid Wysakowicz 写道： > > > > > > Congratulations Becket! Good to have

[jira] [Created] (FLINK-13307) SourceStreamTaskTest test instability.

Kostas Kloudas created FLINK-13307: -- Summary: SourceStreamTaskTest test instability. Key: FLINK-13307 URL: https://issues.apache.org/jira/browse/FLINK-13307 Project: Flink Issue Type

[jira] [Created] (FLINK-13275) Race condition in SourceStreamTaskTest.finishingIgnoresExceptions()

Kostas Kloudas created FLINK-13275: -- Summary: Race condition in SourceStreamTaskTest.finishingIgnoresExceptions() Key: FLINK-13275 URL: https://issues.apache.org/jira/browse/FLINK-13275 Project

Re: [ANNOUNCE] Rong Rong becomes a Flink committer

Congratulations Rong! On Thu, Jul 11, 2019 at 4:40 PM Jark Wu wrote: > Congratulations Rong Rong! > Welcome on board! > > On Thu, 11 Jul 2019 at 22:25, Fabian Hueske wrote: > >> Hi everyone, >> >> I'm very happy to announce that Rong Rong accepted the offer of the Flink >> PMC to become a

Re: [DISCUSS] Graceful Shutdown Handling by UDFs.

e that "cancel" should be consider an ungraceful shutdown, so that the > Job could be restarted from last (retained) checkpoint (as right now). > > Cheers, > > Konstantin > > On Thu, Jul 4, 2019 at 3:21 PM Kostas Kloudas wrote: > > > Hi all, > > > > In man

[FLIP-47] Savepoints vs Checkpoints

Hi Devs, Currently there is a number of efforts around checkpoints/savepoints, as reflected by the number of FLIPs. From a quick look FLIP-34, FLIP-41, FLIP-43, and FLIP-45 are all directly related to these topics. This reflects the importance of these two notions/features to the users of the

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

; > Would you mind granting me the contributor access for the following > > account ? This way I can assign the JIRA to myself. > >*yxu-apache > > <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=yxu-apache > >* > > > > Many thanks!

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

s > issue. > > Thanks again. > > - > Bests > Ying > > > On Tue, Jun 25, 2019 at 2:24 AM Kostas Kloudas wrote: > > > Hi Ying, > > > > You are right! If it is either on checkpoint or on size, then this is > > doable even with the current

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

ilar to that inside prepareBucketForCheckpointing() > < > https://github.com/apache/flink/blob/3702029f45b7034b767e2b7eb01601c7f76ab35e/flink-streaming-java/src/main/java/org/apache/flink/streaming/api/functions/sink/filesystem/Bucket.java#L275 > >. > Not sure if I miss anything

Re: Rolling policy when using StreamingFileSink for bulk-encoded output

Hi Ying, Thanks for using the StreamingFileSink. The reason why the StreamingFileSink only supports OnCheckpointRollingPolicy with bulk formats has to do with the fact that currently Flink relies on the Hadoop writer for Parquet. Bulk formats keep important details about how they write the

[jira] [Created] (FLINK-12226) Add documentation about SUSPEND/TERMINATE

Kostas Kloudas created FLINK-12226: -- Summary: Add documentation about SUSPEND/TERMINATE Key: FLINK-12226 URL: https://issues.apache.org/jira/browse/FLINK-12226 Project: Flink Issue Type

Re: [Discuss] Semantics of event time for state TTL

Hi all, For GDPR: I am not sure about the regulatory requirements of GDPR but I would assume that the time for deletion starts counting from the time an organisation received the data (i.e. the wall-clock ingestion time of the data), and not the "event time" of the data. In other case, an

[jira] [Created] (FLINK-12051) TaskExecutorTest.testFilterOutDuplicateJobMasterRegistrations() failed locally.

Kostas Kloudas created FLINK-12051: -- Summary: TaskExecutorTest.testFilterOutDuplicateJobMasterRegistrations() failed locally. Key: FLINK-12051 URL: https://issues.apache.org/jira/browse/FLINK-12051

[jira] [Created] (FLINK-11984) StreamingFileSink docs do not mention S3 savepoint caveats.

Kostas Kloudas created FLINK-11984: -- Summary: StreamingFileSink docs do not mention S3 savepoint caveats. Key: FLINK-11984 URL: https://issues.apache.org/jira/browse/FLINK-11984 Project: Flink

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

t; > > Aljoscha > > > On 7. Mar 2019, at 11:08, Kostas Kloudas wrote: > > > > Hi, > > > > Thanks for the comments. > > I agree with the Ufuk's and Elias' proposal. > > > > - "cancel" remains the good old "cancel" > >

Re: [DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

y-once sinks complete their two-phase commits > > successfully. If a savepoint was requested, one should be created. > > > > So in my mind there are two commands, cancel and stop, with appropriate > > semantics. Emitting MAX_WATERMARK before the checkpoint barrier during &

Re: [DISCUSS] A more restrictive JIRA workflow

Really nice idea Timo, Thanks for taking the initiative to open this discussion. Although a side-effect, I consider it a big argument about my +1 the fact that now we create backpressure whenever needed at the JIRA level, rather than at the open PR level. The reason is that not accepting a PR

[jira] [Created] (FLINK-11670) Add SUSPEND/TERMINATE calls to REST API

Kostas Kloudas created FLINK-11670: -- Summary: Add SUSPEND/TERMINATE calls to REST API Key: FLINK-11670 URL: https://issues.apache.org/jira/browse/FLINK-11670 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-11671) Expose SUSPEND/TERMINATE to CLI

Kostas Kloudas created FLINK-11671: -- Summary: Expose SUSPEND/TERMINATE to CLI Key: FLINK-11671 URL: https://issues.apache.org/jira/browse/FLINK-11671 Project: Flink Issue Type: Sub-task

[jira] [Created] (FLINK-11669) Add Synchronous Checkpoint Triggering RPCs.

Kostas Kloudas created FLINK-11669: -- Summary: Add Synchronous Checkpoint Triggering RPCs. Key: FLINK-11669 URL: https://issues.apache.org/jira/browse/FLINK-11669 Project: Flink Issue Type

[jira] [Created] (FLINK-11668) Allow sources to advance time to max watermark on checkpoint.

Kostas Kloudas created FLINK-11668: -- Summary: Allow sources to advance time to max watermark on checkpoint. Key: FLINK-11668 URL: https://issues.apache.org/jira/browse/FLINK-11668 Project: Flink

[jira] [Created] (FLINK-11667) Add Synchronous Checkpoint handling in StreamTask

Kostas Kloudas created FLINK-11667: -- Summary: Add Synchronous Checkpoint handling in StreamTask Key: FLINK-11667 URL: https://issues.apache.org/jira/browse/FLINK-11667 Project: Flink Issue

Re: StreamingFileSink causing AmazonS3Exception

gt;> >> This whole thing is documented here: >> https://docs.aws.amazon.com/sdk-for-java/v1/developer-guide/best-practices.html >> >> However, I found that just using the documented property didn't appear to >> work and I had to wrap the InputStream in the BufferedInputStr

[DISCUSS] FLIP-33: Terminate/Suspend Job with Savepoint

confluence/pages/viewpage.action?pageId=103090212 The implementation sketch is far from complete, but it is worth having a discussion on the semantics as soon as possible. The implementation section is going to be updated soon. Looking forward to the discussion, Kostas -- Kostas Kloudas

[jira] [Created] (FLINK-11574) Make StreamTask properly handle the DRAIN message.

Kostas Kloudas created FLINK-11574: -- Summary: Make StreamTask properly handle the DRAIN message. Key: FLINK-11574 URL: https://issues.apache.org/jira/browse/FLINK-11574 Project: Flink Issue

[jira] [Created] (FLINK-11575) Let the JobManager send the SUSPEND and DRAIN messages

Kostas Kloudas created FLINK-11575: -- Summary: Let the JobManager send the SUSPEND and DRAIN messages Key: FLINK-11575 URL: https://issues.apache.org/jira/browse/FLINK-11575 Project: Flink

[jira] [Created] (FLINK-11573) Make StreamTask properly handle the SUSPEND message.

Kostas Kloudas created FLINK-11573: -- Summary: Make StreamTask properly handle the SUSPEND message. Key: FLINK-11573 URL: https://issues.apache.org/jira/browse/FLINK-11573 Project: Flink

[jira] [Created] (FLINK-11572) Add new types of CheckpointBarriers.

Kostas Kloudas created FLINK-11572: -- Summary: Add new types of CheckpointBarriers. Key: FLINK-11572 URL: https://issues.apache.org/jira/browse/FLINK-11572 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-11458) Ensure sink commit side-effects when cancelling with savepoint.

Kostas Kloudas created FLINK-11458: -- Summary: Ensure sink commit side-effects when cancelling with savepoint. Key: FLINK-11458 URL: https://issues.apache.org/jira/browse/FLINK-11458 Project: Flink

Re: [DISCUSS] Bot for stale PRs on GitHub

+1 to try the bot. It may, at first, seem less empathetic than a solution that involves a human monitoring the PRs, but, in essence, having a PR stale for months (or even years) is at least as discouraging for a new contributor. Labels could further reduce the problem of noise, but I think that

Re: [DISCUSS] Dropping flink-storm?

+1 to drop as well. On Thu, Jan 10, 2019 at 10:15 AM Ufuk Celebi wrote: > +1 to drop. > > I totally agree with your reasoning. I like that we tried to keep it, > but I don't think the maintenance overhead would be justified. > > – Ufuk > > On Wed, Jan 9, 2019 at 4:09 PM Till Rohrmann wrote: >

[jira] [Created] (FLINK-11116) Clean-up temporary files that upon recovery, they belong to no checkpoint.

Kostas Kloudas created FLINK-6: -- Summary: Clean-up temporary files that upon recovery, they belong to no checkpoint. Key: FLINK-6 URL: https://issues.apache.org/jira/browse/FLINK-6

Re: support/docs for compression in StreamingFileSink

Hi Addison, Sorry for the late reply. I agree that the documentation can be significantly improved and that adding compression could be a nice thing to have. There is already a PR open for supporting writing SequenceFiles with the StreamingFileSink. When this gets merged, you will be able to

Re: Looking for relevant sources related to connecting Apache Flink and Edgent.

to implement a custom source. Cheers, Kostas On Thu, Nov 29, 2018 at 11:08 AM Kostas Kloudas wrote: > Hi Felipe, > > This seems related to your previous question about a custom scheduler that > knows which task to run on which machine. > As Chesnay said, this is a rather involved and

Re: Looking for relevant sources related to connecting Apache Flink and Edgent.

Hi Felipe, This seems related to your previous question about a custom scheduler that knows which task to run on which machine. As Chesnay said, this is a rather involved and laborious task, if you want to do it as a general framework. But if you know what operation to push down, then why not

Re: [DISCUSS] FLIP-27: Refactor Source Interface

Hi Biao, Thanks for the answer! So given the multi-threaded readers, now we have as open questions: 1) How do we let the checkpoints pass through our multi-threaded reader operator? 2) Do we have separate reader and source operators or not? In the strategy that has a separate source, the

Re: [DISCUSS] FLIP-27: Refactor Source Interface

Hi all, >From the discussion, I understand that we are leaning towards a design where the user writes a single-threaded SplitReader, which Flink executes on another thread (not the main task thread). This way the task can have multiple readers running concurrently, each one reading a different

[jira] [Created] (FLINK-10963) Cleanup small objects uploaded to S3 as independent objects

Kostas Kloudas created FLINK-10963: -- Summary: Cleanup small objects uploaded to S3 as independent objects Key: FLINK-10963 URL: https://issues.apache.org/jira/browse/FLINK-10963 Project: Flink

[jira] [Created] (FLINK-10803) Add documentation about S3 support by the StreamingFileSink

Kostas Kloudas created FLINK-10803: -- Summary: Add documentation about S3 support by the StreamingFileSink Key: FLINK-10803 URL: https://issues.apache.org/jira/browse/FLINK-10803 Project: Flink

[jira] [Created] (FLINK-10739) Unstable ProcessFailureCancelingITCase.testCancelingOnProcessFailure

Kostas Kloudas created FLINK-10739: -- Summary: Unstable ProcessFailureCancelingITCase.testCancelingOnProcessFailure Key: FLINK-10739 URL: https://issues.apache.org/jira/browse/FLINK-10739 Project

[jira] [Created] (FLINK-10733) Misleading clean_log_files() in common.sh

Kostas Kloudas created FLINK-10733: -- Summary: Misleading clean_log_files() in common.sh Key: FLINK-10733 URL: https://issues.apache.org/jira/browse/FLINK-10733 Project: Flink Issue Type

Re: FLINK-9752 (s3 recoverable writer) not actually fixed in 1.6.2?

Hi Addison, This is definitely an error on my end, as the feature is going to be available from Flink 1.7 onwards. I forgot to correctly update the Flink version when closing the JIRA issue. I will update the release notes accordingly. Sorry for the miscommunication, Kostas > On Oct 31,

[jira] [Created] (FLINK-10583) Add support for state retention to the Processing Time versioned joins.

Kostas Kloudas created FLINK-10583: -- Summary: Add support for state retention to the Processing Time versioned joins. Key: FLINK-10583 URL: https://issues.apache.org/jira/browse/FLINK-10583 Project

[jira] [Created] (FLINK-10584) Add support for state retention to the Event Time versioned joins.

Kostas Kloudas created FLINK-10584: -- Summary: Add support for state retention to the Event Time versioned joins. Key: FLINK-10584 URL: https://issues.apache.org/jira/browse/FLINK-10584 Project

[jira] [Created] (FLINK-10530) ProcessFailureCancelingITCase.testCancelingOnProcessFailure failed on Travis.

Kostas Kloudas created FLINK-10530: -- Summary: ProcessFailureCancelingITCase.testCancelingOnProcessFailure failed on Travis. Key: FLINK-10530 URL: https://issues.apache.org/jira/browse/FLINK-10530

[jira] [Created] (FLINK-10529) Add flink-s3-fs-base to the connectors in the travis stage file.

Kostas Kloudas created FLINK-10529: -- Summary: Add flink-s3-fs-base to the connectors in the travis stage file. Key: FLINK-10529 URL: https://issues.apache.org/jira/browse/FLINK-10529 Project: Flink

[jira] [Created] (FLINK-10522) Check if RecoverableWriter supportsResume and accordingly.

Kostas Kloudas created FLINK-10522: -- Summary: Check if RecoverableWriter supportsResume and accordingly. Key: FLINK-10522 URL: https://issues.apache.org/jira/browse/FLINK-10522 Project: Flink

Re: [DISCUSS] Dropping flink-storm?

+1 to drop it as nobody seems to be willing to maintain it and it also stands in the way for future developments in Flink. Cheers, Kostas > On Sep 29, 2018, at 8:19 AM, Tzu-Li Chen wrote: > > +1 to drop it. > > It seems few people use it. Commits history of an experimental > module sparse

Re: Codespeed deployment for Flink

Thanks for this contribution Piotr and Nico. Tools like this are really useful for Flink’s success. Cheers, Kostas > On Sep 21, 2018, at 4:59 PM, Piotr Nowojski wrote: > > Hello community, > > For almost a year in data Artisans Nico and I were maintaining a setup > that continuously

Re: Watermark alignment during unit tests

Hi Eugen, It is true that for ITcases this can be difficult and this should be improved in Flink’s testing infrastructure, but for this specific PR, what you need to check is if the allowedLateness parameter is propagated correctly throughout the translation process. The window operator with

Re: [ANNOUNCE] New committer Gary Yao

Congratulations Gary! Well deserved! Cheers, Kostas > On Sep 7, 2018, at 4:43 PM, Fabian Hueske wrote: > > Congratulations Gary! > > 2018-09-07 16:29 GMT+02:00 Thomas Weise : > >> Congrats, Gary! >> >> On Fri, Sep 7, 2018 at 4:17 PM Dawid Wysakowicz >> wrote: >> >>> Congratulations Gary!

Re: Support Hadoop 2.6 for StreamingFileSink

Hi Artsem, Till is correct in that getting rid of the “valid-length” file was a design decision for the new StreamingFileSink since the beginning. The motivation was that users were reporting that essentially it was very cumbersome to use. In general, when the BucketingSink gets deprecated, I

[jira] [Created] (FLINK-10097) More tests to increase StreamingFileSink test coverage

Kostas Kloudas created FLINK-10097: -- Summary: More tests to increase StreamingFileSink test coverage Key: FLINK-10097 URL: https://issues.apache.org/jira/browse/FLINK-10097 Project: Flink

[jira] [Created] (FLINK-10029) Refactor the code for better separation of concerns.

Kostas Kloudas created FLINK-10029: -- Summary: Refactor the code for better separation of concerns. Key: FLINK-10029 URL: https://issues.apache.org/jira/browse/FLINK-10029 Project: Flink

[jira] [Created] (FLINK-10027) Add logging to the StreamingFileSink

Kostas Kloudas created FLINK-10027: -- Summary: Add logging to the StreamingFileSink Key: FLINK-10027 URL: https://issues.apache.org/jira/browse/FLINK-10027 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-9994) IntervalJoinOperator#Context#getTimestamp does not return the Max timestamp.

Kostas Kloudas created FLINK-9994: - Summary: IntervalJoinOperator#Context#getTimestamp does not return the Max timestamp. Key: FLINK-9994 URL: https://issues.apache.org/jira/browse/FLINK-9994 Project

Re: Cherry picking FLINK-9753 and FLINK-9753 on release-1.6

would still like to see this happen, because it let me have more >> alternative to upload data with parquet >> format. Thanks for your great efforts on this. >> >> Best Regards, >> Tony Wei >> >> https://issues.apache.org/jira/browse/FLI

[jira] [Created] (FLINK-9921) Update the rolling policy interface.

Kostas Kloudas created FLINK-9921: - Summary: Update the rolling policy interface. Key: FLINK-9921 URL: https://issues.apache.org/jira/browse/FLINK-9921 Project: Flink Issue Type: Sub-task

Cherry picking FLINK-9753 and FLINK-9753 on release-1.6

Hi all, We just merged on the master [FLINK-9753] (commit 66b1f854a0250bdd048808d40f93aa2990476841) and [FLINK-9903] (commit b56c75ca375049b1d2c80d2d0945ae1ae04eb39e). These two commits introduce: 1) a big refactoring to the new StreamingFileSink which allows it to support bulk formats in

[jira] [Created] (FLINK-9903) Add support for bulk writers.

Kostas Kloudas created FLINK-9903: - Summary: Add support for bulk writers. Key: FLINK-9903 URL: https://issues.apache.org/jira/browse/FLINK-9903 Project: Flink Issue Type: Sub-task

Re: Adding a part suffix setter to the BucketingSink

this issue - https://issues.apache.org/ > jira/browse/FLINK-9603. Thanks for pointing out, I'll make sure to use the > 1.5.3 version of the sink. > > Thanks > Lakshmi > > > On Thu, Jul 12, 2018 at 4:55 AM, vino yang wrote: > >> Hi Kostas, good job! >> >>

Re: Adding a part suffix setter to the BucketingSink

Hi Lakshmi, Since Flink-1.5 you have the ability to set the part suffix. As you said, you only want the .gzip to be the suffix of the final (or “completed”) part files, which is exactly what is currently supported. If you want also intermediate files to have this suffix, then you can always

Re: [ANNOUNCE] New committer: Sihua Zhou

Congratulations! On Fri, Jun 22, 2018, 21:33 Shuyi Chen wrote: > Congratulations! > > On Fri, Jun 22, 2018 at 11:08 AM Matthias J. Sax wrote: > > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA512 > > > > Congrats! > > > > On 6/22/18 10:33 AM, shimin yang wrote: > > > Congrats! > > > > > >

Re: [ANNOUNCE] New committer Piotr Nowojski

Congratulations! On Fri, Jun 22, 2018, 21:33 Shuyi Chen wrote: > Congratulations! > > > On Fri, Jun 22, 2018 at 12:30 PM Matthias J. Sax wrote: > > > -BEGIN PGP SIGNED MESSAGE- > > Hash: SHA512 > > > > Congrats! > > > > On 6/22/18 12:28 PM, Stefan Richter wrote: > > > Congrats Piotr! >

Re: [ANNOUNCE] Two new committers: Xingcan Cui and Nico Kruber

Congratulations to both of you guys! > On May 10, 2018, at 9:41 AM, Amit Jain wrote: > > Congrats! > > On Thu, May 10, 2018 at 10:10 AM, Xingcan Cui wrote: >> Thanks, everyone! >> >> It’s an honor which inspires me to devote more to our community. >>

Re: CoProcessFunction doesn't support timer on keyed stream

ee all the documentation at localhost:4000 and the Broadcast State one at: http://localhost:4000/dev/stream/state/broadcast_state.html <http://localhost:4000/dev/stream/state/broadcast_state.html> Any feedback is welcomed! Cheers, Kostas > On Apr 26, 2018, at 11:09 AM, Kostas Kloudas

Re: CoProcessFunction doesn't support timer on keyed stream

Hi Ken, It is true that there is not reason for not having access to the timerService from the processElement of the keyed side. On the other side (the non-keyed side) you cannot set timers because timers are bound to a specific key. Now, if one stream is broadcasted and the other is keyed,

Re: Flink 1.3.2 with CEP Pattern, Memory usage increases results in OOM

Hi Abiramalakshmi, Thanks for reporting this! As a starting point I would recommend: 1) use RocksDB as your backend, so that state is not accumulated in memory 2) enable incremental checkpoints 3) the “new IterativeCondition() {…}” can become “new SimpleCondition() {}”, as this is more

Re: [jira] [Created] (FLINK-9164) times(#,#) quantifier does not seem to work

Hi Romain, What if you remove the AfterMatchSkipStrategy.skipPastLastEvent()? Kostas > On Apr 12, 2018, at 1:19 PM, Romain Revol (JIRA) wrote: > > AfterMatchSkipStrategy.skipPastLastEvent()

Re: [Proposal] CEP library changes - review request

Hi Shailesh, Your solution may fit your use case, but as Dawid mentioned earlier, it makes a lot of assumptions about the input. From a look at your PoC: 1) You assume no late data (you do not drop anything) and no out-of-orderness. 2) You mix the two notions of time (event and processing).

Re: [DISCUSS] Implement end-to-end tests in Java

Hi Timo, Thanks for opening this. I agree that bash is not the best tool for all the reasons that you mention plus: 1) it is difficult to write re-usable code 2) there are a lot of ways to express the same thing and difficult to build “best practices” (as it should be in a community

[jira] [Created] (FLINK-9046) Improve error messages when receiving unexpected messages.

Kostas Kloudas created FLINK-9046: - Summary: Improve error messages when receiving unexpected messages. Key: FLINK-9046 URL: https://issues.apache.org/jira/browse/FLINK-9046 Project: Flink

[jira] [Created] (FLINK-8928) Improve error message on server binding error.

Kostas Kloudas created FLINK-8928: - Summary: Improve error message on server binding error. Key: FLINK-8928 URL: https://issues.apache.org/jira/browse/FLINK-8928 Project: Flink Issue Type

[jira] [Created] (FLINK-8926) Shutdown client proxy on test end.

Kostas Kloudas created FLINK-8926: - Summary: Shutdown client proxy on test end. Key: FLINK-8926 URL: https://issues.apache.org/jira/browse/FLINK-8926 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8908) MapSerializer creates new serializer even if key and value serializers are stateless

Kostas Kloudas created FLINK-8908: - Summary: MapSerializer creates new serializer even if key and value serializers are stateless Key: FLINK-8908 URL: https://issues.apache.org/jira/browse/FLINK-8908

[jira] [Created] (FLINK-8841) Duplicate MapSerializer and HashMapSerializer.

Kostas Kloudas created FLINK-8841: - Summary: Duplicate MapSerializer and HashMapSerializer. Key: FLINK-8841 URL: https://issues.apache.org/jira/browse/FLINK-8841 Project: Flink Issue Type

[jira] [Created] (FLINK-8802) Concurrent serialization without duplicating serializers in state server.

Kostas Kloudas created FLINK-8802: - Summary: Concurrent serialization without duplicating serializers in state server. Key: FLINK-8802 URL: https://issues.apache.org/jira/browse/FLINK-8802 Project

[jira] [Created] (FLINK-8780) Add Broadcast State documentation.

Kostas Kloudas created FLINK-8780: - Summary: Add Broadcast State documentation. Key: FLINK-8780 URL: https://issues.apache.org/jira/browse/FLINK-8780 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-8724) Add BroadcastState examples with predetermined state transitions for the broadcast state

Kostas Kloudas created FLINK-8724: - Summary: Add BroadcastState examples with predetermined state transitions for the broadcast state Key: FLINK-8724 URL: https://issues.apache.org/jira/browse/FLINK-8724

[jira] [Created] (FLINK-8723) Remove existing BroadcastState examples.

Kostas Kloudas created FLINK-8723: - Summary: Remove existing BroadcastState examples. Key: FLINK-8723 URL: https://issues.apache.org/jira/browse/FLINK-8723 Project: Flink Issue Type: Sub

[jira] [Created] (FLINK-8722) Refactor BroadcastState examples.

Kostas Kloudas created FLINK-8722: - Summary: Refactor BroadcastState examples. Key: FLINK-8722 URL: https://issues.apache.org/jira/browse/FLINK-8722 Project: Flink Issue Type: Improvement

Re: HAQueryableStateRocksDBBackendITCase test cause outofmemoryerror and never stop

Hi Minglei, Can you send us where the execution is when it hangs? Threaddump, what objects are created, or whatever can help track down the problem. Thanks, Kostas > On Feb 21, 2018, at 9:07 AM, mingleizhang wrote: > > Hi, > I run

[jira] [Created] (FLINK-8659) Add migration tests for Broadcast state.

Kostas Kloudas created FLINK-8659: - Summary: Add migration tests for Broadcast state. Key: FLINK-8659 URL: https://issues.apache.org/jira/browse/FLINK-8659 Project: Flink Issue Type

[jira] [Created] (FLINK-8642) Initialize descriptors before use at getBroadcastState().

Kostas Kloudas created FLINK-8642: - Summary: Initialize descriptors before use at getBroadcastState(). Key: FLINK-8642 URL: https://issues.apache.org/jira/browse/FLINK-8642 Project: Flink

Re: [DISCUSS] Releasing Flink 1.5.0

and the network stack rework. >>>> As such it doesn't make sense to release 1.5 now. >>>> >>>> Given the large scope of these features I would very much prefer to have >>>> them active on master for a while before a feature-freeze >>>&g

[jira] [Created] (FLINK-8597) Add examples for Connected Streams with Broadcast State.

Kostas Kloudas created FLINK-8597: - Summary: Add examples for Connected Streams with Broadcast State. Key: FLINK-8597 URL: https://issues.apache.org/jira/browse/FLINK-8597 Project: Flink

Re: [DISCUSS] Releasing Flink 1.5.0

Hi Aljoscha, I believe that support for Broadcast State should also be in 1.5. There is an open PR https://github.com/apache/flink/pull/5230 for that and there are some pending issues related to scala api and documentation. Thanks, Kostas > On Feb 5,

[jira] [Created] (FLINK-8561) SharedBuffer line 573 uses == to compare BufferEntries instead of .equals.

Kostas Kloudas created FLINK-8561: - Summary: SharedBuffer line 573 uses == to compare BufferEntries instead of .equals. Key: FLINK-8561 URL: https://issues.apache.org/jira/browse/FLINK-8561 Project

[jira] [Created] (FLINK-8522) DefaultOperatorStateBackend writes data in checkpoint that is never read.

Kostas Kloudas created FLINK-8522: - Summary: DefaultOperatorStateBackend writes data in checkpoint that is never read. Key: FLINK-8522 URL: https://issues.apache.org/jira/browse/FLINK-8522 Project

[jira] [Created] (FLINK-8446) Add support for multiple broadcast states.

Kostas Kloudas created FLINK-8446: - Summary: Add support for multiple broadcast states. Key: FLINK-8446 URL: https://issues.apache.org/jira/browse/FLINK-8446 Project: Flink Issue Type: New

[jira] [Created] (FLINK-8345) Iterate over keyed state on broadcast side of connect with broadcast.

Kostas Kloudas created FLINK-8345: - Summary: Iterate over keyed state on broadcast side of connect with broadcast. Key: FLINK-8345 URL: https://issues.apache.org/jira/browse/FLINK-8345 Project: Flink

Re: CEP: Dynamic Patterns

al stopping/ restarting. I do not know if Ufuk has something to add to this. Hope this helps, Kostas > On Dec 28, 2017, at 2:57 PM, Kostas Kloudas <k.klou...@data-artisans.com> > wrote: > > Hi Rafi, > > Currently this is unfortunately not supported out of the box. &g

Re: CEP: Dynamic Patterns

Hi Rafi, Currently this is unfortunately not supported out of the box. To support this, we need 2 features with one having to be added in Flink itself, and the other to the CEP library. The first one is broadcast state and the ability to connect keyed and non-keyed streams. This one is to be

[jira] [Created] (FLINK-8090) An operator should not be able to register two states with the same name.

Kostas Kloudas created FLINK-8090: - Summary: An operator should not be able to register two states with the same name. Key: FLINK-8090 URL: https://issues.apache.org/jira/browse/FLINK-8090 Project

[jira] [Created] (FLINK-8073) Test instability FlinkKafkaProducer011ITCase.testScaleDownBeforeFirstCheckpoint()

Kostas Kloudas created FLINK-8073: - Summary: Test instability FlinkKafkaProducer011ITCase.testScaleDownBeforeFirstCheckpoint() Key: FLINK-8073 URL: https://issues.apache.org/jira/browse/FLINK-8073

[jira] [Created] (FLINK-8050) RestServer#shutdown() ignores exceptions thrown when shutting down netty.

Kostas Kloudas created FLINK-8050: - Summary: RestServer#shutdown() ignores exceptions thrown when shutting down netty. Key: FLINK-8050 URL: https://issues.apache.org/jira/browse/FLINK-8050 Project

Re: [ANNOUNCE] New committer: Haohui Mai

Congratulations! > On Nov 2, 2017, at 9:12 AM, Matthias J. Sax wrote: > > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA512 > > Congrats! > > On 11/1/17 9:40 PM, Dawid Wysakowicz wrote: >> Congratulations! >> >> 01.11.2017 7:45 PM "Stephan Ewen"

[jira] [Created] (FLINK-7933) Test instability PrometheusReporterTest

Kostas Kloudas created FLINK-7933: - Summary: Test instability PrometheusReporterTest Key: FLINK-7933 URL: https://issues.apache.org/jira/browse/FLINK-7933 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-7908) Restructure the QS module to reduce client deps.

Kostas Kloudas created FLINK-7908: - Summary: Restructure the QS module to reduce client deps. Key: FLINK-7908 URL: https://issues.apache.org/jira/browse/FLINK-7908 Project: Flink Issue Type

[jira] [Created] (FLINK-7835) Fix duplicate() method in NFASerializer

Kostas Kloudas created FLINK-7835: - Summary: Fix duplicate() method in NFASerializer Key: FLINK-7835 URL: https://issues.apache.org/jira/browse/FLINK-7835 Project: Flink Issue Type: Sub-task

<    1   2   3   4   5   >