[jira] [Created] (FLINK-9632) SlotPool should notify the call when allocateSlot meet an exception

2018-06-20 Thread shuai.xu (JIRA)
shuai.xu created FLINK-9632: --- Summary: SlotPool should notify the call when allocateSlot meet an exception Key: FLINK-9632 URL: https://issues.apache.org/jira/browse/FLINK-9632 Project: Flink

[jira] [Created] (FLINK-9631) use Files.createDirectories instead of directory.mkdirs

2018-06-20 Thread makeyang (JIRA)
makeyang created FLINK-9631: --- Summary: use Files.createDirectories instead of directory.mkdirs Key: FLINK-9631 URL: https://issues.apache.org/jira/browse/FLINK-9631 Project: Flink Issue Type:

[jira] [Created] (FLINK-9630) Kafka09PartitionDiscoverer cause connection leak on TopicAuthorizationException

2018-06-20 Thread Youjun Yuan (JIRA)
Youjun Yuan created FLINK-9630: -- Summary: Kafka09PartitionDiscoverer cause connection leak on TopicAuthorizationException Key: FLINK-9630 URL: https://issues.apache.org/jira/browse/FLINK-9630 Project:

[jira] [Created] (FLINK-9629) Datadog metrics reporter does not have shaded dependencies

2018-06-20 Thread Georgii Gobozov (JIRA)
Georgii Gobozov created FLINK-9629: -- Summary: Datadog metrics reporter does not have shaded dependencies Key: FLINK-9629 URL: https://issues.apache.org/jira/browse/FLINK-9629 Project: Flink

Am I forgetting to do something to get pull request accepted?

2018-06-20 Thread jpcarterara
I just want to make sure I am not missing anything to get my pull request accepted. All tests are passing so I figured it was going to be a short time after that. Is there anything else that I need to do or a reason like there is a freeze on accepting pull requests for the moment? Here is the

Re: [TABLE][SQL] Unify UniqueKeyExtractor and DataStreamRetractionRules

2018-06-20 Thread Hequn Cheng
Hi Piotrek, I agree that the shuttle way makes the code more easier and clean. But it will lose the abilities of rules. For Volcano, it does interrupt searching plans space when it reaches the maximal iteration times, but there is a condition that the result plan is a valid plan, or it will

[jira] [Created] (FLINK-9628) Options to tolerate truncate failure in BucketingSink

2018-06-20 Thread Truong Duc Kien (JIRA)
Truong Duc Kien created FLINK-9628: -- Summary: Options to tolerate truncate failure in BucketingSink Key: FLINK-9628 URL: https://issues.apache.org/jira/browse/FLINK-9628 Project: Flink

Re: Ordering of stream from different kafka partitions

2018-06-20 Thread Andrey Zagrebin
Hi Amol, > In above code also it will sort the records in specific time window only. All windows will be emitted as watermark passes the end of the window. The watermark only increases. So the non-overlapping windows should be also sorted by time and as a consequence the records across windows

[jira] [Created] (FLINK-9627) Extending

2018-06-20 Thread JIRA
Dominik WosiƄski created FLINK-9627: --- Summary: Extending Key: FLINK-9627 URL: https://issues.apache.org/jira/browse/FLINK-9627 Project: Flink Issue Type: Bug Reporter: Dominik

[jira] [Created] (FLINK-9626) Possible resource leak in FileSystem

2018-06-20 Thread Piotr Nowojski (JIRA)
Piotr Nowojski created FLINK-9626: - Summary: Possible resource leak in FileSystem Key: FLINK-9626 URL: https://issues.apache.org/jira/browse/FLINK-9626 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9625) Enrich the error information to user

2018-06-20 Thread mingleizhang (JIRA)
mingleizhang created FLINK-9625: --- Summary: Enrich the error information to user Key: FLINK-9625 URL: https://issues.apache.org/jira/browse/FLINK-9625 Project: Flink Issue Type: Improvement

Re: Ordering of stream from different kafka partitions

2018-06-20 Thread Amol S - iProgrammer
Hello Andrey, In above code also it will sort the records in specific time window only. Anyways we agreed to create N number of partitions with N number of consumers based on some key as order is maintained per kafka partition. I have some questions about this. 1. How should I create N

[jira] [Created] (FLINK-9624) Move jar/artifact upload logic out of JobGraph

2018-06-20 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9624: --- Summary: Move jar/artifact upload logic out of JobGraph Key: FLINK-9624 URL: https://issues.apache.org/jira/browse/FLINK-9624 Project: Flink Issue

[jira] [Created] (FLINK-9623) Move zipping logic out of blobservice

2018-06-20 Thread Chesnay Schepler (JIRA)
Chesnay Schepler created FLINK-9623: --- Summary: Move zipping logic out of blobservice Key: FLINK-9623 URL: https://issues.apache.org/jira/browse/FLINK-9623 Project: Flink Issue Type:

Re: Ordering of stream from different kafka partitions

2018-06-20 Thread Andrey Zagrebin
Hi, Good point, sorry for confusion, BoundedOutOfOrdernessTimestampExtractor of course does not buffer records, you need to apply windowing (e.g. TumblingEventTimeWindows) for that and then sort the window output by time and emit records in sorted order. You can also use windowAll which

Re: Ordering of stream from different kafka partitions

2018-06-20 Thread sihua zhou
Hi, I think a global ordering is a bit impractical on production, but in theroy, you still can do that. You need to - Firstly fix the operate's parallelism to 1(except the source node). - If you want to sort the records within a bouned time, then you can keyBy() a constant and window it,

Re: Breakage in Flink CLI in 1.5.0

2018-06-20 Thread Till Rohrmann
It will, but it defaults to jobmanager.rpc.address if no rest.address has been specified. On Wed, Jun 20, 2018 at 9:49 AM Chesnay Schepler wrote: > Shouldn't the non-HA case be covered by rest.address? > > On 20.06.2018 09:40, Till Rohrmann wrote: > > Hi Sampath, > > it is no longer possible to

Re: Breakage in Flink CLI in 1.5.0

2018-06-20 Thread Chesnay Schepler
Shouldn't the non-HA case be covered by rest.address? On 20.06.2018 09:40, Till Rohrmann wrote: Hi Sampath, it is no longer possible to not start the rest server endpoint by setting rest.port to -1. If you do this, then the cluster won't start. The comment in the flink-conf.yaml holds only

Re: Breakage in Flink CLI in 1.5.0

2018-06-20 Thread Till Rohrmann
Hi Sampath, it is no longer possible to not start the rest server endpoint by setting rest.port to -1. If you do this, then the cluster won't start. The comment in the flink-conf.yaml holds only true for the legacy mode. In non-HA setups we need the jobmanager.rpc.address to derive the hostname

Re: Ordering of stream from different kafka partitions

2018-06-20 Thread Amol S - iProgrammer
Hello Andrey, Thanks for your quick response. I have tried with your above code but it didn't suit's my requirement. I need global ordering of my records by using multiple kafka partitions. Please suggest me any workaround for this. as mentioned in this

Re: Breakage in Flink CLI in 1.5.0

2018-06-20 Thread Chesnay Schepler
I was worried this might be the case. The rest.port handling was simply copied from the legacy web-server, which explicitly allowed shutting it down. It may (I'm not entirely sure) also not be necessary for all deployment modes; for example if the job is baked into the job/taskmanager images.

[jira] [Created] (FLINK-9622) DistributedCacheDfsTest failed on travis

2018-06-20 Thread Sihua Zhou (JIRA)
Sihua Zhou created FLINK-9622: - Summary: DistributedCacheDfsTest failed on travis Key: FLINK-9622 URL: https://issues.apache.org/jira/browse/FLINK-9622 Project: Flink Issue Type: Bug

[jira] [Created] (FLINK-9621) Warning when enabling partition discovery

2018-06-20 Thread Olivier Zembri (JIRA)
Olivier Zembri created FLINK-9621: - Summary: Warning when enabling partition discovery Key: FLINK-9621 URL: https://issues.apache.org/jira/browse/FLINK-9621 Project: Flink Issue Type:

[jira] [Created] (FLINK-9620) Add an alternative option to choose when deal with eventtime cep

2018-06-20 Thread aitozi (JIRA)
aitozi created FLINK-9620: - Summary: Add an alternative option to choose when deal with eventtime cep Key: FLINK-9620 URL: https://issues.apache.org/jira/browse/FLINK-9620 Project: Flink Issue