Re: KeyGroupRangeAssignment ?

Hi Ovidiu, the way Flink works is to assign key group ranges to operators. For each element you calculate a hash value and based on that you assign it to a key group. Thus, in your example, you have either a key group with more than 1 key or multiple key groups with 1 or more keys assigned to an

Re: Question about Async IO

Hi Gyula, the assumption is that the AsyncCollector is either completed by the user or, if you have a timeout defined, that it will be completed with a timeout exception. This means that if you have no timeout defined, then you have to make sure that the collector is completed. Otherwise you will

Re: Question about Async IO

ust my thoughts, now I also understand the current rationale just I didn't > completely get it for the first pass. > > Gyula > > Till Rohrmann <trohrm...@apache.org> ezt írta (időpont: 2017. febr. 20., > H, > 15:35): > > > Hi Gyula, > > > > the

Re: Redis sink in Flink 2.0

Hi Imalds, Flink's redis connector has been moved to Apache Bahir [1]. [1] https://github.com/apache/bahir-flink/tree/master/flink-connector-redis Cheers, Till On Fri, Feb 24, 2017 at 7:42 AM, lmalds wrote: > Hi!I want to know why the Redis Sink connector is

Re: Flink ML - NaN Handling

Hi Stavros, so far we've sticked mainly to scikit-learn in terms of semantics. Thus, I would recommend to follow scikit-learn's approach to handle NaNs. Cheers, Till On Fri, Feb 10, 2017 at 11:48 PM, Stavros Kontopoulos < st.kontopou...@gmail.com> wrote: > Hello guys, > > Is there a story for

Re: Support for daylight saving timezone changes in Flink

Hi Swapnil, Flink does not have explicit support for this. It's the responsibility of the user to make sure that the right watermarks are extracted from the incoming events. This also means the correct handling of different time zones. Cheers, Till On Tue, Feb 14, 2017 at 8:41 AM, Swapnil

Re: New Flink team member - Kate Eri.

Hi Katherin, welcome to the Flink community. Always great to see new people joining the community :-) Cheers, Till On Tue, Jan 17, 2017 at 1:02 PM, Katherin Sotenko wrote: > ok, I've got it. > I will take a look at https://github.com/apache/flink/pull/2735. > > вт, 17

Re: 答复: [DISCUSS] Apache Flink 1.2.0 RC0 (Non-voting testing release candidate)

ll produced correct results. > > > > 2017-01-12 17:45 GMT+01:00 Till Rohrmann <trohrm...@apache.org>: > >> I'm wondering whether we should not depend the webserver encryption on the >> global encryption activation and activating it instead per default. >> >&g

Re: [DISCUSS] FLIP-3 - Organization of Documentation

hub.com/apache/flink/pull/2387 > > > > On Tue, Aug 2, 2016 at 5:18 PM, Aljoscha Krettek <aljos...@apache.org> > > wrote: > > > +1 > > > > > > On Tue, 2 Aug 2016 at 03:15 Till Rohrmann <trohrm...@apache.org> > wrote: > > > > > >> +

Re: [DISCUSS] FLIP-9: Trigger DSL

Cool design doc Klou. It's well described with a lot of details. I like it a lot :-) +1 for implementing the trigger DSL. Cheers, Till On Tue, Aug 16, 2016 at 3:18 PM, Kostas Kloudas wrote: > Thanks for the feedback Ufuk! > I will do that. > > > On Aug 16, 2016,

Re: [DISCUSS] FLIP-10: Unify Savepoints and Checkpoints

+1 for the FLIP. I like the described changes and new functionality. When looking at the public interface, I was wondering whether we should not allow the user to specify a TimeUnit for the periodic interval. I think it's nicer to be able to specify the time unit instead of converting everything

Re: [FLINK-305] Code test coverage - how FLINK using it?

to see if this solution acceptable and does not affect > build duration too much. > > 2016-08-19 12:51 GMT+03:00 Till Rohrmann <trohrm...@apache.org>: > > > Hi Pavel, > > > > I think it's a good point you're raising here. The Flink community isn't > > using m

Re: [DISCUSS] Code style / checkstyle

No, I think that's exactly what people mean when saying "losing the commit history". With the reformatting you would have to go manually through all past commits until you find the commit which changed a given line before the reformatting. Cheers, Till On Sun, Feb 26, 2017 at 6:32 PM, Alexander

Re: Task manager processes crashing one after the other

Hi Gyula, I haven't seen this problem before. Do you have the logs of the failed TMs so that we have some more context what was going on? Cheers, Till On Thu, Aug 25, 2016 at 9:40 AM, Gyula Fóra wrote: > Hi guys, > > For quite some time now we fairly frequently experience a

Re: Reducing the JIRA PR message verbosity

+1 On Fri, Sep 2, 2016 at 4:20 PM, Fabian Hueske wrote: > +1 > > Thanks Max! > > 2016-09-02 15:20 GMT+02:00 Stephan Ewen : > > > Sounds good to me! > > > > On Fri, Sep 2, 2016 at 3:08 PM, Maximilian Michels > wrote: > > > > > If there are

Re: Contribution

Welcome back Hasan :-) What are you interested in (e.g. libraries, backend, frontend)? Cheers, Till On Fri, Sep 9, 2016 at 2:02 PM, Gábor Gévay wrote: > Hi Hasan, > > Welcome! > There is the "starter" label on some Jiras, which means that the issue > is good for getting

Re: Flink HA on AWS: Network related issue

Hi Deepak, could you check the logs whether the JobManager has been quarantined and thus, cannot be connected to anymore? The logs should at least contain a hint why the TaskManager lost the connection initially. Cheers, Till On Thu, Sep 8, 2016 at 7:08 PM, Deepak Jha

Re: Gelly Library. Need an example

Hi Olga, can you provide us with a little bit more details about the problem. The full stack trace of the exception and the program you're trying to run would be helpful. Cheers, Till On Wed, Sep 14, 2016 at 9:49 PM, Olga Golovneva wrote: > Hi devs, > > Do you know if

Re: build error

I agree with Ivan. This does not look like a Flink specific problem. Have you tried building other projects with your maven and JDK version? Cheers, Till On Thu, Sep 15, 2016 at 2:15 PM, Ivan Mushketyk wrote: > Hi Ameet, > > This seems like a possible JVM bug. > Could

Re: Gelly Library. Need an example

.fromCollection(edgeList); > } > //Define vertices > private static DataSet<Vertex<Long, Long>> > getVertexDataSet(ExecutionEnvironment env) { > //We will summarize by = Long > Object[][] DEFAULT_VERTICES = new Object[][] { > new O

Re: [Discuss] Upgrade JUnit to 4.12

+1 for that :-) On Tue, Oct 4, 2016 at 10:11 PM, Greg Hogan wrote: > PowerMock reports "org.powermock.reflect.exceptions. > FieldNotFoundException: > Field 'fTestClass' was not found in class > org.junit.internal.runners.MethodValidator." >

Re: ML contributions

Great to hear Gabor :-) I hope that the community will help out with reviewing of the algorithms so that we can give quick feedback. Looking forward to your contributions. Cheers, Till On Mon, Sep 12, 2016 at 10:34 AM, Gábor Hermann wrote: > Hey all, > > We are planning

Re: Savepoint and restart in the same command?

Hi Ron, Konstantin is absolutely right. One of the missing features is an atomic stop with savepoint operation to shut down a job in a clean manner. We will hopefully have this soon. Cheers, Till On Tue, Sep 13, 2016 at 11:53 AM, Konstantin Knauf < konstantin.kn...@tngtech.com> wrote: > Hi

Re: Gelly Library. Need an example

.com> >> wrote: >> >> Hi Till, >>> >>> Thanks a lot for your help! I'll try to use another variable type in the >>> meantime. >>> >>> Best regards, >>> Olga >>> >>> >>> Best regards, >>> Olga Golo

Re: [DISCUSS] how choose Scala and Java

I think you're referring to the implementation of some of Flink's modules, right? If that is the case, then the rule of thumb is that we want to use Java for the low level runtime implementations. For the API implementations it is a case to case decision. The Scala API, for example is of course

Re: [HEADS-UP] Dev Week 33

Good initiative @Aljoscha. - Just a convenience link for FLIP-6: The feature branch can be found here https://github.com/apache/flink/tree/flip-6. - My main task is the review of the Mesos PR of Eron ( https://github.com/apache/flink/pull/2315) so that we can continue making progress there. On

Re: [DISCUSS] Move Redis and Flume connectors to Apache Bahir and redirect contributions there

+1 On Thu, Aug 18, 2016 at 10:21 AM, Aljoscha Krettek wrote: > +1 > > On Thu, 18 Aug 2016 at 03:54 Jark Wu wrote: > > > Good start point. +1 > > > > > > > > - Jark Wu > > > > > 在 2016年8月17日，下午11:24，Robert Metzger 写道： > > >

Re: Enabling Encryption between slaves in Flink

Hi Vinay, it's not only done by enabling encryption of the Akka messages since the TaskManager to TaskManager communication utilizes Netty. There is a JIRA issue which tracks the progress on implementing secured communication within Flink: https://issues.apache.org/jira/browse/FLINK-3931. Feel

Re: why job submit timeout is 21474835 second

If I'm not mistaken then this was a limitation of Akka's ask futures. The maximum timeout was as specified. It might have changed with a new version, though. Usually, you should rarely run into a case where this actually matters. Cheers, Till On Mon, Aug 29, 2016 at 5:44 PM, Greg Hogan

Re: Additional project downloads

I agree that it would be good to offer these kind of convenience download links. On Wed, Aug 24, 2016 at 5:25 PM, Robert Metzger wrote: > Maybe we should put a link to maven central. We could parameterize the link > so that it always links to the current release linked on

Re: [DISCUSS] Mesos Dispatcher (FF2016)

I agree with Max since it hard to foresee when Flip-6 is really done. Cheers, Till On Wed, Sep 28, 2016 at 4:24 PM, Maximilian Michels wrote: > Hi Eron, > > Great to see so much progress on the Mesos implementation! Thank you > for sharing the code with us. > > I'm not

Re: [DISCUSS] Merge batch and stream connector modules

I think this only holds true for modules which depend on the batch or streaming counter part, respectively. We could refactor these modules by pulling out common types which are independent of streaming/batch and are used by the batch and streaming module. Cheers, Till On Fri, Sep 23, 2016 at

Re: FailureRate Restart Strategy is not picked from Config file

Hi Deepak, are you running Flink streaming jobs with checkpointing enabled? In this case Flink will check if you've set a restart strategy at your job and if not it will set the fixed delay restart strategy. This will effectively overwrite the default restart strategy which you define in the

Re: No support for request PutMappingRequest

Hi Ozan, I'm not super experienced with Flink's elasticsearch connector, but could you post the complete stack trace to figure out where the problem comes from? I've also pulled in Aljoscha, the original author of the elasticsearch sink. Maybe he can give you a detailed answer. Cheers, Till On

Re: Left outer join

Hi Thomas, either you map your input data set into a tuple input.map(x => Tuple1(x)) or you specify a key selector leftOuterJoin(metrics).where(x => x).equalTo(0). I think the user ML u...@flink.apache.org would be a better place to ask Flink usage related questions. The dev ML is mainly used

Re: Could Not Submit Job DataStream Because No Connection to a JobManager

Hi David, the dev ML is intended for technical discussions about Flink. Problems related to the usage of Flink should go to the u...@flink.apache.org. Be aware that the ML does not allow attachments. Thus, we don't see your JobManager log. Cheers, Till On Mon, Nov 7, 2016 at 8:53 PM, daviD

Re: [DISCUSS] Proposed updates to Flink project site

I agree with Aljoscha and Ufuk. Making the Flink website more accessible for newcomers would be a big gain :-) +1 for the changes. Cheers, Till On Tue, Nov 8, 2016 at 9:43 AM, Ufuk Celebi wrote: > I really like your proposal. +1. > > I did some of the previous site updates,

Re: Deterministic processing with out-of-order streams

You're right if you want to guarantee a deterministic computation for an arbitrary allowed lateness. In the general case, you would never be able to calculate the final result of a window in a finite time, because there might always be another element which arrives later. However, for most

Re: Flink using Yarn on MapR

Hi Naveen, I could reproduce your problem with the given Hadoop version (2.7.0-mapr-1607). It seems to me as if this version always tries to use Kerberos even though I selected the AuthenticationMethod.SIMPLE (no Kerberos activated). I've also tested it with vanilla Hadoop 2.7.3 and there it

Re: Deterministic processing with out-of-order streams

Hi Jaromir, deterministic processing with late elements is indeed more difficult than without them. What you have to do is to send updates to your downstream operators in case that you see late elements. This can either be an incremental update or a retraction with the corrected value. It

Re: Add MapState for keyed streams

Hi Xiaogang, I really like your proposal and think that this would be a valuable addition to Flink :-) For convenience we could maybe add contains(K key), too. Java's Map interface returns a Set of Entry when calling entrySet() (which is the equivalent of iterator() in our interface). The Entry

Re: Efficient Batch Operator in Streaming

Hi Xiaowei, thanks for sharing this proposal. How would fault tolerance work with the BatchFunction? Since the batch function seems to manage its own buffer, users would also have to make sure that in-flight elements which are buffered but not yet processed are checkpointed, wouldn't they?

Re: Add partitionedKeyBy to DataStream

Hi Xiaowei, I like the idea to reuse a partitioning and thus saving a shuffle operation. It would be great if we could fail at runtime in case the partitioning changed somehow. That way a logical user failure won't go unnoticed. Would it make sense to name the method partitionedByKey(...)

Re: Flink Metrics

Hi Govind, I think the DropwizardMeterWrapper implementation is just a reference implementation where it was decided to report the minute rate. You can define your own meter class which allows to configure the rate interval accordingly. Concerning Timers, I think nobody requested this metric so

Re: TopSpeedWindowing - in error: Could not forward element to next operator

Hi Ovidiu, which version of Flink are you using? Cheers, Till On Thu, Oct 20, 2016 at 6:38 PM, Ovidiu Cristian Marcu < ovidiu.cristian.ma...@huawei.com> wrote: > Could you check the following issue on master? > > When running this example org.apache.flink.streaming.examples.windowing. >

Re: [VOTE] Release Apache Flink 1.1.4 (RC1)

+1 for Ufuk's proposal to cancel the vote in favour of a new RC. +1 for including FLINK-5065. I'm currently backporting the fix. On Tue, Nov 15, 2016 at 9:08 AM, Ufuk Celebi wrote: > Furthermore, I think this issue is a blocker: > >

Re: [DISCUSS] deprecated function need more detail

+1 for your proposal. Cheers, Till On Wed, Nov 23, 2016 at 9:33 AM, Fabian Hueske wrote: > I agree on this one. > Whenever we deprecate a method or a feature we should add a comment that > explains the new API or why the feature was removed without replacement. > > Enforcing

Re: [DISCUSS] @Public libraries

I think in general annotating library methods/classes is a good idea. The question is just which APIs are going to be marked stable. In the past we've seen that we might have marked some of Flink's APIs stable too early. As a consequence we have to carry them along for quite some time (at the

Re: Kafka Sink stuck in cancelling

Hi Gyula, I'm not aware of any recent issues with the Kafka Producer. However there was one with the Kafka Consumer which prevented the proper cancellation ( https://issues.apache.org/jira/browse/FLINK-5048). Which version of Flink and which Kafka Producer were you using? Cheers, Till On Tue,

Re: Window's Checkpoint problem

Hi 时某人, I think you've found an inconsistency in Flink's windowing API (but it's the same in the Java API). Handling operator state in the context of windows is a little bit delicate because you could have multiple windows in flight, though. I've pulled Aljoscha in this thread who is more

Re: Add Sonarqube analysis

Hi Boris, I think it is a good idea to gather some more metrics about Flink's code quality. This can help to address deficiencies and finally improve Flink's code and test coverage. So +1 for adding it if it does not conflict with any Apache regulations. But given anlaysis.apache.org it seems to

Re: Request for permissions in JIRA

Hi Sergey, I've given you the permissions to assign yourself to JIRA issues. Cheers, Till On Thu, Nov 17, 2016 at 12:31 PM, Sergey Sokur wrote: > Hi folks! > > I'd like to resolve issue but I can't assigned it to me. Could you please > give me enough permissions in

Re: [Discuss] State Backend use external HBase storage

Hi Jinkui, the file system state backend and the RocksDB state backend can be configured (and usually should be) such that they store their checkpoint data on a reliable storage system such as HDFS. Then you also have the reliability guarantees. Of course, one can start adding more state

Re: [HEADS UP] Introducing ConfigOptions

+1 for the ConfigOptions and the automatic configuration description generation once we've migrated all config keys. Cheers, Till On Fri, Oct 28, 2016 at 2:18 PM, Robert Metzger wrote: > You are right Stephan. The doc migration will be easier when we use the new > logic

Re: "Cannot resolve map"

Hi Thomas, Flink does not support partial functions due to the map method being overloaded. Instead you can write map{ x match { case ... => } } or you import org.apache.flink.scala.extensions.acceptPartialFunctions and then write .zipWithIndex.mapWith { case ... => }. Cheers, Till ​ On Fri,

Re: [DISCUSS] Releasing Flink 1.1.4

I'll work on FLINK-3347. Additionally I would like to get in - https://issues.apache.org/jira/browse/FLINK-4932: Don't let ExecutionGraph fail when in state Restarting - https://issues.apache.org/jira/browse/FLINK-4933: ExecutionGraph.scheduleOrUpdateConsumers can fail the ExecutionGraph Cheers,

Re: FLIP-6 and FLIP-12

+1 for the changes and thanks for updating the Flips. Cheers, Till On Wed, Oct 26, 2016 at 1:05 PM, Stephan Ewen wrote: > Hi all! > > I updated the wiki with the following: > > FLIP-12 (async I/O) should go into Flink 1.2. A pull request is there, > reviews have started. > >

Re: [DISCUSS] Schedule and Scope for Flink 1.2

+1 for the features to include. What is the state of the Trigger DSL? How much is left to be done before merging? Cheers, Till On Tue, Oct 25, 2016 at 4:32 PM, Aljoscha Krettek wrote: > +1 the schedule proposed so far. > > Do we also want to get in the "Trigger DSL" that

Re: [DISCUSS] Support Suspending and Resuming of Flink Jobs

Hi Greg, at the moment the serialization of savepoints costs the same as the serialization of checkpoints, because they use the same serialization logic. In fact, with Ufuk's changes [1], a savepoint is a checkpoint with special properties. However, in the future we will probably have different

Re: Allow TypeInfofactory regisration via ExecutionConfig

Hi Alexander, I guess that Timo will be able to give a more detailed answer, but I agree with your assessment. The TypeInfo annotation does not solve all the problems as you've stated. Thus, making the TypeExtractor.registerFactory method public would solve the problem. I'm just wondering whether

Re: [VOTE] Release Apache Flink 1.1.3 (RC2)

+1 (binding) - mvn clean verify for (Scala 2.10, Hadoop 2.3.0), (Scala 2.11, Hadoop 2.4.1), (Scala 2.10, Hadoop 2.6.3), (Scala 2.11, Hadoop 2.7.2) - Run examples using the FliRRT tool on multi node cluster. Cheers, Till On Wed, Oct 12, 2016 at 5:32 PM, Neelesh Salian

Re: [DISCUSS] Schedule and Scope for Flink 1.2

We might also think about addressing: Relocate Flink's Hadoop dependency and its transitive dependencies (FLINK-5297), because a user reported that they cannot use the system due to a dependency issue. Cheers, Till On Thu, Dec 8, 2016 at 10:17 AM, Robert Metzger wrote: >

Re: [DISCUSS] Merging the FLIP-6 feature branch into the Master branch

I agree with Stephan. +1 for merging it after forking 1.2 off and trying to do this in the near future. Cheers, Till On Fri, Dec 9, 2016 at 11:50 AM, Stephan Ewen wrote: > I would be +1 to merge the FLIP-6 branch to the master branch after the 1.2 > branch is forked off, if

Re: Travis build broken on missing licenses

Thanks Marton. On Wed, Dec 7, 2016 at 8:24 AM, Fabian Hueske wrote: > Thanks Marton! > > 2016-12-07 2:49 GMT+01:00 Márton Balassi : > > > Done, my Travis build came in all green: > > > > https://travis-ci.org/mbalassi/flink/builds/181809550 > > > >

Re: Travis CI

I'm in favour of splitting the project up into multiple repositories. This will decrease building and testing time locally as well as on Travis. The downside, however, will be that if not built together, conflicting changes between different modules might go unnoticed until the release or the next

Re: some questions about submit flink job on flink-yarn

Hi Huang, this seems to be very strange, because the JobManager’s actor system has bound to the address 9-96-101-177 instead of 9.96.101.177. It seems a if the . have been replaced by -. Could you maybe tell me which version of Flink you’re running and also share the complete JobManager log with

Re: Flink CEP development is stalling

Hi Ivan, first of all let me apologise for the bad experience you've had with opening CEP PRs in the past. The general problem as you've said is that there is nobody who reviews the open PRs. I used to do this in the but at the moment I hardly find time due to other commitments. I think the way

Re: some questions about submit flink job on flink-yarn

skmanager) as > 5d65baf1ec196cf3ac5bc43870156855. Current number of registered hosts is > 2. Current number of alive task slots is 2. > 2017-01-14 09:24:45,855 INFO org.apache.flink.yarn.YarnFlinkResourceManager > - TaskManager container_1483499303549_0043_01_04 has

Re: Categorize or GroupBy datastream data and process with CEP separately

Hi, Flink’s Pattern API allows you to specify a time interval for a pattern to occur. Use the within call to specify a valid time interval for your pattern. Pattern pattern = ...; Pattern timedPattern = pattern.within(Time.minutes(10)); Cheers, Till ​ On Thu, Jan 5, 2017 at

Re: [FLINK-3615] Add support for non-native SQL types

Hi Alex, I guess that Fabian and Timo (cc'ed) will be able to answer this question. Cheers, Till On Wed, Dec 28, 2016 at 9:38 AM, Alexander Chermenin wrote: > Hi all. > > Is FLINK-3615 an actual > issue now? Or it has

Re: [ANNOUNCE] Flink 1.1.4 Released

Thanks a lot Ufuk for your hard work. Good work team! :-) On Sun, Dec 25, 2016 at 3:50 PM, Jean-Baptiste Onofré wrote: > Great. Good job team ! > > Regards > JB⁣​ > > On Dec 25, 2016, 11:04, at 11:04, Aljoscha Krettek > wrote: > >Very nice. Good work,

Re: time format for akka status

Hi Alexey, this is a good proposal. Could you open a corresponding JIRA issue for this change? Cheers, Till On Sun, Jan 8, 2017 at 8:32 AM, Alexey Demin wrote: > Hi > > In ExecutionGraphMessages we have code > > private val DATE_FORMATTER: SimpleDateFormat = new >

Re: [DISCUSS] schedule for execution from different list of ExecutionJobVertex

Hi Jinkui, the difference between `getVerticesTopologically` and `tasks.values()` is that the former returns an `Iterator` which iterates over the different `ExecutionJobVertices` in topological order whereas the latter returns a simple collection of `ExecutionJobVertices` with no specified

Re: time format for akka status

n console (System.out ) > and for longrunning applications print hours without date very > uninformative. > > What do you think? > > Thanks, > Alexey > > > 2017-01-09 17:25 GMT+04:00 Till Rohrmann <trohrm...@apache.org>: > > > Hi Alexey, > &g

Re: [DISCUSS] Proposed updates to Flink project site

Great work Mike :-) I like the new web page a lot. Some comments: - Can we put a higher resolved Flink logo picture. Looks not good on my monitor and mobile - When browsing the web page on my phone, I noticed that all nav bar items start at the very left border. Maybe some kind of padding would

Re: [Bug]Question about StreamExecutionEnvironment.createRemoteEnvironment

Hi, this is definitely a bug you're describing. The problem is that with FLINK-2821 [1], we can no longer resolve the hostname on the JobManager. Thus, you should specify the external hostname of the machine on which you have started the JobManager (given that you've used the very same hostname

Re: [DISCUSS] TravisCI auto cancellation

Looking at Flink's Travis account, I've got the feeling that this feature has already been activated. At least I see some builds (e.g. PR #3625) where multiple commits where created in a short time and then only the latest was actually executed. Apart from that I think it's a good idea since it

Re: Question about flink client

due to missing files on HDFS. As a workround, I can config > `akka.lookup.timeout` to wait a bit longer, say 60 seconds. But I'm > wondering if it will affect other components." > > Thanks, > Yelei > > From: Till Rohrmann <

Re: [ANNOUNCE] Apache Flink 1.1.5 Released

Thanks a lot for your work being the release manager Gordon. Also thanks a lot to the community for all the bug fixes which went into 1.1.5. On Fri, Mar 24, 2017 at 3:40 PM, Stephan Ewen wrote: > Thanks a lot, Gordon, for being the release manager for that release! > > > On

Re: Question about flink client

Hi Yelei, thanks for investigating the problem and pointing out the problematic parts. In fact, I recently stumbled across the very same problem in the JobClientActor and wrote a fix for it. It is already merged into the master. I hope that this fix solved the problem you've described. Cheers,

Re: [DISCUSS] Project build time and possible restructuring

istory, this may become a bottleneck eventually > as well. > > - There is less risk of broken master. If one repository/modules breaks > its master, the others can still continue. > > Stephan > > > On Fri, Mar 10, 2017 at 12:20 PM, Till Rohrmann <trohrm...@apache.org> > wrote:

Re: [DISCUSS] Project build time and possible restructuring

milar to the main documentation. > > > 6. I'll update the documentation build process to build both > > documentations > > > & link them to each other > > > 7. I'll update the nightly deployment process to include both > > repositories > > > 8. I'l

Re: [VOTE] Release Apache Flink 1.2.1 (RC1)

+1 for option 1) On Mon, Apr 3, 2017 at 5:48 PM, Fabian Hueske wrote: > +1 to option 1) > > 2017-04-03 16:57 GMT+02:00 Ted Yu : > > > Looks like #1 is better - 1.2.1 would be at least as stable as 1.2.0 > > > > Cheers > > > > On Mon, Apr 3, 2017 at 7:39

Re: [Bug]Question about StreamExecutionEnvironment.createRemoteEnvironment

Thanks a lot :-) On Fri, Mar 31, 2017 at 2:59 AM, canbinzheng <2056268...@qq.com> wrote: > Hi, I have opened an issue for the probelm > https://issues.apache.org/jira/browse/FLINK-6224 > > > > -- > View this message in context: http://apache-flink-mailing- >

Re: [VOTE] Release Apache Flink 1.2.1 (RC2)

+1 (binding) for the release - checked checksums and signature - no dependencies added or removed - build Flink with Hadoop 2.7.1 and Scala 2.11 from sources and ran all tests - Ran Flirrt locally, on standalone cluster and Yarn with Hadoop 2.7.1 and Scala 2.10 Cheers, Till On Thu, Apr 13,

Re: [VOTE] Release Apache Flink 1.2.1 (RC2)

If this bug was already present in 1.2.0, then I guess not many users have used this feature. Otherwise we would have seen complaints on the mailing list. >From the JIRA issue description, it looks as if we have to fix it for 1.3.0 anyway. What about fixing it this week and then backporting it to

Re: Wrong argument used in StreamTask when user-defined backend is used

Thanks for the pointer. I will fix it. Cheers, Till On Mon, Mar 13, 2017 at 4:28 PM, Vladislav Pernin < vladislav.per...@gmail.com> wrote: > https://github.com/apache/flink/blob/master/flink- > streaming-java/src/main/java/org/apache/flink/streaming/ > runtime/tasks/StreamTask.java#L716 > >

Re: [DISCUSS] Release Flink 1.1.5 / Flink 1.2.1

Thanks for kicking off the discussion Tzu-Li. I'd like to add the following issues which have already been merged into the 1.2-release and 1.1-release branch: 1.2.1: (7) https://issues.apache.org/jira/browse/FLINK-5942 Hardens the checkpoint recovery in case of corrupted ZooKeeper data.

Re: Machine Learning on Flink - Next steps

Thanks Theo for steering Flink's ML effort here :-) I'd vote to concentrate on - Online learning - Low-latency prediction serving because of the following reasons: Online learning: I agree that this topic is highly researchy and it's not even clear whether it will ever be of any interest

Re: Flink 1.2 / YARN on Secure MapR Cluster

Hi, could it be that this issue is related to [1]? If so, then it should soon be fixed. [1] https://issues.apache.org/jira/browse/FLINK-5949 Cheers, Till On Wed, Mar 8, 2017 at 11:50 PM, dschexna wrote: > I am attempting to run flink / YARN on a secure MapR 5.2 cluster.

Re: [DISCUSS] Flink ML roadmap

Hi Roberto, jpmml looks quite promising and this could be a first step towards the model serving story. Thus, looking really forward seeing it being open sourced by you guys :-) @Katherin, I'm not saying that there is no interest in the community to work on batch features. However, there is

Re: [DISCUSS] Project build time and possible restructuring

Thanks for all your input. In order to wrap the discussion up I'd like to summarize the mentioned points: The problem of increasing build times and complexity of the project has been acknowledged. Ideally we would have everything in one repository using an incremental build tool. Since Maven does

Re: Dataset and eager scheduling

Hi CPC, I think that the optimizer does not take the scheduling mode into account when optimizing a Flink job. Cheers, Till On Thu, Mar 2, 2017 at 11:52 AM, CPC wrote: > Hi all, > > Currently our team trying implement a runtime operator also playing with > scheduler. We are

Re: About the ACL of Zookeeper

Hi Zhangrucong, I don't exactly know what's needed to use the ACL of ZooKeeper. I'm pulling Vijay in who implemented this feature. He probably knows more about it. Cheers, Till On Thu, Mar 2, 2017 at 3:09 AM, Zhangrucong wrote: > Hi: > > I want to use the ACL of

Re: [ANNOUNCE] New committer: Theodore Vasiloudis

Great to have you now as a committer, Theo! On Tue, Mar 21, 2017 at 1:02 PM, Stephan Ewen wrote: > Good to have you, Theo! > > On Tue, Mar 21, 2017 at 11:51 AM, Ufuk Celebi wrote: > > > Great news! :-) > > > > > > On Tue, Mar 21, 2017 at 10:32 AM, Aljoscha

Re: [ANNOUNCE] New Flink PMC member: Chesnay Schepler

Congrats Chesnay :-) On Sun, Jul 30, 2017 at 1:34 AM, jincheng sun wrote: > Congrats Chesnay! > > > > 2017-07-30 1:43 GMT+08:00 Shaoxuan Wang : > > > Congratulations Chesnay! > > > > On Fri, Jul 28, 2017 at 10:05 PM, Greg Hogan

Re: [POLL] Dropping savepoint format compatibility for 1.1.x in the Flink 1.4.0 release

+1 On Wed, Aug 2, 2017 at 9:12 AM, Stefan Richter wrote: > +1 > > Am 28.07.2017 um 16:03 schrieb Stephan Ewen : > > Seems like no one raised a concern so far about dropping the savepoint > format compatibility for 1.1 in 1.4. > > Leaving this

Re: [DISCUSS] Service Authorization (redux)

Dropping Java 7 alone is not enough to move to Akka 2.4+. For that we need at least Scala 2.11. Cheers, Till On Tue, Aug 1, 2017 at 4:22 PM, Aljoscha Krettek wrote: > Hi Eron, > > I think after Dropping support for Java 7 we will move to Akka 2.4+, so we > should be good

Re: [VOTE] Release 1.3.2, release candidate #3

+1 - Checked checksums and GPG files - Sources contain no binaries - Check all POM files point to the same version - Read readme file - Build from source archive with Hadoop 2.8.1 - Test start up scripts for local and standalone mode - Test job submission for multi-node cluster - Plan-visualizer

Re: Make SubmittedJobGraphStore configurable

If there is a need for this, then we can definitely make this configurable. The interface SubmittedJobGraphStore is already there. Cheers, Till ​ On Fri, Jul 7, 2017 at 6:32 AM, Chen Qin wrote: > Sure, > ​ I would imagine ​couple of extra lines within flink.conf > ​...​ >

<    1   2   3   4   5   6   7   8   9   10   >