Re: [DISCUSS] Start a user...@flink.apache.org mailing list for the Chinese-speaking community?

+1 great idea! On Fri, Jan 25, 2019 at 11:28 AM Till Rohrmann wrote: > +1, I like this idea very much. > > On Fri, Jan 25, 2019 at 5:38 AM Jark Wu wrote: > > > a big +1 to this! > > > > An user-zh mailing list will help more Chinese speaking users and there > > will be more people willing to

Re: [DISCUSS] Proposed updates to Flink project site

Love it! I would merge this asap Some comments (not blockers) - I was looking for the downloads page for a minute, until I saw that it is linked via the big blue button :) Did anyone have the same problem? - Do we still link to the wiki? - Maybe too much info is buried under the Community &

Re: [DISCUSS] ElasticSearch in Flink Strategy

+1 for keeping the ES connector in Flink On Mon, Jan 9, 2017 at 2:53 PM, Robert Metzger wrote: > Thanks for bringing this up again Flavio. > > The good thing about a common base for all ES connectors is that we can fix > the issue for all ES versions (ideally). > > Thanks a

Who's hiring, December 2016

Hi folks, As promised, here is the first thread for Flink-related job positions. If your organization is hiring people on Flink-related positions do reply to this thread with a link for applications. data Artisans is hiring on multiple technical positions. Help us build Flink, and help our

[ANNOUNCE] New Flink community mailing list

Hi everyone, We have created a new Flink mailing lists, commun...@flink.apache.org where we can post everything related to the broader Flink community including job offers, upcoming meetups and conferences, exciting reads, and everything else that is deemed worthy for the greater Flink community.

Flink survey by data Artisans

Hi everyone! The Apache Flink community has evolved quickly over the past 2+ years, and there are now many production Flink deployments in organizations of all sizes. This is both exciting and humbling :-) data Artisans is running a brief survey to understand Apache Flink usage and the needs of

[ANNOUNCE] Flink Forward 2016: First round of speakers and sessions is out

Hi everyone, I wanted to share this with the community: we have announced the first round of speakers and sessions of Flink Forward 2016, and it looks amazing! Check it out here: http://flink-forward.org/program/sessions/ This year we have a great mix of use case talks (e.g., by Netflix,

Re: [DISCUSS] Putting Flink user names / logos on the homepage

I'd be happy to check with some of these folks On Mon, Jul 4, 2016 at 8:15 AM, Stephan Ewen wrote: > We have the "Powered By" page already. > My naive assumption was that companies that have clearance to put their > name there are also okay with a logo. > After all, it is only

Re: Iteration Intermediate Output

Thanks Greg for opening this discussion! I really really don't want to derail the discussion here, just a quick clarification regarding Suneel's last email: folks that are working at data Artisans are participating in this community as individuals, not as a corporation, and the dev list is not a

Re: Blogpost on Flink's SQL support

+1, great post On Sun, May 22, 2016 at 4:15 PM, Matthias J. Sax wrote: > Will be a nice post! > > On 05/21/2016 10:40 PM, Henry Saputra wrote: > > I agree with Ufuk, that this is more internal posts which perfect for > blog. > > > > For high level and use cases I think would

Re: [PROPOSAL] Structure the Flink Open Source Development

+1 to Henry's comment, once this makes it to the wiki/website the wording needs to make it clear that the governance model is unchanged On Mon, May 16, 2016 at 10:02 AM, Theodore Vasiloudis < theodoros.vasilou...@gmail.com> wrote: > I like the idea of having maintainers as well, hopefully we can

Re: [PROPOSAL] Structure the Flink Open Source Development

Should we also add a component "Flink website and wiki" (minus the documentation) with an associated maintainer? On Fri, May 13, 2016 at 12:17 PM, Timo Walther wrote: > +1 for from my side too > > > > On 13.05.2016 06:13, Chiwan Park wrote: > >> +1 for this proposal >> > > >

Re: [PROPOSAL] Structure the Flink Open Source Development

Big +1 from my side, I think this will help the community grow and prosper big time! On Thu, May 12, 2016 at 1:27 PM, Matthias J. Sax wrote: > +1 from my side. > > Happy to be the maintainer for Storm-Compatibiltiy (at least I guess > it's me, even the correct spelling would

[ANNOUNCE] Flink 1.0.0 has been released

Hi everyone! As you might have noticed, Apache Flink 1.0.0 has been released and announced! You can read more about the release at the ASF blog and the Flink blog - https://blogs.apache.org/foundation/entry/the_apache_software_foundation_announces88 -

Re: [ANNOUNCE] Chengxiang Li added as committer

Welcome Chengxiang!! On Tue, Jan 19, 2016 at 12:31 PM, Stephan Ewen wrote: > Good to have you on board! > > On Tue, Jan 19, 2016 at 11:29 AM, Maximilian Michels > wrote: > > > Pleased to have you with us Chengxiang! > > > > Cheers, > > Max > > > > On Tue, Jan

Re: [ANNOUNCE] Chengxiang Li added as committer

ongrats Chengxiang! Really pleased to have you on board > > > On 19 Jan 2016, at 13:16, Matthias J. Sax <mj...@apache.org> wrote: > > > > Congrats and welcome Chengxiang!! :) > > > > On 01/19/2016 12:56 PM, Kostas Tzoumas wrote: > >> Welcome Chengxiang

Re: Dripping the Flink-on-Tez code for Flink 1.0

+1 from my side Flink on Tez never got a lot of user traction. It served well as a prototype of "this is possible", but since the core functionality will be subsumed by making Flink on YARN resource elastic, I don't see any reason we should have it as part of the Flink codebase. Best, Kostas On

Re: Dripping the Flink-on-Tez code for Flink 1.0

for clarification, I was talking about dropping the code, I am unsure about the consequences of dripping code :-) On Fri, Jan 8, 2016 at 4:57 PM, Kostas Tzoumas <ktzou...@apache.org> wrote: > +1 from my side > > Flink on Tez never got a lot of user traction. It served well a

Re: Effort to add SQL / StreamSQL to Flink

Wow! Thanks Fabian, this looks fantastic! On Thu, Jan 7, 2016 at 4:35 PM, Stephan Ewen wrote: > Super, thanks for that detailed effort, Fabian! > > On Thu, Jan 7, 2016 at 3:40 PM, Matthias J. Sax wrote: > > > Pretty cool! > > > > On 01/07/2016 03:05 PM,

Re: [DISCUSS] Time Behavior in Streaming Jobs (Event-time/processing-time)

Aljoscha, thanks for starting this discussion. I think this will be very important to get right. Can you explain a bit more why the results are "wrong"? I understand that window panes are built on event timestamps (as intended), but fired at regular intervals instead of watermarks. Why is this

[DISCUSS] Flink roadmap for 2016

Hi everyone, I think it is very interesting to both developers and users of Flink to define a roadmap for future development. Together with Stephan, we started a draft containing a couple of areas that we think are important to focus on next.

Re: [DISCUSS] Improving State/Timers/Windows

I suppose that they can start as sugar and evolve to a different implementation. I would +1 the name change to KVState, OperatorState is indeed somewhat confusing, and it will only get harder to rename later. On Mon, Dec 14, 2015 at 11:09 AM, Gyula Fóra wrote: > Would the

Re: [DISCUSS] Improving State/Timers/Windows

ter. > >> > >> On a side not, why would you call it KvState? And what would be called > >> KvState? > >> > >>> On 14 Dec 2015, at 11:14, Kostas Tzoumas <ktzou...@apache.org> wrote: > >>> > >>> I suppose that the

Community choice for Hadoop Summit Europe 2016

Hi everyone, Just a reminder, the community vote for the Hadoop Summit Europe 2016 talks in Dublin is still open until December 15. There is a very good number of talks around Flink submitted, here are the ones that mention "flink" in their abstract:

Re: Distributed DataFrame - ddf.io

Hi Nam-Luc, I cc Rohit who implemented the DDF framework. I would say that the main difference with the Table API is that DDF aims at portability (running the same code using Flink, Spark, or a database), whereas the Table API is meant to be part of Flink itself. Best, Kostas On Thu, Dec 3,

Re: From 0.10 to 1.0

+1 for 1.0, it's the right time if not a bit overdue in my opinion On Fri, Oct 23, 2015 at 12:06 PM, Fabian Hueske wrote: > Yes, let's do it > +1 > > 2015-10-23 12:00 GMT+02:00 Stephan Ewen : > > > +1 for 1.0 :-) > > > > On Fri, Oct 23, 2015 at 11:59 AM,

Powered by Flink

Hi everyone, I started a "Powered by Flink" wiki page, listing some of the organizations that are using Flink: https://cwiki.apache.org/confluence/display/FLINK/Powered+by+Flink If you would like to be added to the list, just send me a short email with your organization's name and a description

Re: Powered by Flink

; flink.apache.org to that page? > > Cheers, Fabian > > 2015-10-19 14:50 GMT+02:00 Kostas Tzoumas <ktzou...@apache.org>: > >> Hi everyone, >> >> I started a "Powered by Flink" wiki page, listing some of the >> organizations that are using Flink:

Re: An update on the DataStream API refactoring WiP

Oh, and of course, support for event time. I might be forgetting more, feel free to add to the list On Fri, Oct 2, 2015 at 2:40 PM, Kostas Tzoumas <ktzou...@apache.org> wrote: > Hi folks, > > Currently, Aljoscha, Stephan, and I are reworking the DataStream API as > discus

Re: An update on the DataStream API refactoring WiP

right, I meant DataStream On Fri, Oct 2, 2015 at 2:47 PM, Robert Metzger <rmetz...@apache.org> wrote: > I suspect: "- Deletion of "DataSet.forward() and .global()"" is a typo, you > meant DataStream ? > > On Fri, Oct 2, 2015 at 2:44 PM, Kostas Tzoumas &

An update on the DataStream API refactoring WiP

Hi folks, Currently, Aljoscha, Stephan, and I are reworking the DataStream API as discussed before. Things are a bit in-flight right now with several commits and pull requests, and the current master containing code from both the old and the new API. I want to give you an idea of how the new API

Re: Pulling Streaming out of staging and project restructure

+1 I wanted to suggest that we rename modules to fully accept streaming as first class, qualifying also "batch" as "batch" (e.g., flink-java --> flink-dataset-java, flink-streaming --> flink-datastream, etc). This would break maven dependencies (temporary hell :-) so it's not a decision to take

Re: Pulling Streaming out of staging and project restructure

;>> "flink-dataset-scala", which is kind of weird. >>> >>> >>> I'm wondering whether we should remove the "flink-test-utils" module. I >>> don't think its really necessary, because we can put the test jars into >>> the &g

Re: Graduating Gelly in 0.10

e is skipped. > > -V. > > On 30 September 2015 at 10:44, Ufuk Celebi <u...@apache.org> wrote: > > > > > > On 30 Sep 2015, at 10:06, Kostas Tzoumas <ktzou...@apache.org> wrote: > > > > > > Does the workaround work, or can FLINK-2443 still appear?

Re: Extending and improving our "How to contribute" page

Big +1. For (1), a discussion in JIRA would also be an option IMO For (2), let us come up with few examples on what constitutes a feature that needs a design doc, and what should be in the doc (IMO architecture/general approach, components touched, interfaces changed) On Wed, Sep 23, 2015 at

[jira] [Created] (FLINK-2740) Create data consumer for Apache NiFi

Kostas Tzoumas created FLINK-2740: - Summary: Create data consumer for Apache NiFi Key: FLINK-2740 URL: https://issues.apache.org/jira/browse/FLINK-2740 Project: Flink Issue Type: New Feature

Re: On integrating Flink with Apache NiFi

I had a discussion with Joe from the NiFi community, and they are interested in contributing a connector between NiFi and Flink. I created a JIRA issue for that: https://issues.apache.org/jira/browse/FLINK-2740 I believe that this is the easiest and most useful integration point to begin with, as

Re: Releasing 0.10.0-milestone1

+1 for a milestone release On Tue, Sep 8, 2015 at 5:43 PM, Robert Metzger wrote: > +1 for a "milestone1" release. We have a lot of good features in master > that people can benefit from. > > On Tue, Sep 8, 2015 at 5:10 PM, Maximilian Michels wrote: > > >

Volunteers needed for Flink Forward 2015 (and they get a free ticket)

Hi folks, The Flink Forward 2015 organizers are looking for volunteers (and they are offering free tickets in exchange). Sign up here if you are interested (or send me an email): http://flink-forward.org/?page_id=495 Best, Kostas

Re: 答复: Some questions about storm metrics

Sounds great. It is easy to create an AverageAccumulator by implementing the org.apache.flink.api.common.accumulators.Accumulator interface, accumulating the sum and the count internally, and dividing in the end. This would be something useful also outside of Storm compatibility. Then,

[ANNOUNCE] Welcome Matthias Sax as new committer

The Project Management Committee (PMC) of Apache Flink has asked Matthias Sax to become a committer, and we are pleased to announce that he has accepted. Matthias has been very active with Flink, and he is the original contributor of the Storm compatibility functionality. Being a committer

Re: 答复: Some questions about storm metrics

Flink accumulators are documented here: https://ci.apache.org/projects/flink/flink-docs-master/apis/programming_guide.html#accumulators--counters I think Aljoscha's idea is to implement Storm metrics on top of those. Huangwei, perhaps you can look whether the interfaces match (basically if Flink

Re: [DISCUSSION] Release current master as 0.9.1 (mod few changes)

+1 for Robert's proposal On Wed, Aug 26, 2015 at 2:48 PM, Fabian Hueske fhue...@gmail.com wrote: I'm +1 for Robert's proposal as well. 2015-08-26 14:46 GMT+02:00 Ufuk Celebi u...@apache.org: +1 I very much like Robert's suggestion. This way we can proceed with the 0.9.1 release as

[ANNOUNCE] Flink Forward 2015 program is online

Hi everyone, Just a shoutout that we have posted the program of Flink Forward 2015 here: http://flink-forward.org/?post_type=day You can expect few changes here and there, but the majority of the talks is in. Thanks again to the speakers and the reviewers! If you have not registered yet, now

Flink color scheme

Hi folks, I have a color scheme for Flink that people can use for presentations, blog posts, etc, based on the Flink logo colors: https://www.dropbox.com/sh/dlstvzw2xzt09hx/AADpzAAmVUuAunWR2RJh7zjYa?dl=0 I'm not saying that we have to use it, just something that is out there in case someone

Re: Gelly Blog Post

I think it reads very well, time to publish :-) On Sun, Aug 23, 2015 at 12:37 PM, Martin Junghanns m.jungha...@mailbox.org wrote: Hi, this is a very nice blog post! I added some minor comments. I am really excited about the future work on partition-centric computation and graph

Re: DataStream API - What does Beta mean?

Stephan was very fast :-) I will just add that production readiness has a lot to do with the runtime code, which is largely shared by the DataSet and the Data Stream API. The beta status does not refer to production-readiness, but rather the ability to still make breaking changes. And the

Re: [ANNOUNCE] New Committer Chesnay Schepler

Welcome Chesnay! On Thu, Aug 20, 2015 at 11:18 AM, Robert Metzger rmetz...@apache.org wrote: The Project Management Committee (PMC) for Apache Flink has asked Chesnay Schepler to become a committer and we are pleased to announce that they have accepted. Chesnay has been very involved with

Re: Revert 78fd2146dd until we have consensus for FLINK-2419?

I'm probably lacking a bit of context, but by reading your conversation at JIRA it seems to me that commit https://github.com/apache/flink/commit/78fd2146dd00da1130910d9f23f09e2504854ef7 does not contain a test, and Robert is asking for a test which means that we do not have consensus. If this

Re: Revert 78fd2146dd until we have consensus for FLINK-2419?

I am not familiar with this part of the code, but this is perhaps a good thing, as this is a matter of policy, not who introduced which bug (I suspect that the policy issue was Robert's motivation for starting a thread at the dev list) So, I think we have two issues: (1) Pull request

Re: Revert 78fd2146dd until we have consensus for FLINK-2419?

the fun of being open source :-) In my opinion it is better to provide a well tested fix later than a potentially sloppy fix earlier. Gyula Kostas Tzoumas ktzou...@apache.org ezt írta (időpont: 2015. júl. 28., K, 20:48): I am not familiar with this part of the code, but this is perhaps a good

Re: Flink contributor list

name should be Mingliang Qi. On 24 Jul 2015, at 11:34, Kostas Tzoumas ktzou...@apache.org wrote: Hi everyone, I compiled an up-to-date list with everyone that has contributed code to the Flink git repository. I used git log to get unique IDs, de-duplicated

Flink contributor list

Richter Timo Walther Maximilian Michels Andra Lungu Henry Saputra Markus Holzemer Yingjun Wu Rico Bergmann Chesnay Schepler Minglian Qi Judit Feher Jonas Traub Mathias Peters Bjorn Lohrmann Peter Szabo Alexander Alexandrov Sebastian Ruf Dennis Schneider Kostas Tzoumas Chiwan Park Paris Carbone Eric

Re: Any planning for Apache Flink 1.0 release?

I agree that once DataStream is out of beta and stabilized we should move to 1.0. My opinion would be to aim for a 0.10 release that contains the breaking changes in the DataStream API to give people time to forward-fit applications, and go for 1.0 afterwards focusing on stability without new

Re: New Flink Runtime Monitor Dashboard

Finally, Flink is a JavaScript project :-) On Wed, Jul 22, 2015 at 6:22 PM, Stephan Ewen se...@apache.org wrote: Hi all! Yesterday, we merged the framework for the new Flink runtime monitor dashboard. New stub, based on angular.js and coffee script.

Re: Theoretical complexity of a coGroup

Hi Andra, CoGroup is not implemented as a Cartesian product, so O(V*E) is not a very accurate approximation. All this depends on what you count. Let's assume single-node execution and that everything fits in memory, and let's count comparisons and UDFs on groups. Then, coGroup sorts both

Re: Read XML from HDFS

Perhaps there is also an existing HadoopInputFormat for XML that you might be able to reuse for your purposes (Flink supports Hadoop input formats). For example, there is an XMLInputFormat in the Apache Mahout codebase that you could take a look at:

Re: Design documents for consolidated DataStream API

) On Mon, Jul 13, 2015 at 4:28 PM Aljoscha Krettek aljos...@apache.org wrote: +1 I like it as well. On Mon, 13 Jul 2015 at 16:17 Kostas Tzoumas ktzou...@apache.org wrote

Re: Design documents for consolidated DataStream API

+1 from my side On Mon, Jul 13, 2015 at 4:15 PM, Stephan Ewen se...@apache.org wrote: Do we have consensus on these designs? If we have, we should get to implementing this soon, because basically all streaming patches will have to be revisited in light of this... On Tue, Jul 7, 2015 at

Re: Flink on Wikipedia

I think it is clear to most people that the only official and (hopefully) up-to-date description of an Apache project is its Apache website, and any paper can get outdated. Perhaps we can change the link to a more up-to-date paper when we have one. I like the article, thanks Matthias! Kostas On

Re: Thoughts About Streaming

I agree with supporting out-of-order out of the box :-), even if this means a major refactoring. This is the right time to refactor the streaming API before we pull it out of beta. I think that this is more important than new features in the streaming API, which can be prioritized once the API is

Re: Send events to parallel operator instances

Wouldn't this kind of cross-task communication break the whole dataflow abstraction? How can recovery be implemented if we allowed something like this? On Thu, Jun 4, 2015 at 5:14 PM, Stephan Ewen se...@apache.org wrote: That is not what Ufuk said. You can use a singleton auxiliary task that

Re: Changed the behavior of DataSet.print()

+1 for printOnTaskManager(prefix) On Tue, Jun 2, 2015 at 1:35 PM, Till Rohrmann trohrm...@apache.org wrote: +1 for printOnTaskManager(prefix) On Tue, Jun 2, 2015 at 12:08 PM, Fabian Hueske fhue...@gmail.com wrote: +1 for writeToWorkerStdOut(prefix) On Jun 2, 2015 11:42, Aljoscha Krettek

Re: SQL on Flink

very excited to see this starting! On Wed, May 27, 2015 at 6:06 PM, Ufuk Celebi u...@apache.org wrote: On 27 May 2015, at 17:05, Timo Walther twal...@apache.org wrote: It's rather passion for the future of the project than passion for SQL ;-) I always try to think like someone from the

Re: SQL on Flink

I think Fabian's arguments make a lot of sense. However, if Timo *really wants* to start SQL on top of Table, that is what he will do a great job at :-) As usual, we can keep it in beta status in flink-staging until it is mature... and it will help create issues for the Table API and give

Re: Gelly Roadmap

:-D Great! On Tue, May 19, 2015 at 4:00 PM, Andra Lungu lungu.an...@gmail.com wrote: Hi Kostas, We're way ahead of you! The first draft of the blog post is internally reviewed as we speak ;) On Tue, May 19, 2015 at 3:49 PM, Kostas Tzoumas ktzou...@apache.org wrote: This is very cool

Re: New project website

+1 On Fri, May 15, 2015 at 11:49 AM, Vasiliki Kalavri vasilikikala...@gmail.com wrote: +1 :)) On 15 May 2015 at 12:42, Ufuk Celebi u...@apache.org wrote: On 14 May 2015, at 12:39, Vasiliki Kalavri va...@apache.org wrote: Hey Ufuk, the logo still looks too big for the menu and

Re: New project website

Good points raised by Stephan, Felix, and Volker. Do you think we can achieve this by iterating on the new design? One thing we can indeed do is de-clutter a bit. Apart from that, what high level points would you like to see in the frontpage? On Tue, May 12, 2015 at 6:16 AM, Markl, Volker, Prof.

Re: [DISCUSS] Change Streaming Operators to be Push-Only

, May 5, 2015 at 2:41 PM, Kostas Tzoumas ktzou...@apache.org wrote: Can you give us a rough idea of the pros and cons? Do we lose some functionality by getting rid of iterations? Kostas On Tue, May 5, 2015 at 1:37 PM, Aljoscha Krettek aljos...@apache.org wrote: Hi Folks, while

Re: Adding a new operator

Some form of tree aggregation is useful in many cases, and IMO a good addition to the system. Kostas On Mon, Apr 27, 2015 at 11:04 AM, Andra Lungu lungu.an...@gmail.com wrote: Hi Fabian, After a quick look at the current behaviour of Flink's combinable reduce, I saw that it does something

Re: About Operator and OperatorBase

I think Stephan meant Meteor, an old API when Flink was Stratosphere. This was never part of the code that made it to Apache. Not sure if we want to remove the common API, as it provides a dataflow abstraction that is higher level than the JobGraph. Admittedly, I don't have a better argument

Re: Merge Python API

I'm +1 for this On Mon, Apr 20, 2015 at 11:03 AM, Robert Metzger rmetz...@apache.org wrote: Hi, The Python API pull request [1] has been open for quite some time now. I was wondering whether we are planning to merge it or not. I took a closer look at the Python API a few weeks ago and I

Re: [DISCUSS] Replace user@f.a.o with Stackoverflow

If we clearly preface with a boilerplate text and a link to the users@ question it might look less weird :-) Perhaps we can create a stackoverflow user whose purpose is to create questions that mirror the users@ list? Not sure how much this can be automated though On Mon, Apr 20, 2015 at 4:25

[jira] [Created] (FLINK-1893) Add Scala support for Flink on Tez

Kostas Tzoumas created FLINK-1893: - Summary: Add Scala support for Flink on Tez Key: FLINK-1893 URL: https://issues.apache.org/jira/browse/FLINK-1893 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-1898) Add support for self-joins to Flink on Tez

Kostas Tzoumas created FLINK-1898: - Summary: Add support for self-joins to Flink on Tez Key: FLINK-1898 URL: https://issues.apache.org/jira/browse/FLINK-1898 Project: Flink Issue Type: Bug

Re: Flink interactive Scala shell

Great, let us know if you run into any issues. Can you create a JIRA on the REPL and link to your repository for the community to track the status? On Wed, Apr 15, 2015 at 4:23 PM, Nikolaas s nikolaas.steenber...@gmail.com wrote: Thanks for the feedback guys! Apparently The Scala Shell

[jira] [Created] (FLINK-1897) Add accummulators and counters feature to Flink on Tez

Kostas Tzoumas created FLINK-1897: - Summary: Add accummulators and counters feature to Flink on Tez Key: FLINK-1897 URL: https://issues.apache.org/jira/browse/FLINK-1897 Project: Flink Issue

[jira] [Created] (FLINK-1895) Add task chaining to Flink on Tez

Kostas Tzoumas created FLINK-1895: - Summary: Add task chaining to Flink on Tez Key: FLINK-1895 URL: https://issues.apache.org/jira/browse/FLINK-1895 Project: Flink Issue Type: Improvement

[jira] [Created] (FLINK-1894) Add Tez execution mode to Flink command-line tools

Kostas Tzoumas created FLINK-1894: - Summary: Add Tez execution mode to Flink command-line tools Key: FLINK-1894 URL: https://issues.apache.org/jira/browse/FLINK-1894 Project: Flink Issue

Flink 0.9.0-milestone1 released

We are very excited to announce Flink 0.9.0-milestone1, a preview release to give users early access to some Flink 0.9.0 features, including: - A Table API for SQL-like queries embedded in Java and Scala - Gelly, Flink's graph processing API - A Machine Learning library on Flink inspired by

Re: Flink 0.9.0-milestone1 released

, Kostas Tzoumas ktzou...@apache.org wrote: We are very excited to announce Flink 0.9.0-milestone1, a preview release to give users early access to some Flink 0.9.0 features, including: - A Table API for SQL-like queries embedded in Java and Scala - Gelly, Flink's graph processing API

Flink Forward 2015

Hi everyone, The folks at data Artisans and the Berlin Big Data Center are organizing the first physical conference all about Apache Flink in Berlin the coming October: http://flink-forward.org The conference will be held in a beautiful spot an old brewery turned event space (the same space

Re: Make docs searchable

+1 On Wed, Apr 1, 2015 at 4:58 PM, Henry Saputra henry.sapu...@gmail.com wrote: +1 Superbly needed :) On Wednesday, April 1, 2015, Ufuk Celebi u...@apache.org wrote: Hey all, I think our documentation has grown to a point where we need to think about how to make it more

Re: [DISCUSS] Inconsistent naming of intermediate results

I like the fact that the naming scheme follows some logic. I also like that we have two easy to understand concepts: - Operator (be that in any of the above representations) - Result (of executing an operator) +1 On Tue, Mar 31, 2015 at 4:50 PM, Ufuk Celebi u...@apache.org wrote: On a high

Re: [DISCUSS] Make a release to be announced at ApacheCon

+1 for an early milestone release. Perhaps we can call it 0.9-milestone or so? On Thu, Mar 26, 2015 at 11:01 AM, Robert Metzger rmetz...@apache.org wrote: Two weeks have passed since we've discussed the 0.9 release the last time. The ApacheCon is in 18 days from now. If we want, we can also

Re: [DISCUSS] Make a release to be announced at ApacheCon

The ASF press team wants to announce next week, so a 3-day vote right now might cancel the subject line of this thread :-) Perhaps we can reach consensus in the DISCUSS thread or have a 24-hour vote? I agree with Stephan on 0.9.0.M1 (or 0.9.0-m1 or whatever), as it seems that other open source

Re: Improve the documentation of the Flink Architecture and internals

I added a document for data exchange between tasks: https://cwiki.apache.org/confluence/display/FLINK/Data+exchange+between+tasks Feel free to edit. I plan to link the class names to the class files in github. On Tue, Mar 17, 2015 at 11:17 AM, Kostas Tzoumas ktzou...@apache.org wrote: +1

Re: Improve the documentation of the Flink Architecture and internals

it's down for me as well On Fri, Mar 20, 2015 at 7:12 PM, Henry Saputra henry.sapu...@gmail.com wrote: Is the wiki down for any of you? I can't access https://cwiki.apache.org/confluence/display/FLINK/Apache+Flink+Home 404 - Henry On Fri, Mar 20, 2015 at 4:46 AM, Kostas Tzoumas ktzou

Re: Improve the documentation of the Flink Architecture and internals

+1 for the Wiki. When these have been stabilized we can move them to the docs if we decide to do so. On Mon, Mar 16, 2015 at 10:07 PM, Stephan Ewen se...@apache.org wrote: I have put my suggested version of an outline for the docs into the wiki. Regardless where the docs end up (wiki or

Re: Not Flink related: IntelliJ cannot open maven projects

The same happened to me (for a different project). Re-importing the project to IntelliJ solved it On Thu, Mar 5, 2015 at 8:10 AM, Till Rohrmann trohrm...@apache.org wrote: That is odd. Most of the committers are using the IntelliJ to develop Flink. Have you tried to delete the Flink directory

February 2015 in the Flink community

Hi everyone February might be the shortest month of the year, but the community has been pretty busy: - Flink 0.8.1, a bugfix release has been made available - The project added a new committer - Flink contributors developed a Flink adapter for Apache SAMOA - Flink committers contributed to

Re: Drafting a roadmap for Flink

Yeah, this is something that nobody is working on AFAIK and not a major focus of the project. I moved it to the interesting projects page (and cleaned up the page a bit removing streaming, tez, and mahout as these are ongoing efforts). On Wed, Feb 4, 2015 at 9:34 AM, Stephan Ewen se...@apache.org

January 2015 in the Flink community

Here is a digestible read on some January activity in the Flink community: http://flink.apache.org/news/2015/02/04/january-in-flink.html Highlights: - Flink 0.8.0 was released - The Flink community published a technical roadmap for 2015 - Flink was used to scale matrix factorization to

Fwd: MODERATE for dev@flink.apache.org

I am forwarding this as I could not approve it for some reason. Kostas -- Forwarded message -- From: Ankit Jhalaria anki...@yahoo-inc.com.invalid To: dev@flink.apache.org dev@flink.apache.org Cc: Date: Mon, 26 Jan 2015 22:59:53 + (UTC) Subject: [Flink reading HDFS] : SIMPLE

Re: Adding non-core API features to Flink

respectively. On Sat, Jan 24, 2015 at 4:26 PM, Fabian Hueske fhue...@gmail.com wrote: I am also more in favor of option 1). 2015-01-24 20:27 GMT+01:00 Kostas Tzoumas ktzou...@apache.org: Thanks Fabian for starting the discussion. I would be biased towards option (1

Re: Adding non-core API features to Flink

Thanks Fabian for starting the discussion. I would be biased towards option (1) that Stephan highlighted for the following reasons: - A separate github project is one more infrastructure to manage, and it lives outside the ASF. I would like to bring as much code as possible to the Apache

Re: [ANNOUNCE] Apache Flink 0.8.0 released

handle =) - Henry On Thu, Jan 22, 2015 at 8:01 AM, Kostas Tzoumas ktzou...@apache.org wrote: Great job, thank you Marton, Robert and everyone! On Thu, Jan 22, 2015 at 12:50 AM, Fabian Hueske fhue...@apache.org wrote: Awesome! Thank you very much Marton and Robert! Cheers