Re: December in Flink
I like the idea of having a news list as well :-) +1 On Fri, Jan 9, 2015 at 7:36 PM, Ted Dunning ted.dunn...@gmail.com wrote: Would the user list do for now? On Fri, Jan 9, 2015 at 7:27 AM, Robert Metzger rmetz...@apache.org wrote: Our PMC Chair or a ASF member has to request a list: https://infra.apache.org/officers/mlreq On Fri, Jan 9, 2015 at 4:25 PM, Kostas Tzoumas ktzou...@apache.org wrote: Cool, does anyone know how we can do that with infra? On Fri, Jan 9, 2015 at 3:46 PM, Ufuk Celebi u...@apache.org wrote: On 09 Jan 2015, at 15:12, Max Michels m...@data-artisans.com wrote: I think it would be good to have an additional mailing list for news. For open source projects, it's pretty common to have an announce mailing list. In addition to the monthly newsletter we could also announce releases. +1 I think this is a good idea for people who want to follow the project.
Re: Question on Streaming Dependency
Hey! As I can see, it was mistakenly added there during summer (probably by interns working on connectors). Thanks for the fix! Regards, Gábor On Sat, Jan 10, 2015 at 4:50 PM, Stephan Ewen se...@apache.org wrote: Just figured out that it is a transitive dependency of the streaming connectors. Will move it there with a comment. On Sat, Jan 10, 2015 at 4:43 PM, Stephan Ewen se...@apache.org wrote: I am currently going through the code checking that all license-related issues are well (and cleaning up unused dependencies on the way). I found that the streaming core project references the following dependency, which seems never used in the code: groupIdorg.apache.sling/groupId artifactIdorg.apache.sling.commons.json/artifactId version2.0.6/version Was this accidentally added? IIRC sling is a web framework, so I was also a bit surprised to see it as a dependency in the streaming code. Can anyone help me? Was this added because another dependency relies on it, but does not include it by itself? Greetings, Stephan
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
Seems reasonable. Have you tested it on a cluster with concurrent YARN jobs? On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger rmetz...@apache.org wrote: I would really like to include this commit into the 0.8 release as well: https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704 A user is affected by this issue. If you agree, I can merge it. On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen se...@apache.org wrote: I have gone through the code, cleaned up dependencies and made sure that all licenses are correctly handled. The changes are in the public release-0.8 branch. From that side, the code is now good to go in my opinion. Stephan On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger rmetz...@apache.org wrote: I've updated the docs/_config.yml variables to reflect that hadoop2 is now the default profile: https://github.com/apache/flink/pull/294 On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen se...@apache.org wrote: Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi balassi.mar...@gmail.com wrote: Cherry-picked and tested: found no duplicate dependencies in lib, yarn uberjar build goes without the mentioned warns. Travis tests are passing, pushing soon. On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen se...@apache.org wrote: Nice. @Marton: As soon as as you are done, I make a pass over the licenses... Stephan On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger rmetz...@apache.org wrote: Allright. The travis tests are green and I tested it again with Tachyon on a cluster. My pull request also fixes some of the issues mentioned earlier in this thread by Stephan (the warnings from shading regarding duplicate classes). I can not fix all of them because some projects like hadoop just have the conflicts in their dependencies. I'll merge the pull request to master. Marton can merge it to release-0.8. On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen se...@apache.org wrote: Robert, can you let us know once the PR is merged? Then we can start with the next steps... On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger rmetz...@apache.org wrote: Please wait with merging 268. There is still a minor open issue. On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: +1 for merging PR 268, volunteering for the merge. It should also solve the issue mentioned by Stephan with the yarn uberjar. Updating the release scripts and doing a double-check on the cosmetics. On Thu, Jan 8, 2015 at 12:55 PM, Stephan Ewen se...@apache.org wrote: We just found and fixed another highly critical bug. I vote to also cherry pick commit 19066b520435528e104a69ccf372f56811123ee3 ([FLINK-1371] [runtime] Fix
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
I have gone through the code, cleaned up dependencies and made sure that all licenses are correctly handled. The changes are in the public release-0.8 branch. From that side, the code is now good to go in my opinion. Stephan On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger rmetz...@apache.org wrote: I've updated the docs/_config.yml variables to reflect that hadoop2 is now the default profile: https://github.com/apache/flink/pull/294 On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen se...@apache.org wrote: Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi balassi.mar...@gmail.com wrote: Cherry-picked and tested: found no duplicate dependencies in lib, yarn uberjar build goes without the mentioned warns. Travis tests are passing, pushing soon. On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen se...@apache.org wrote: Nice. @Marton: As soon as as you are done, I make a pass over the licenses... Stephan On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger rmetz...@apache.org wrote: Allright. The travis tests are green and I tested it again with Tachyon on a cluster. My pull request also fixes some of the issues mentioned earlier in this thread by Stephan (the warnings from shading regarding duplicate classes). I can not fix all of them because some projects like hadoop just have the conflicts in their dependencies. I'll merge the pull request to master. Marton can merge it to release-0.8. On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen se...@apache.org wrote: Robert, can you let us know once the PR is merged? Then we can start with the next steps... On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger rmetz...@apache.org wrote: Please wait with merging 268. There is still a minor open issue. On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: +1 for merging PR 268, volunteering for the merge. It should also solve the issue mentioned by Stephan with the yarn uberjar. Updating the release scripts and doing a double-check on the cosmetics. On Thu, Jan 8, 2015 at 12:55 PM, Stephan Ewen se...@apache.org wrote: We just found and fixed another highly critical bug. I vote to also cherry pick commit 19066b520435528e104a69ccf372f56811123ee3 ([FLINK-1371] [runtime] Fix KryoSerializer to not swallow EOFExceptions) On Thu, Jan 8, 2015 at 11:55 AM, Robert Metzger rmetz...@apache.org wrote: +1 for merging pull request 268. It makes Flink even more compatible with hadoop. regarding the documentation: I already updated the build instructions. But we should double check everything again. I probably won't have time to look into this today however. On Thu, Jan 8, 2015 at 11:50 AM, Stephan Ewen se...@apache.org wrote: After the dependencies are cleaned up (Robert's pull request https://github.com/apache/flink/pull/268 solves that), we need to also do the following: -
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
I've tested it on an empty YARN cluster, allocating more containers than available. Flink will then allocate as many containers as possible. On Sat, Jan 10, 2015 at 7:31 PM, Stephan Ewen se...@apache.org wrote: Seems reasonable. Have you tested it on a cluster with concurrent YARN jobs? On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger rmetz...@apache.org wrote: I would really like to include this commit into the 0.8 release as well: https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704 A user is affected by this issue. If you agree, I can merge it. On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen se...@apache.org wrote: I have gone through the code, cleaned up dependencies and made sure that all licenses are correctly handled. The changes are in the public release-0.8 branch. From that side, the code is now good to go in my opinion. Stephan On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger rmetz...@apache.org wrote: I've updated the docs/_config.yml variables to reflect that hadoop2 is now the default profile: https://github.com/apache/flink/pull/294 On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen se...@apache.org wrote: Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi balassi.mar...@gmail.com wrote: Cherry-picked and tested: found no duplicate dependencies in lib, yarn uberjar build goes without the mentioned warns. Travis tests are passing, pushing soon. On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen se...@apache.org wrote: Nice. @Marton: As soon as as you are done, I make a pass over the licenses... Stephan On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger rmetz...@apache.org wrote: Allright. The travis tests are green and I tested it again with Tachyon on a cluster. My pull request also fixes some of the issues mentioned earlier in this thread by Stephan (the warnings from shading regarding duplicate classes). I can not fix all of them because some projects like hadoop just have the conflicts in their dependencies. I'll merge the pull request to master. Marton can merge it to release-0.8. On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen se...@apache.org wrote: Robert, can you let us know once the PR is merged? Then we can start with the next steps... On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger rmetz...@apache.org wrote: Please wait with merging 268. There is still a minor open issue. On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: +1 for merging PR 268, volunteering for the merge. It should also solve the issue mentioned by Stephan with the yarn uberjar.
