Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
On Mon, Jan 12, 2015 at 11:22 AM, Stephan Ewen se...@apache.org wrote: It would be good to have the patch, but it is also a very tricky patch, so pushing it hastily may be problematic. I agree. @Till: would that be OK with you? If yes, I think we are good to go for the next RC.
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
It would be good to have the patch, but it is also a very tricky patch, so pushing it hastily may be problematic. We could put out 0.8 and very soon a 0.8.1 with that fix. Am 12.01.2015 11:12 schrieb Till Rohrmann trohrm...@apache.org: I only have to fix a last dead lock and then the fix should be working. On Mon, Jan 12, 2015 at 11:06 AM, Ufuk Celebi u...@apache.org wrote: Thanks, Marton. Yes, I think https://issues.apache.org/jira/browse/FLINK-1376. Till has a fix coming up for it. Should we wait for this or postpone it to 0.8.1? – Ufuk On 12 Jan 2015, at 10:16, Márton Balassi balassi.mar...@gmail.com wrote: Based on the requests listed in this thread Stephan and myself cherry-picked the following commits: 7634310 [FLINK-1266] Generalize DistributedFileSystem implementation (rmetzger) 40a2705 [FLINK-1266] Update mongodb link and address pull request comments (rmetzger) cd66ced [FLINK-1266] Properly pass the fs.defaulFS setting when initializing … (rmetzger) 3bf2d21 [FLINK-1266] More dependency exclusions (rmetzger) e8ab5b7 [FLINK-1266] Backport fix to 0.8 (rmetzger) 7cd0f47 [docs] Prepare documentation for 0.8 release (rmetzger) e83ccd0 [FLINK-1385] Print warning if not resources are _currently_ available… (rmetzger) 4f9dcae [FLINK-1378] [scala] Fix type extraction for nested type parameters (aljoscha) fced2eb [FLINK-1378] Add support for Throwables in KryoSerializer (aljoscha) ada35eb [FLINK-1378] [scala] Add support for Try[A] (Success/Failure) (aljoscha) a64abe1 [docs] Update README and internals (scheduling) for graduation and fi… (SephanEwen) 4f95ce7 Fix typo in README.md (uce) Both of us committed some other fixes mainly for the dependencies and licences, the distribution and the quickstarts. Pushing the results as soon as the tests pass. Does anyone have any other issue that has to be included in the next release candidate? On Sat, Jan 10, 2015 at 7:34 PM, Robert Metzger rmetz...@apache.org wrote: I've tested it on an empty YARN cluster, allocating more containers than available. Flink will then allocate as many containers as possible. On Sat, Jan 10, 2015 at 7:31 PM, Stephan Ewen se...@apache.org wrote: Seems reasonable. Have you tested it on a cluster with concurrent YARN jobs? On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger rmetz...@apache.org wrote: I would really like to include this commit into the 0.8 release as well: https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704 A user is affected by this issue. If you agree, I can merge it. On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen se...@apache.org wrote: I have gone through the code, cleaned up dependencies and made sure that all licenses are correctly handled. The changes are in the public release-0.8 branch. From that side, the code is now good to go in my opinion. Stephan On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger rmetz...@apache.org wrote: I've updated the docs/_config.yml variables to reflect that hadoop2 is now the default profile: https://github.com/apache/flink/pull/294 On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen se...@apache.org wrote: Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
Thanks, Marton. Yes, I think https://issues.apache.org/jira/browse/FLINK-1376. Till has a fix coming up for it. Should we wait for this or postpone it to 0.8.1? – Ufuk On 12 Jan 2015, at 10:16, Márton Balassi balassi.mar...@gmail.com wrote: Based on the requests listed in this thread Stephan and myself cherry-picked the following commits: 7634310 [FLINK-1266] Generalize DistributedFileSystem implementation (rmetzger) 40a2705 [FLINK-1266] Update mongodb link and address pull request comments (rmetzger) cd66ced [FLINK-1266] Properly pass the fs.defaulFS setting when initializing … (rmetzger) 3bf2d21 [FLINK-1266] More dependency exclusions (rmetzger) e8ab5b7 [FLINK-1266] Backport fix to 0.8 (rmetzger) 7cd0f47 [docs] Prepare documentation for 0.8 release (rmetzger) e83ccd0 [FLINK-1385] Print warning if not resources are _currently_ available… (rmetzger) 4f9dcae [FLINK-1378] [scala] Fix type extraction for nested type parameters (aljoscha) fced2eb [FLINK-1378] Add support for Throwables in KryoSerializer (aljoscha) ada35eb [FLINK-1378] [scala] Add support for Try[A] (Success/Failure) (aljoscha) a64abe1 [docs] Update README and internals (scheduling) for graduation and fi… (SephanEwen) 4f95ce7 Fix typo in README.md (uce) Both of us committed some other fixes mainly for the dependencies and licences, the distribution and the quickstarts. Pushing the results as soon as the tests pass. Does anyone have any other issue that has to be included in the next release candidate? On Sat, Jan 10, 2015 at 7:34 PM, Robert Metzger rmetz...@apache.org wrote: I've tested it on an empty YARN cluster, allocating more containers than available. Flink will then allocate as many containers as possible. On Sat, Jan 10, 2015 at 7:31 PM, Stephan Ewen se...@apache.org wrote: Seems reasonable. Have you tested it on a cluster with concurrent YARN jobs? On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger rmetz...@apache.org wrote: I would really like to include this commit into the 0.8 release as well: https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704 A user is affected by this issue. If you agree, I can merge it. On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen se...@apache.org wrote: I have gone through the code, cleaned up dependencies and made sure that all licenses are correctly handled. The changes are in the public release-0.8 branch. From that side, the code is now good to go in my opinion. Stephan On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger rmetz...@apache.org wrote: I've updated the docs/_config.yml variables to reflect that hadoop2 is now the default profile: https://github.com/apache/flink/pull/294 On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen se...@apache.org wrote: Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi balassi.mar...@gmail.com wrote: Cherry-picked and tested: found no duplicate dependencies in lib, yarn uberjar build goes without the mentioned warns. Travis tests are passing, pushing soon. On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen se...@apache.org wrote: Nice. @Marton: As soon as as you are done, I make a pass over the licenses... Stephan On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger rmetz...@apache.org wrote: Allright. The travis tests are green and I tested it again with Tachyon on a cluster. My pull request also fixes some of the issues mentioned earlier in this thread by Stephan (the warnings from shading regarding duplicate classes).
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
Yeah I agree with that. On Mon, Jan 12, 2015 at 11:30 AM, Ufuk Celebi u...@apache.org wrote: On Mon, Jan 12, 2015 at 11:22 AM, Stephan Ewen se...@apache.org wrote: It would be good to have the patch, but it is also a very tricky patch, so pushing it hastily may be problematic. I agree. @Till: would that be OK with you? If yes, I think we are good to go for the next RC.
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
Seems reasonable. Have you tested it on a cluster with concurrent YARN jobs? On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger rmetz...@apache.org wrote: I would really like to include this commit into the 0.8 release as well: https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704 A user is affected by this issue. If you agree, I can merge it. On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen se...@apache.org wrote: I have gone through the code, cleaned up dependencies and made sure that all licenses are correctly handled. The changes are in the public release-0.8 branch. From that side, the code is now good to go in my opinion. Stephan On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger rmetz...@apache.org wrote: I've updated the docs/_config.yml variables to reflect that hadoop2 is now the default profile: https://github.com/apache/flink/pull/294 On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen se...@apache.org wrote: Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi balassi.mar...@gmail.com wrote: Cherry-picked and tested: found no duplicate dependencies in lib, yarn uberjar build goes without the mentioned warns. Travis tests are passing, pushing soon. On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen se...@apache.org wrote: Nice. @Marton: As soon as as you are done, I make a pass over the licenses... Stephan On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger rmetz...@apache.org wrote: Allright. The travis tests are green and I tested it again with Tachyon on a cluster. My pull request also fixes some of the issues mentioned earlier in this thread by Stephan (the warnings from shading regarding duplicate classes). I can not fix all of them because some projects like hadoop just have the conflicts in their dependencies. I'll merge the pull request to master. Marton can merge it to release-0.8. On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen se...@apache.org wrote: Robert, can you let us know once the PR is merged? Then we can start with the next steps... On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger rmetz...@apache.org wrote: Please wait with merging 268. There is still a minor open issue. On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: +1 for merging PR 268, volunteering for the merge. It should also solve the issue mentioned by Stephan with the yarn uberjar. Updating the release scripts and doing a double-check on the cosmetics. On Thu, Jan 8, 2015 at 12:55 PM, Stephan Ewen se...@apache.org wrote: We just found and fixed another highly critical bug. I vote to also cherry pick commit 19066b520435528e104a69ccf372f56811123ee3 ([FLINK-1371] [runtime] Fix
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
I have gone through the code, cleaned up dependencies and made sure that all licenses are correctly handled. The changes are in the public release-0.8 branch. From that side, the code is now good to go in my opinion. Stephan On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger rmetz...@apache.org wrote: I've updated the docs/_config.yml variables to reflect that hadoop2 is now the default profile: https://github.com/apache/flink/pull/294 On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen se...@apache.org wrote: Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi balassi.mar...@gmail.com wrote: Cherry-picked and tested: found no duplicate dependencies in lib, yarn uberjar build goes without the mentioned warns. Travis tests are passing, pushing soon. On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen se...@apache.org wrote: Nice. @Marton: As soon as as you are done, I make a pass over the licenses... Stephan On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger rmetz...@apache.org wrote: Allright. The travis tests are green and I tested it again with Tachyon on a cluster. My pull request also fixes some of the issues mentioned earlier in this thread by Stephan (the warnings from shading regarding duplicate classes). I can not fix all of them because some projects like hadoop just have the conflicts in their dependencies. I'll merge the pull request to master. Marton can merge it to release-0.8. On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen se...@apache.org wrote: Robert, can you let us know once the PR is merged? Then we can start with the next steps... On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger rmetz...@apache.org wrote: Please wait with merging 268. There is still a minor open issue. On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: +1 for merging PR 268, volunteering for the merge. It should also solve the issue mentioned by Stephan with the yarn uberjar. Updating the release scripts and doing a double-check on the cosmetics. On Thu, Jan 8, 2015 at 12:55 PM, Stephan Ewen se...@apache.org wrote: We just found and fixed another highly critical bug. I vote to also cherry pick commit 19066b520435528e104a69ccf372f56811123ee3 ([FLINK-1371] [runtime] Fix KryoSerializer to not swallow EOFExceptions) On Thu, Jan 8, 2015 at 11:55 AM, Robert Metzger rmetz...@apache.org wrote: +1 for merging pull request 268. It makes Flink even more compatible with hadoop. regarding the documentation: I already updated the build instructions. But we should double check everything again. I probably won't have time to look into this today however. On Thu, Jan 8, 2015 at 11:50 AM, Stephan Ewen se...@apache.org wrote: After the dependencies are cleaned up (Robert's pull request https://github.com/apache/flink/pull/268 solves that), we need to also do the following: -
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
I've tested it on an empty YARN cluster, allocating more containers than available. Flink will then allocate as many containers as possible. On Sat, Jan 10, 2015 at 7:31 PM, Stephan Ewen se...@apache.org wrote: Seems reasonable. Have you tested it on a cluster with concurrent YARN jobs? On Sat, Jan 10, 2015 at 7:28 PM, Robert Metzger rmetz...@apache.org wrote: I would really like to include this commit into the 0.8 release as well: https://github.com/apache/flink/commit/ec2bb573d185429f8b3efe111850b8f0e67f2704 A user is affected by this issue. If you agree, I can merge it. On Sat, Jan 10, 2015 at 7:25 PM, Stephan Ewen se...@apache.org wrote: I have gone through the code, cleaned up dependencies and made sure that all licenses are correctly handled. The changes are in the public release-0.8 branch. From that side, the code is now good to go in my opinion. Stephan On Sat, Jan 10, 2015 at 12:30 PM, Robert Metzger rmetz...@apache.org wrote: I've updated the docs/_config.yml variables to reflect that hadoop2 is now the default profile: https://github.com/apache/flink/pull/294 On Fri, Jan 9, 2015 at 8:52 PM, Stephan Ewen se...@apache.org wrote: Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi balassi.mar...@gmail.com wrote: Cherry-picked and tested: found no duplicate dependencies in lib, yarn uberjar build goes without the mentioned warns. Travis tests are passing, pushing soon. On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen se...@apache.org wrote: Nice. @Marton: As soon as as you are done, I make a pass over the licenses... Stephan On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger rmetz...@apache.org wrote: Allright. The travis tests are green and I tested it again with Tachyon on a cluster. My pull request also fixes some of the issues mentioned earlier in this thread by Stephan (the warnings from shading regarding duplicate classes). I can not fix all of them because some projects like hadoop just have the conflicts in their dependencies. I'll merge the pull request to master. Marton can merge it to release-0.8. On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen se...@apache.org wrote: Robert, can you let us know once the PR is merged? Then we can start with the next steps... On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger rmetz...@apache.org wrote: Please wait with merging 268. There is still a minor open issue. On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: +1 for merging PR 268, volunteering for the merge. It should also solve the issue mentioned by Stephan with the yarn uberjar.
Re: [VOTE] Release Apache Flink 0.8.0 (RC1)
Just as a heads up. I am almost through with checking dependencies and licenses. Will commit that later tonight or tomorrow. On Fri, Jan 9, 2015 at 7:09 PM, Stephan Ewen se...@apache.org wrote: I vote to include it as well. It is sort of vital for advanced use of the Scala API. It is also an isolated change that does not affect other components, so it should be testable very well. On Fri, Jan 9, 2015 at 7:05 PM, Robert Metzger rmetz...@apache.org wrote: I'd say yes because its affecting a user. On Fri, Jan 9, 2015 at 7:00 PM, Aljoscha Krettek aljos...@apache.org wrote: I have a fix for this issue: https://issues.apache.org/jira/browse/FLINK-1378?jql=project%20%3D%20FLINK and I think this should also make it into the 0.8.0 release. What do you think? On Fri, Jan 9, 2015 at 3:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: Sure, thanks Ufuk. On Fri, Jan 9, 2015 at 3:15 PM, Ufuk Celebi u...@apache.org wrote: Marton, could you also cherry-pick 7f659f6 and 7e08fa1 for the next RC? It's a minor update to the README describing the IDE setup. I will closed the respective issue FLINK-1109. On 08 Jan 2015, at 23:50, Henry Saputra henry.sapu...@gmail.com wrote: Marton, could you close this VOTE thread by replying to the original email and append [CANCEL] in the subject line. - Henry On Thu, Jan 8, 2015 at 9:35 AM, Márton Balassi balassi.mar...@gmail.com wrote: Cherry-picked and tested: found no duplicate dependencies in lib, yarn uberjar build goes without the mentioned warns. Travis tests are passing, pushing soon. On Thu, Jan 8, 2015 at 4:57 PM, Stephan Ewen se...@apache.org wrote: Nice. @Marton: As soon as as you are done, I make a pass over the licenses... Stephan On Thu, Jan 8, 2015 at 4:42 PM, Robert Metzger rmetz...@apache.org wrote: Allright. The travis tests are green and I tested it again with Tachyon on a cluster. My pull request also fixes some of the issues mentioned earlier in this thread by Stephan (the warnings from shading regarding duplicate classes). I can not fix all of them because some projects like hadoop just have the conflicts in their dependencies. I'll merge the pull request to master. Marton can merge it to release-0.8. On Thu, Jan 8, 2015 at 2:42 PM, Stephan Ewen se...@apache.org wrote: Robert, can you let us know once the PR is merged? Then we can start with the next steps... On Thu, Jan 8, 2015 at 2:07 PM, Robert Metzger rmetz...@apache.org wrote: Please wait with merging 268. There is still a minor open issue. On Thu, Jan 8, 2015 at 1:28 PM, Márton Balassi balassi.mar...@gmail.com wrote: +1 for merging PR 268, volunteering for the merge. It should also solve the issue mentioned by Stephan with the yarn uberjar. Updating the release scripts and doing a double-check on the cosmetics. On Thu, Jan 8, 2015 at 12:55 PM, Stephan Ewen se...@apache.org wrote: We just found and fixed another highly critical bug. I vote to also cherry pick commit 19066b520435528e104a69ccf372f56811123ee3 ([FLINK-1371] [runtime] Fix KryoSerializer to not swallow EOFExceptions) On Thu, Jan 8, 2015 at 11:55 AM, Robert Metzger rmetz...@apache.org wrote: +1 for merging pull request 268. It makes Flink even more compatible with hadoop. regarding the documentation: I already updated the build instructions. But we should double check everything again. I probably won't have time to look into this today however. On Thu, Jan 8, 2015 at 11:50 AM, Stephan Ewen se...@apache.org wrote: After the dependencies are cleaned up (Robert's pull request https://github.com/apache/flink/pull/268 solves that), we need to also do the following: - Make a pass over dependencies to ensure that NOTICE and LICENSE files are up to date (both source and bin distribution) - Adjust the variables in the docs to reflect the fact that hadoop2 is now the default profile I would volunteer for the first task. Stephan On Wed, Jan 7, 2015 at 10:01 PM, Stephan Ewen se...@apache.org wrote: I also see a warning when building the yarn fat jar. This is a consequence of the duplicate dependencies. [WARNING] servlet-api-3.0.20100224.jar, javax.servlet-api-3.0.1.jar, javax.servlet-3.1.jar, servlet-api-2.5.jar define 42 overlappping classes: [WARNING] - javax.servlet.http.Cookie [WARNING] - javax.servlet.http.HttpSessionBindingEvent [WARNING] - javax.servlet.http.NoBodyResponse [WARNING] -
