Re: Validates Runner on Java 11 and the Java SDK Harness
Just for info I found today that there was already a JIRA tracking the Java 11 container created by Hannah https://issues.apache.org/jira/browse/BEAM-8106 So this one is the preferred one to track because it is associated to the complete Java 11 effort. In other news Tyson contributed a fix today to the bytebuddy code generation that made the missing Schema tests pass for Java 11. So for the first time Flink passed the full Validates Runner tests on Java 11 (for the classic runner at the moment) as well as Spark in the upcoming 3.0 version (also classic runner for the moment). So I am finally optimistic that 2020 is going to be finally the year we get full Java 11 support. We are close, we are getting close! On Thu, May 7, 2020 at 4:04 PM David Morávek wrote: > > Great effort Ismaël! ;) Can't wait to try this out :) > > On Thu, May 7, 2020 at 12:08 PM Ismaël Mejía wrote: >> >> Filled https://issues.apache.org/jira/browse/BEAM-9915 for the moment >> to track this. >> >> On Wed, Apr 22, 2020 at 10:35 PM Mikhail Gryzykhin wrote: >> > >> > +Paweł Pasterz >> > >> > On Wed, Apr 22, 2020, 13:23 Pablo Estrada wrote: >> >> >> >> +Mikhail Gryzykhin fyi : ) >> >> >> >> On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía wrote: >> >>> >> >>> I have been working in recent days on enabling the CI tests for Java 11 >> >>> in >> >>> Jenkins for Flink (based on latest release 1.10.x, already merged) and >> >>> Spark >> >>> (based on upcoming release 3.x.x tested locally), so far we have good >> >>> progress >> >>> for both classical runners with only one test failing the complete >> >>> suite! So >> >>> soon we would be able to announce that we support Java 11 for our most >> >>> popular >> >>> open source classical runners. >> >>> >> >>> The next step is to tackle the portable validates runner tests, and when >> >>> I >> >>> looked at those I realized that we are not publishing the Java SDK >> >>> Harness based >> >>> on Java 11. I would like to know if someone might be interested on >> >>> taking this >> >>> task so we can publish the Java 11 SDK Harness docker image too maybe as >> >>> part of >> >>> the next release. >> >>> >> >>> Anyone who knows the harness container part interested on creating a >> >>> JIRA and working on a fix for this? >> >>> >> >>> Regards, >> >>> Ismaël
Re: Validates Runner on Java 11 and the Java SDK Harness
Great effort Ismaël! ;) Can't wait to try this out :) On Thu, May 7, 2020 at 12:08 PM Ismaël Mejía wrote: > Filled https://issues.apache.org/jira/browse/BEAM-9915 for the moment > to track this. > > On Wed, Apr 22, 2020 at 10:35 PM Mikhail Gryzykhin > wrote: > > > > +Paweł Pasterz > > > > On Wed, Apr 22, 2020, 13:23 Pablo Estrada wrote: > >> > >> +Mikhail Gryzykhin fyi : ) > >> > >> On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía wrote: > >>> > >>> I have been working in recent days on enabling the CI tests for Java > 11 in > >>> Jenkins for Flink (based on latest release 1.10.x, already merged) and > Spark > >>> (based on upcoming release 3.x.x tested locally), so far we have good > progress > >>> for both classical runners with only one test failing the complete > suite! So > >>> soon we would be able to announce that we support Java 11 for our most > popular > >>> open source classical runners. > >>> > >>> The next step is to tackle the portable validates runner tests, and > when I > >>> looked at those I realized that we are not publishing the Java SDK > Harness based > >>> on Java 11. I would like to know if someone might be interested on > taking this > >>> task so we can publish the Java 11 SDK Harness docker image too maybe > as part of > >>> the next release. > >>> > >>> Anyone who knows the harness container part interested on creating a > >>> JIRA and working on a fix for this? > >>> > >>> Regards, > >>> Ismaël >
Re: Validates Runner on Java 11 and the Java SDK Harness
Filled https://issues.apache.org/jira/browse/BEAM-9915 for the moment to track this. On Wed, Apr 22, 2020 at 10:35 PM Mikhail Gryzykhin wrote: > > +Paweł Pasterz > > On Wed, Apr 22, 2020, 13:23 Pablo Estrada wrote: >> >> +Mikhail Gryzykhin fyi : ) >> >> On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía wrote: >>> >>> I have been working in recent days on enabling the CI tests for Java 11 in >>> Jenkins for Flink (based on latest release 1.10.x, already merged) and Spark >>> (based on upcoming release 3.x.x tested locally), so far we have good >>> progress >>> for both classical runners with only one test failing the complete suite! So >>> soon we would be able to announce that we support Java 11 for our most >>> popular >>> open source classical runners. >>> >>> The next step is to tackle the portable validates runner tests, and when I >>> looked at those I realized that we are not publishing the Java SDK Harness >>> based >>> on Java 11. I would like to know if someone might be interested on taking >>> this >>> task so we can publish the Java 11 SDK Harness docker image too maybe as >>> part of >>> the next release. >>> >>> Anyone who knows the harness container part interested on creating a >>> JIRA and working on a fix for this? >>> >>> Regards, >>> Ismaël
Re: Validates Runner on Java 11 and the Java SDK Harness
+Paweł Pasterz On Wed, Apr 22, 2020, 13:23 Pablo Estrada wrote: > +Mikhail Gryzykhin fyi : ) > > On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía wrote: > >> I have been working in recent days on enabling the CI tests for Java 11 in >> Jenkins for Flink (based on latest release 1.10.x, already merged) and >> Spark >> (based on upcoming release 3.x.x tested locally), so far we have good >> progress >> for both classical runners with only one test failing the complete suite! >> So >> soon we would be able to announce that we support Java 11 for our most >> popular >> open source classical runners. >> >> The next step is to tackle the portable validates runner tests, and when I >> looked at those I realized that we are not publishing the Java SDK >> Harness based >> on Java 11. I would like to know if someone might be interested on taking >> this >> task so we can publish the Java 11 SDK Harness docker image too maybe as >> part of >> the next release. >> >> Anyone who knows the harness container part interested on creating a >> JIRA and working on a fix for this? >> >> Regards, >> Ismaël >> >
Re: Validates Runner on Java 11 and the Java SDK Harness
+Mikhail Gryzykhin fyi : ) On Tue, Apr 21, 2020 at 1:25 PM Ismaël Mejía wrote: > I have been working in recent days on enabling the CI tests for Java 11 in > Jenkins for Flink (based on latest release 1.10.x, already merged) and > Spark > (based on upcoming release 3.x.x tested locally), so far we have good > progress > for both classical runners with only one test failing the complete suite! > So > soon we would be able to announce that we support Java 11 for our most > popular > open source classical runners. > > The next step is to tackle the portable validates runner tests, and when I > looked at those I realized that we are not publishing the Java SDK Harness > based > on Java 11. I would like to know if someone might be interested on taking > this > task so we can publish the Java 11 SDK Harness docker image too maybe as > part of > the next release. > > Anyone who knows the harness container part interested on creating a > JIRA and working on a fix for this? > > Regards, > Ismaël >
Validates Runner on Java 11 and the Java SDK Harness
I have been working in recent days on enabling the CI tests for Java 11 in Jenkins for Flink (based on latest release 1.10.x, already merged) and Spark (based on upcoming release 3.x.x tested locally), so far we have good progress for both classical runners with only one test failing the complete suite! So soon we would be able to announce that we support Java 11 for our most popular open source classical runners. The next step is to tackle the portable validates runner tests, and when I looked at those I realized that we are not publishing the Java SDK Harness based on Java 11. I would like to know if someone might be interested on taking this task so we can publish the Java 11 SDK Harness docker image too maybe as part of the next release. Anyone who knows the harness container part interested on creating a JIRA and working on a fix for this? Regards, Ismaël