I am not an owner or maintainer of the PyPi package, so I'm not sure if I'll be able to release Python artifacts.
On Fri, Nov 24, 2017 at 10:08 PM, Jean-Baptiste Onofré <[email protected]> wrote: > Awesome, Thanks Reuven ! > > Regards > JB > > On 11/25/2017 07:01 AM, Reuven Lax wrote: > >> I'll go ahead and send the RESULT email right now. >> >> >> >> On Fri, Nov 24, 2017 at 9:56 PM, Jean-Baptiste Onofré <[email protected]> >> wrote: >> >> It's not sync: promoting the artifacts takes some time (at least 30 >>> minutes). So, the artifacts will be on central after a certain time. >>> >>> I confirm that it's OK because now the artifacts are on Central: >>> >>> http://repo.maven.apache.org/maven2/org/apache/beam/beam-sdk >>> s-java-core/2.2.0/ >>> >>> By the way, you are promoting the artifacts to Central but I didn't see >>> any [RESULT] e-mail on the vote thread. You have first to close the vote, >>> then promote the artifacts, announce the release, etc. >>> >>> Regards >>> JB >>> >>> On 11/25/2017 12:43 AM, Reuven Lax wrote: >>> >>> Appears to be a problem :) >>>> >>>> I tried publishing the latest artifact from Apache Nexus to Maven >>>> Central. >>>> After clicking publish, Nexus claimed that the operation has completed. >>>> However a look at the Maven Central page ( >>>> https://mvnrepository.com/artifact/org.apache.beam/beam-sdks-java-core) >>>> does not show 2.2.0 artifacts, and the staging repository has now >>>> vanished >>>> from the Nexus site! Does anyone know what happened here? >>>> >>>> Reuven >>>> >>>> On Wed, Nov 22, 2017 at 11:04 PM, Thomas Weise <[email protected]> wrote: >>>> >>>> +1 >>>> >>>>> >>>>> Run quickstart with Apex runner in embedded mode and on YARN. >>>>> >>>>> It needed couple tweaks to get there though. >>>>> >>>>> 1) Change quickstart pom.xml apex-runner profile: >>>>> >>>>> <!-- >>>>> Apex 3.6 is built against YARN 2.6. For this fat jar, the >>>>> included version has to match what's on the cluster, >>>>> hence we need to repeat the Apex Hadoop dependencies at the >>>>> required version here. >>>>> --> >>>>> <dependency> >>>>> <groupId>org.apache.hadoop</groupId> >>>>> <artifactId>hadoop-yarn-client</artifactId> >>>>> <version>${hadoop.version}</version> >>>>> <scope>runtime</scope> >>>>> </dependency> >>>>> <dependency> >>>>> <groupId>org.apache.hadoop</groupId> >>>>> <artifactId>hadoop-common</artifactId> >>>>> <version>${hadoop.version}</version> >>>>> <scope>runtime</scope> >>>>> </dependency> >>>>> >>>>> 2) After copying the fat jar to the cluster: >>>>> >>>>> java -cp word-count-beam-bundled-0.1.jar org.apache.beam.examples. >>>>> WordCount >>>>> \ >>>>> --inputFile=file:///tmp/input.txt --output=/tmp/counts >>>>> --embeddedExecution=false --configFile=beam-runners-apex.properties >>>>> --runner=ApexRunner >>>>> >>>>> (this was on a single node cluster, hence the local file path) >>>>> >>>>> The quickstart instructions suggest to use *mvn exec:java* instead of >>>>> *java* >>>>> - it generally isn't valid to assume that mvn and a build environment >>>>> exists on the edge node of a YARN cluster. >>>>> >>>>> >>>>> >>>>> On Wed, Nov 22, 2017 at 2:12 PM, Nishu <[email protected]> wrote: >>>>> >>>>> Hi Eugene, >>>>> >>>>>> >>>>>> I ran it on both standalone flink(non Yarn) and Flink on HDInsight >>>>>> Cluster(Yarn). Both ran successfully. :) >>>>>> >>>>>> Regards, >>>>>> Nishu >>>>>> >>>>>> <https://www.avast.com/sig-email?utm_medium=email&utm_ >>>>>> source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=icon> >>>>>> Virus-free. >>>>>> www.avast.com >>>>>> <https://www.avast.com/sig-email?utm_medium=email&utm_ >>>>>> source=link&utm_campaign=sig-email&utm_content=webmail&utm_term=link> >>>>>> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> >>>>>> >>>>>> On Wed, Nov 22, 2017 at 9:40 PM, Eugene Kirpichov < >>>>>> [email protected]> wrote: >>>>>> >>>>>> Thanks Nishu. So, if I understand correctly, your pipelines were >>>>>> >>>>>>> >>>>>>> running >>>>>> >>>>> >>>>> on >>>>>> >>>>>> non-YARN, but you're planning to run with YARN? >>>>>>> >>>>>>> I meanwhile was able to get Flink running on Dataproc (YARN), and >>>>>>> >>>>>>> validated >>>>>> >>>>>> quickstart and game examples. >>>>>>> At this point we need validation for Spark and Flink non-YARN [I >>>>>>> think >>>>>>> >>>>>>> if >>>>>> >>>>> >>>>> Nishu's runs were non-YARN, they'd give us enough confidence, combined >>>>>> >>>>>>> >>>>>>> with >>>>>> >>>>>> the success of other validations of Spark and Flink runners?], and >>>>>>> Apex >>>>>>> >>>>>>> on >>>>>> >>>>>> YARN. However, it seems that in previous RCs we were not validating >>>>>>> >>>>>>> Apex >>>>>> >>>>> >>>>> on >>>>>> >>>>>> YARN, only local cluster. Is it needed this time? >>>>>>> >>>>>>> On Wed, Nov 22, 2017 at 12:28 PM Nishu <[email protected]> wrote: >>>>>>> >>>>>>> Hi Eugene, >>>>>>> >>>>>>>> >>>>>>>> No, I didn't try with those instead I have my custom pipeline where >>>>>>>> >>>>>>>> Kafka >>>>>>> >>>>>> >>>>>> topic is the source. I have defined a Global Window and processing >>>>>>> >>>>>>>> >>>>>>>> time >>>>>>> >>>>>> >>>>> trigger to read the data. Further it runs some transformation i.e. >>>>>> >>>>>>> GroupByKey and CoGroupByKey. on the windowed collections. >>>>>>>> I was running the same pipeline on direct runner and spark runner >>>>>>>> >>>>>>>> earlier.. >>>>>>> >>>>>>> Today gave it a try with Flink on Yarn. >>>>>>>> >>>>>>>> Best Regards, >>>>>>>> Nishu. >>>>>>>> >>>>>>>> < >>>>>>>> https://www.avast.com/sig-email?utm_medium=email&utm_ >>>>>>>> >>>>>>>> source=link&utm_campaign=sig-email&utm_content=webmail&utm_t >>>>>>> erm=icon >>>>>>> >>>>>>> >>>>>>>> Virus-free. >>>>>>>>> >>>>>>>> www.avast.com >>>>>>>> < >>>>>>>> https://www.avast.com/sig-email?utm_medium=email&utm_ >>>>>>>> >>>>>>>> source=link&utm_campaign=sig-email&utm_content=webmail&utm_t >>>>>>> erm=link >>>>>>> >>>>>>> >>>>>>>> <#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2> >>>>>>>>> >>>>>>>> >>>>>>>> On Wed, Nov 22, 2017 at 8:07 PM, Eugene Kirpichov < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>> Thanks Nishu! Can you clarify which pipeline you were running? >>>>>>>> >>>>>>>>> The validation spreadsheet includes 1) the quickstart and 2) mobile >>>>>>>>> >>>>>>>>> game >>>>>>>> >>>>>>> >>>>>>> walkthroughs. Was it one of these, or your custom pipeline? >>>>>>>> >>>>>>>>> >>>>>>>>> On Wed, Nov 22, 2017 at 10:20 AM Nishu <[email protected]> >>>>>>>>> >>>>>>>>> wrote: >>>>>>>> >>>>>>> >>>>> >>>>>> Hi, >>>>>>>>> >>>>>>>>>> >>>>>>>>>> Typo in previous mail. I meant Flink runner. >>>>>>>>>> >>>>>>>>>> Thanks, >>>>>>>>>> Nishu >>>>>>>>>> On Wed, 22 Nov 2017 at 19.17, >>>>>>>>>> >>>>>>>>>> Hi, >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> I build a pipeline using RC 2.2 today and ran with runner on >>>>>>>>>>> >>>>>>>>>>> yarn. >>>>>>>>>> >>>>>>>>> >>>>>> It worked seamlessly for unbounded sources. Couldn’t see any >>>>>>> >>>>>>>> >>>>>>>>>>> issues >>>>>>>>>> >>>>>>>>> >>>>>> with >>>>>>> >>>>>>>> >>>>>>>>> my pipeline so far :) >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> Thanks,Nishu >>>>>>>>>>> >>>>>>>>>>> On Wed, 22 Nov 2017 at 18.57, Reuven Lax >>>>>>>>>>> >>>>>>>>>>> <[email protected] >>>>>>>>>> >>>>>>>>> >>>>>> >>>>>>> wrote: >>>>>>>> >>>>>>>>> >>>>>>>>>> >>>>>>>>>>> Who is validating Flink and Yarn? >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Tue, Nov 21, 2017 at 9:26 AM, Kenneth Knowles >>>>>>>>>>>> >>>>>>>>>>>> <[email protected] >>>>>>>>>>> >>>>>>>>>> >>>>>>>>> >>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, Nov 20, 2017 at 5:01 PM, Eugene Kirpichov < >>>>>>>>>>>> >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>> In the verification spreadsheet, I'm not sure I understand >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> the >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>> difference >>>>>>> >>>>>>>> >>>>>>>>>>>> between the "YARN" and "Standalone cluster/service". Which >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> is >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>> Dataproc? >>>>>>> >>>>>>>> >>>>>>>>>>>> It >>>>>>>>>>>>> >>>>>>>>>>>>> definitely uses YARN, but it is also a standalone >>>>>>>>>>>>>> >>>>>>>>>>>>>> cluster/service. >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>> Does >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>> it >>>>>>>>>>>>> >>>>>>>>>>>>> count for both? >>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> No, it doesn't. A number of runners have their own non-YARN >>>>>>>>>>>>> >>>>>>>>>>>>> cluster >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>> mode. I >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>> would expect that the launching experience might be >>>>>>>>>>>>> >>>>>>>>>>>>> different >>>>>>>>>>>> >>>>>>>>>>> >>>>> and >>>>>> >>>>>>> >>>>>>> the >>>>>>>> >>>>>>>>> >>>>>>>>> portable container management to differ. If they are >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>>> identical, >>>>>>>>>>>> >>>>>>>>>>> >>>>>> experts >>>>>>> >>>>>>>> >>>>>>>>>> in >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> those systems should feel free to coalesce the rows. >>>>>>>>>>>>> >>>>>>>>>>>>> Conversely, >>>>>>>>>>>> >>>>>>>>>>> >>>>>> as >>>>>>> >>>>>>>> >>>>>>>> other >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>> platforms become supported, they could be added or not based >>>>>>>>>>>>> >>>>>>>>>>>>> on >>>>>>>>>>>> >>>>>>>>>>> >>>>>> whether >>>>>>> >>>>>>>> >>>>>>>>>> they are substantively different from a user experience or >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>> QA >>>>>>>>>>>> >>>>>>>>>>> >>>>> point >>>>>> >>>>>>> >>>>>>>> of >>>>>>>>> >>>>>>>>> view. >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>>> Kenn >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> Seems now we're missing just Apex and Flink cluster >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> verifications. >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>> >>>>>>>>> *though Spark runner took 6x longer to run UserScore, >>>>>>>>>>>>>> >>>>>>>>>>>>>> partially >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>> I >>>>>>>> >>>>>>>> guess >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>> because it didn't do autoscaling (Dataflow runner ramped >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> up >>>>>>>>>>>>> >>>>>>>>>>>> >>>>> to 5 >>>>>> >>>>>>> >>>>>>> workers >>>>>>>> >>>>>>>>> >>>>>>>>>>>> whereas Spark runner used 2 workers). For some reason >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> Spark >>>>>>>>>>>>> >>>>>>>>>>>> >>>>> runner >>>>>> >>>>>>> >>>>>>>> chose >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>> not to split the 10GB input files into chunks. >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> On Mon, Nov 20, 2017 at 3:46 PM Reuven Lax >>>>>>>>>>>>>> >>>>>>>>>>>>>> <[email protected] >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>> >>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>>> Done >>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> On Tue, Nov 21, 2017 at 3:08 AM, Robert Bradshaw < >>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> Thanks. You need to re-sign as well. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Mon, Nov 20, 2017 at 12:14 AM, Reuven Lax >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> <[email protected] >>>>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> FYI these generated files have been removed from the >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> source >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>> distribution. >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> On Sat, Nov 18, 2017 at 9:09 AM, Reuven Lax < >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> [email protected] >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>> >>>>>>>>>> wrote: >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>>> hmmm, I thought I removed those generated files >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> from >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>> the >>>>>> >>>>>>> >>>>>>> zip >>>>>>>> >>>>>>>>> >>>>>>>>> file >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>> before >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>>> sending this email. Let me check again. >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> Reuven >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> On Sat, Nov 18, 2017 at 8:52 AM, Robert Bradshaw < >>>>>>>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> The source distribution contains a couple of files >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> not >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>> on >>>>>>> >>>>>>>> >>>>>>>> github >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>> (e.g. >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>>> folders that were added on master, Python >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> generated >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>> files). >>>>>> >>>>>>> >>>>>>>>> The >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>> pom >>>>>>>>>>>>> >>>>>>>>>>>>> files differed only by missing -SNAPSHOT, other >>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> than >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>> that >>>>>> >>>>>>> >>>>>>>> presumably >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>>>> the source release should just be "wget >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> https://github.com/apache/beam/archive/release-2.2.0.zip >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>> "? >>>>>>>>> >>>>>>>>> >>>>>>>>>> diff -rq apache-beam-2.2.0 beam/ | grep -v pom.xml >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> # OK? >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0: DEPENDENCIES >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> # Expected. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Only in beam/: .git >>>>>>>>>>>>>>>>>>> Only in beam/: .gitattributes >>>>>>>>>>>>>>>>>>> Only in beam/: .gitignore >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> # These folders are probably from switching around >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> between >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>> master >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>> and >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> git branches. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0: model >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/runners/flink: examples >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/runners/flink: runner >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/runners/gearpump: >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> jarstore >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>> Only in apache-beam-2.2.0/sdks/java/extensions: >>>>>>> >>>>>>>> >>>>>>>>>>>>>>>>>>> gcp-core >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>> Only in apache-beam-2.2.0/sdks/java/extensions: >>>>>>>> >>>>>>>>> >>>>>>>>>>>>>>>>>>> sketching >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>> Only in apache-beam-2.2.0/sdks/java/io: >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>>>>>>>>> file-based-io-tests >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>> Only in apache-beam-2.2.0/sdks/java/io: hdfs >>>>>>>>>> >>>>>>>>>>> Only in apache-beam-2.2.0/sdks/java/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> maven-archetypes/examples/src/ >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> ma >>>>>>>>>>>>>> >>>>>>>>>>>>>> in/resources/archetype-resources: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> src >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/java/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> maven-archetypes/examples- >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>> java8/ >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> src/main/resources/archetype-resources: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> src >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/java: >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> microbenchmarks >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>> >>>>>> # Here's the generated protos. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_artifact_api_pb2_grpc.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_artifact_api_pb2.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_fn_api_pb2_grpc.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_fn_api_pb2.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_job_api_pb2_grpc.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_job_api_pb2.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_provision_api_pb2_grpc.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_provision_api_pb2.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_runner_api_pb2_grpc.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> beam_runner_api_pb2.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> endpoints_pb2_grpc.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> endpoints_pb2.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> standard_window_fns_pb2_grpc.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> apache_beam/portability/api: >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>> standard_window_fns_pb2.py >>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> And some other sdist generated Python files. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python: .eggs >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python: LICENSE >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python: NOTICE >>>>>>>>>>>>>>>>>>> Only in apache-beam-2.2.0/sdks/python: README.md >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Presumably we should just purge these files from >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> the >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>> rc? >>>>>> >>>>>>> >>>>>>> >>>>>>>> >>>>>>>>>>>>>>>>>>> FWIW, the Python tarball looks fine. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> On Fri, Nov 17, 2017 at 4:40 PM, Eugene Kirpichov >>>>>>>>>>>>>>>>>>> <[email protected]> wrote: >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> How can I specify a dependency on the staged RC? >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> E.g. >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>> I'm >>>>>>>> >>>>>>>>> >>>>>>>>> trying >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>>> to >>>>>>>>>>>>>> >>>>>>>>>>>>>> validate the quickstart per >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> https://beam.apache.org/get- >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> started/quickstart-java/ >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>> and >>>>>>>> >>>>>>>>> >>>>>>>>> specifying >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>>>>> version >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> 2.2.0 doesn't work I suppose because it's not >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> released >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>> yet. >>>>>>>> >>>>>>>>> >>>>>>>>>> Should >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>>> I >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> pass >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> some command-line flag to mvn to make it fetch >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> the >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>> version >>>>>> >>>>>>> >>>>>>>>> from >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>> the >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> staging >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> area? >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> On Fri, Nov 17, 2017 at 4:37 PM Lukasz Cwik >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> <[email protected] >>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> Its open to all, its just that there are >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> binding >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>> votes >>>>>> >>>>>>> >>>>>>>> and >>>>>>>>> >>>>>>>>>> >>>>>>>>>> non-binding >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>>>>> votes. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> On Fri, Nov 17, 2017 at 4:26 PM, Valentyn >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Tymofieiev >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> >>>>>>> < >>>>>>>> >>>>>>>> [email protected]> wrote: >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> I have a process question: is the vote open >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> for >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>> committers >>>>>> >>>>>>> >>>>>>>>>>>> only >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> or >>>>>>>>>>>>>>> >>>>>>>>>>>>>>> for >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> all >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> contributors? >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> On Fri, Nov 17, 2017 at 4:06 PM, Lukasz Cwik >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> <[email protected]> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> wrote: >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> +1, Approve the release >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> I have verified the wordcount quickstart on >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> the >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>> Apache >>>>>>> >>>>>>>> >>>>>>>>>> Beam >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>> website >>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> using >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> Apex, DirectRunner, Flink & Spark on Linux. >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> The Gearpump runner is yet to have a >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> quickstart >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>> listed >>>>>>> >>>>>>>> >>>>>>>>>> on >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> our >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>> website. >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> Adding the quickstart is already >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> represented >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>> by >>>>>> >>>>>> this >>>>>>> >>>>>>>> >>>>>>>>> existing >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>>>> issue: >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> https://issues.apache.org/ >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> jira/browse/BEAM-2692 >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>> >>>>>>>> On Fri, Nov 17, 2017 at 11:50 AM, Valentyn >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> Tymofieiev < >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>> [email protected]> wrote: >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> I have verified: SHA & MD5 signatures of >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> Python >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>> artifacts >>>>>>>> >>>>>>>>> >>>>>>>>>>>>> in >>>>>>>>>>>>>> >>>>>>>>>>>>>> [2], and >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> checked Python side of the validation >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> checklist >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>> on >>>>>>>> >>>>>>>>> >>>>>>>>> Linux. >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>>> There is one known issue in UserScore >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> example >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>> for >>>>>>> >>>>>>>> >>>>>>>> Dataflow >>>>>>>>> >>>>>>>>>> >>>>>>>>>>>>> runner. >>>>>>>>>>>>>> >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>> The >>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>> issue has been fixed on master branch and >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> does >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>> not >>>>>>>> >>>>>>>>> >>>>>>>>> require a >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>>>> cherry-pick >>>>>>>>>>>>>>> >>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> at >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> this point. A workaround is to pass >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> --save_main_session >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>> pipeline >>>>>>>>>>>>> >>>>>>>>>>>>>> >>>>>>>>>>>>>>>> option. >>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>> RC4 looks good to me so far. >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> On Fri, Nov 17, 2017 at 11:30 AM, Kenneth >>>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>>>> Knowles >>>>>>>>>>>>>>>>>>>>>>> >>>>>>>>>>>>>>>>>>>>>> >>>>>>>> <[email protected] >>>>>>>>> >>>>>>>>>>
