See <https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApiJava11_Cron/3/display/redirect?page=changes>
Changes: [amogh.tiwari] lzo-addons [amogh.tiwari] 3rd dec 2019, 12:43AM [amogh.tiwari] PR corrections [amogh.tiwari] PR javaPreCommit update [amogh.tiwari] PR changes: added testLzopSpilttale() [amogh.tiwari] updated gradle for supporting optional dependency of lzo- 2:39 AM IST [iemejia] [BEAM-9162] Upgrade Jackson to version 2.10.2 [chadrik] Add attributes defined in operations.pxd but missing in operations.py [veblush] Upgrades gcsio to 2.0.0 [jonathan.warburton09] [BEAM-8916] Rename external_test_it so that it is picked up by pytest [robertwb] Minor FnAPI proto cleanups. [iemejia] [BEAM-9281] Update commons-csv to version 1.8 [je.ik] [BEAM-9273] Explicitly disable @RequiresTimeSortedInput on unsupported [huangry] Create validation runner test for metrics (limited to user counter in [yoshiki.obata] [BEAM-7198] rename ToStringCoder to ToBytesCoder for proper [yoshiki.obata] [BEAM-7198] add comment [ankurgoenka] [BEAM-9290] Support runner_harness_container_image in released python [suztomo] beam-linkage-check.sh [suztomo] copyright [yoshiki.obata] [BEAM-7198] fixup: reformatted with yapf [github] [BEAM-3221] Clarify documentation for StandardTransforms.Primitives, [aromanenko.dev] [BEAM-9292] Provide an ability to specify additional maven repositories [aromanenko.dev] [BEAM-9292] KafkaIO: add io.confluent repository to published POM [github] [BEAM-8201] Add other endpoint fields to provision API. (#10839) [github] [BEAM-9269] Add commit deadline for Spanner writes. (#10752) [github] [AVRO-2737] Exclude a buggy avro version from requirements spec. [je.ik] [BEAM-9273] code review - to be squashed [iemejia] Refine labels/categories for PR autolabeling [github] Update roadmap page for python 3 support [iemejia] [BEAM-9160] Removed WebIdentityTokenCredentialsProvider explicit json [iemejia] Remove unused ReduceFnRunnerHelper class [iemejia] Do not set options.filesToStage in case of spark local execution in [iemejia] Do not set options.filesToStage in case of spark local execution in [github] [BEAM-6522] [BEAM-7455] Unskip Avro IO tests that are now passing. [github] [BEAM-5605] Convert all BoundedSources to SplittableDoFns when using [github] [BEAM-8758] Google-cloud-spanner upgrade to 1.49.1 (#10765) [github] Ensuring appropriate write_disposition and create_disposition for jobs [github] [BEAM-3545] Return metrics as MonitoringInfos (#10777) [github] Modify the TestStreamFileRecord to use TestStreamPayload events. [iemejia] [BEAM-9280] Update commons-compress to version 1.20 [kcweaver] [BEAM-9212] fix zetasql struct exception [kcweaver] [BEAM-9211] Spark reuse Flink portable jar test script [ankurgoenka] [BEAM-9287] Add Python Streaming Validates runner tests for Unified [kcweaver] test_pipeline_jar Use single jar arg for both Flink and Spark. [iemejia] Pin Avro dependency in Python SDK to be consistent with Avro versioning [apilloud] [BEAM-9311] ZetaSQL Named Parameters are case-insensitive [github] Bump dataflow container version (#10861) [github] [BEAM-8335] Update StreamingCache with new Protos (#10856) [github] [BEAM-9317] Fix portable test executions to specify the beam_fn_api [je.ik] [BEAM-9265] @RequiresTimeSortedInput respects allowedLateness [github] [BEAM-9289] Improve performance for metrics update of samza runner [github] = instead of -eq [iemejia] [BEAM-6857] Classify unbounded dynamic timers tests in the [iemejia] Exclude Unbounded PCollection tests from Flink Portable runner batch [github] [BEAM-9317] Fix Dataflow tests to not perform SplittableDoFn expansion [iemejia] [BEAM-9315] Allow multiple paths via HADOOP_CONF_DIR in [robertwb] Add capabilities and requirements to beam protos. [github] Update container images used by Dataflow runner with unreleased SDKs. [github] [BEAM-9314] Make dot output deterministic (#10864) [ccy] [BEAM-9277] Fix exception when running in IPython notebook. [github] Remove experimental parallelization (-j 8) flags from sphinx [iemejia] [BEAM-9301] Checkout the hash of master instead of the branch in beam [github] [BEAM-8399] Add --hdfs_full_urls option (#10223) [iemejia] Fix typo on runners/extensions-java label for github PR autolabeler [github] Merge pull request #10862: [BEAM-9320] Add AlwaysFetched annotation [github] Change static Map fields in ReflectUtils to be concurrent [iemejia] [BEAM-8561] Add ThriftIO to support IO for Thrift files [github] [BEAM-9258] Integrate Google Cloud Data loss prevention functionality [github] [BEAM-9291] Upload graph option in dataflow's python sdk (#10829) [amogh.tiwari] update 19/02/2020 2:32 AM added static class, removed wrappers, updated [chlarsen] Removed compile time generation of test Thrift class. [github] [BEAM-1080] Skip tests that required GCP credentials [github] Exclude tests that are not passing under currect Avro IO requirements. [lcwik] [BEAM-5605] Honor the bounded source timestamps timestamp. [chlarsen] Added ThriftIO to list of supported I/O on website and to change log. [github] [BEAM-7246] Added Google Spanner Write Transform (#10712) [github] Apply suggestions from code review [github] [BEAM-1833] Fixes BEAM-1833 [bhulette] Don't exclude UsesUnboundedPCollections in Dataflow VR tests [heejong] [BEAM-9335] update hard-coded coder id when translating Java external [huangry] Fixups. [github] [BEAM-9146] Integrate GCP Video Intelligence functionality for Python [iemejia] Mark Test categories as internal and improve categorization [github] Add DataCatalogPipelineOptionsRegistrar (#10896) [github] Allow unknown non-merging WindowFns of know window type. (#10875) [iemejia] [BEAM-9326] Make JsonToRow transform input <String> instead of <? [github] [BEAM-8575] Removed MAX_TIMESTAMP from testing data (#10835) [github] Update python sdk container to beam-master-20200219 (#10903) [heejong] [BEAM-9338] add postcommit XVR spark badges [github] [BEAM-3545] Fix race condition w/plan metrics. (#10906) [robertwb] Update go beam runner generated protos. [heejong] [BEAM-9341] postcommit xvr flink fix [github] Update [github] Update [github] Update [github] Update [github] Update [github] Update [github] Update [github] Update [shubham.srivastava] finishing touch 20/02/2020 6:43PM [github] [BEAM-9085] Fix performance regression in SyntheticSource (#10885) [github] Update google-cloud-videointelligence dependency [robertwb] Add standard protocol capabilities to protos. [github] [BEAM-8280] no_annotations decorator (#10904) [kcweaver] [BEAM-9225] Fix Flink uberjar job termination bug. [kcweaver] Reuse get_state method. [chamikara] Updates DataflowRunner to support multiple SDK environments. [github] [BEAM-8280] Enable and improve IOTypeHints debug_str traceback (#10894) [github] [BEAM-9343]Upgrade ZetaSQL to 2020.02.1 (#10918) [robertwb] [BEAM-9339] Declare capabilities for Go SDK. [lcwik] [BEAM-5605] Eagerly close the BoundedReader once we have read everything [github] [BEAM-9229] Adding dependency information to Environment proto (#10733) [lcwik] [BEAM-9349] Update joda-time version [lcwik] fixup! Fix SpotBugs failure [kcweaver] [BEAM-9022] publish Spark job server Docker image [drubinstein] Bump google cloud bigquery to 1.24.0 [github] Revert "[BEAM-9085] Fix performance regression in SyntheticSource [github] [BEAM-8537] Provide WatermarkEstimator to track watermark (#10375) [github] Make sure calling try_claim(0) more than once also trows exception. [robertwb] [BEAM-9339] Declare capabilities for Python SDK. [robertwb] Add some standard requirement URNs to the protos. [kcweaver] [BEAM-9356] reduce Flink test logs to warn [github] [BEAM-9063] migrate docker images to apache (#10612) [github] [BEAM-9252] Exclude jboss's Main and module-info.java (#10930) [boyuanz] Clean up and add type-hints to SDF API [robertwb] [BEAM-9340] Populate requirements for Python DoFn properties. [hannahjiang] fix postcommit failure [robertwb] [BEAM-8019] Branch on having multiple environments. [github] [BEAM-9359] Switch to Data Catalog client (#10917) [github] [BEAM-9344] Add support for bundle finalization execution to the Beam [iemejia] [BEAM-9342] Upgrade vendored bytebuddy to version 1.10.8 [iemejia] Add Dataflow Java11 ValidatesRunner badge to the PR template [github] Merge pull request #10944: [BEAM-7274] optimize oneOf handling [github] [BEAM-8280] Fix IOTypeHints origin traceback on partials (#10927) [relax] Support null fields in rows with ByteBuddy generated code. [robertwb] Allow metrics update to be tolerant to uninitalized metric containers. [github] [GoSDK] Fix race condition in statemgr & test (#10941) [github] [BEAM-9347] Don't overwrite default runner harness for unified worker [boyuanz] Update docstring of ManualWatermarkEstimator.set_watermark() [boyuanz] Address comments [boyuanz] Address comments again [github] [BEAM-9228] Support further partition for FnApi ListBuffer (#10847) [github] [BEAM-7926] Data-centric Interactive Part3 (#10731) [boyuanz] Use NoOpWatermarkEstimator in sdf_direct_runner [chamikara] Updates Dataflow client [github] [BEAM-9240]: Check for Nullability in typesEqual() method of FieldType [amogh.tiwari] 25/02/2020 updated imports Amogh Tiwari & Shubham Srivastava [iemejia] [BEAM-8616] Make hadoop-client a provided dependency on ParquetIO [mxm] [BEAM-9345] Remove workaround to restore stdout/stderr during JobGraph [iemejia] [BEAM-9364] Refactor KafkaIO to use DeserializerProviders [mxm] [BEAM-9345] Add end-to-end Flink job submission test [iemejia] [BEAM-9352] Align version of transitive jackson dependencies with Beam [iemejia] [BEAM-9329] Support request of schemas by version on KafkaIO + CSR [lcwik] [BEAM-9252] Update to vendored gRPC without problematic [github] Update [github] Update [github] Update [lcwik] [BEAM-2822, BEAM-2939, BEAM-6189, BEAM-4374] Enable passing completed [crites] Changes TestStreamTranscriptTest to only emit two elements so that its [alex] [BEAM-7274] Add DynamicMessage Schema support [github] [BEAM-9322] Fix tag output names within Dataflow to be consistent with [iemejia] [BEAM-9342] Exclude module-info.class from vendored Byte Buddy 1.10.8 [iemejia] Add KafkaIO support for Confluent Schema Registry to the CHANGEs file [github] [BEAM-9247] Integrate GCP Vision API functionality (#10959) [github] Fix kotlin warnings (#10976) [github] Update python sdk container version to beam-master-20200225 (#10965) [github] [BEAM-9248] Integrate Google Cloud Natural Language functionality for [github] [BEAM-9355] Basic support for NewType (#10928) [github] [BEAM-8979] reintroduce mypy-protobuf stub generation (#10734) ------------------------------------------ Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on apache-beam-jenkins-4 (beam) in workspace <https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApiJava11_Cron/ws/> No credentials specified Wiping out workspace first. Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init > <https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApiJava11_Cron/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* > git rev-parse origin/master^{commit} # timeout=10 Checking out Revision 631cb81b39d1beaf53e9fd4b9f144e098c2aeace (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 631cb81b39d1beaf53e9fd4b9f144e098c2aeace Commit message: "[BEAM-8979] reintroduce mypy-protobuf stub generation (#10734)" > git rev-list --no-walk ffeea60f3cb766722a101ded1ea97c0be79bf13a # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 [EnvInject] - Variables injected successfully. [Gradle] - Launching build. [src] $ <https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApiJava11_Cron/ws/src/gradlew> -PdisableSpotlessCheck=true --continue --max-workers=12 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g :clean > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy FROM-CACHE > Task :buildSrc:pluginDescriptors > Task :buildSrc:processResources > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:pluginUnderTestMetadata > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validateTaskProperties FROM-CACHE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build Configuration on demand is an incubating feature. > Task :clean UP-TO-DATE Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 2s 1 actionable task: 1 up-to-date Publishing build scan... https://gradle.com/s/nbfqkgoizmbic Build step 'Invoke Gradle script' changed build result to SUCCESS [Gradle] - Launching build. [src] $ <https://builds.apache.org/job/beam_PreCommit_JavaPortabilityApiJava11_Cron/ws/src/gradlew> -Pdockerfile=Dockerfile-java11 -PdisableSpotlessCheck=true -Pjava8Home=/usr/lib/jvm/java-8-openjdk-amd64 -Pjava11Home=/usr/lib/jvm/java-11-openjdk-amd64 --continue --max-workers=120 -Dorg.gradle.jvmargs=-Xms2g -Dorg.gradle.jvmargs=-Xmx4g javaPreCommitPortabilityApiJava11 > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validateTaskProperties UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Configure project :sdks:java:container Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:container Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:examples Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:go:test Found go 1.12 in /usr/bin/go, use it. > Configure project :sdks:python:container Found go 1.12 in /usr/bin/go, use it. FAILURE: Build failed with an exception. * What went wrong: Task 'javaPreCommitPortabilityApiJava11' not found in root project 'beam'. * Try: Run gradlew tasks to get a list of available tasks. Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 6.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 15s Publishing build scan... https://gradle.com/s/zduvkomswdlzm Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
