See
<https://builds.apache.org/job/beam_Dependency_Check/264/display/redirect?page=changes>
Changes:
[markliu] [BEAM-8831] Do not copy generated files for Python source copy
[robertwb] [BEAM-9577] New artifact staging and retrieval service for Java.
[robertwb] [BEAM-9577] Multi-threaded artifact staging service backend.
[pabloem] [BEAM-9608] BundleManagers use BundleContextManager for configuration
[ehudm] [BEAM-6860] Fix iobase non-global windows bug
[rohde.samuel] Add a timeout to the TestStream GRPC and fix the Streaming cache
timeout
[skoonce] [BEAM-9773]: Update Dataflow Debug Capture to use Google API client
[pabloem] [BEAM-9639] Saving side inputs after producer execution, not before
[pabloem] [BEAM-9639] Separate Stage and Bundle execution. Improve typing
[valentyn] Renames run_test -> run_scenario so that nose test runner does not
think
[huangry] Fix user distribution metric test by using less restricting value.
[github] Log job id similar to Java and Go
[robertwb] [BEAM-6960] More sophisticated job server starting and stopping.
[robertwb] Abort pipeline if docker containers die unexpectedly.
[robertwb] [BEAM-6960] Go ULR validates runner tests.
[huangry] Apply yapf fix.
[iemejia] [BEAM-9569] Fix BeamSqlPojoExample logRecords method to not require
Row
[mxm] [BEAM-9733] Always let ImpulseSourceFunction emit a final watermark
[kawaigin] add display:block to datatable so that the columns can have various
[michal.walenia] [BEAM-9147] Add @Experimental annotation to VideoIntelligence
related
[michal.walenia] Add @Experimental to the package-info as well
[iemejia] [BEAM-9285] Add Postcommit ValidatesRunner CI Job for Flink on Java 11
[skoonce] Remove all Dataflow google-api-client-jackson(1) dependencies
[huangry] Replace all explicit validation.
[skoonce] Missed cleanup
[github] Add release date for 2.20.0
[github] [BEAM-9692]: Make CombineValues portable (#11335)
[robertwb] lint
[github] [BEAM-9788] Add RetainDockerContainers flag support to Go SDK. (#11467)
[github] [BEAM-9775] Add Go support for SDF StandardRequirements. (#11443)
[github] [BEAM-9496] Add to_dataframe and to_pcollection APIs. (#11264)
[ankurgoenka] [BEAM-9791] Add precommit for dataflow runner v2
[apilloud] [BEAM-9662][BEAM-9663] Reject Null Limit and Offset
[boyuanz] Fix SplittableParDoNaiveBounded DoFnInvoker.
[shoaib.zafar] update release 2.20.0 blog post and added contributors name
[mxm] [BEAM-9794] Reduce state cells needed for BufferingDoFnRunner
[github] Revert "[BEAM-8131] Provide Kubernetes setup for Prometheus (#9482)"
[github] Merge pull request #11466 from [BEAM-9787] Clear error message on UW +
[pabloem] [BEAM-9639][BEAM-9608] Addressing review comments.
[github] [BEAM-9764] multi threading & optional pulling (#11428)
[github] Revert "[BEAM-9014] CachingShuffleBatchReader use bytes to limit cache
[github] [BEAM-9789] Fix lock error. Add test. (#11468)
[github] [BEAM-7981] Correct ParDo(callable) test (#11446)
[apilloud] [BEAM-9514] Ensure nullability passes through sum
[github] [BEAM-6597, BEAM-6467] Add support for reporting monitoring infos to
the
[yoshiki.obata] [BEAM-9755] changed MAKE_ADD stack pop order according to
Python version
[github] Merge pull request #11489 [BEAM-9577] Ensure required directories exist
[github] [BEAM-9642] Enabling SDF exec runners and fixing small bug. (#11474)
[github] [BEAM-9717] update future version to 0.18.2 for Python 3.8 (#11494)
[github] [BEAM-9577] Use new artifact API to stage go artifacts. (#11490)
[github] Force output names to be unicode-compatible on Python 2. (#11485)
[github] Make license_script.sh tolerate directory already existing (#11501)
[github] [BEAM-9778] remove temp directory & add docker-pull-licenses to release
[lcwik] [BEAM-2939] Expose HasProgress interface for restriction trackers and
[lcwik] [BEAM-2939] Add the ability for SDK harness runners to provide
[lcwik] [BEAM-2939] Integrate progress reporting for splittable dofns.
[lcwik] [BEAM-2939] Fold Sizes sub-interfaces into RestrictionTracker
[lcwik] [BEAM-2939] Drop HasSize in favor of using
[github] [BEAM-8603] Add Python SqlTransform (#10055)
[mxm] [BEAM-9733] Make up for timers set while processing the bundle
[robertwb] Use futures, better error handling.
[github] [BEAM-9701] Increments fastavro version range upper bound to 0.24.
[pabloem] [BEAM-9812] Fixing bug causing pipelines requiring temp tables to not
[ehudm] [BEAM-7405] Workaround for bad Docker config
[boyuanz] [BEAM-8871] Support trySplit for ByteKeyRangeTracker
[robertwb] [BEAM-9813] Replace outputs with respect to the correct tag.
[tweise] [BEAM-9811] Nightly snapshot publish error
[github] [BEAM-9775] Adding Go SDF example, adjusting GetProgress signature.
[kamil.wasilewski] [BEAM-9761] Disable auto builds for tests that are currently
failing.
[tweise] [BEAM-9811] Copy pom for all publishMavenJavaPublication tasks
[github] add licenses and license types for zetasql packages (#11516)
[github] Added a batch example with covid tracking data for interactive
notebook.
[github] Fix invalid formatting specifier in verify
[github] [BEAM-9488] Ensure we pass through PCollection ids instead of
attempting
[iemejia] [BEAM-9820] Upgrade Flink 1.9.x to 1.9.3
[github] [BEAM-9819] Relaxes the version range for httplib2 to <0.16.0. (#11522)
------------------------------------------
[...truncated 34.09 KB...]
http://tika.apache.org/
- org.apache.tika:tika-parsers [1.24 -> 1.24.1]
http://tika.apache.org/
- org.apache.zookeeper:zookeeper [3.4.11 -> 3.6.0]
http://zookeeper.apache.org
- org.assertj:assertj-core [3.11.1 -> 3.15.0]
http://assertj.org
- org.bouncycastle:bcpkix-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.bouncycastle:bcprov-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.3]
https://groovy-lang.org
- org.codehaus.janino:commons-compiler [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.janino:janino [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.woodstox:stax2-api [3.1.4 -> 4.2]
http://github.com/FasterXML/stax2-api
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.4.0]
https://conscrypt.org/
- org.conscrypt:conscrypt-openjdk-uber [1.3.0 -> 2.4.0]
https://conscrypt.org/
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 10.0.0.alpha2]
http://www.eclipse.org/jetty
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 10.0.0.alpha2]
http://www.eclipse.org/jetty
- org.eclipse.jetty.alpn:alpn-api [1.1.2.v20150522 -> 1.1.3.v20160715]
http://www.eclipse.org/jetty
- org.eclipse.jetty.npn:npn-api [1.1.1.v20141010 -> 8.1.2.v20120308]
${jetty.url}
- org.elasticmq:elasticmq-rest-sqs_2.12 [0.14.1 -> 0.15.6]
http://softwaremill.com/open-source
- org.elasticsearch:elasticsearch [2.4.1 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch-hadoop [5.0.0 -> 7.6.2]
http://github.com/elastic/elasticsearch-hadoop
- org.elasticsearch.client:elasticsearch-rest-client [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:transport [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.freemarker:freemarker [2.3.28 -> 2.3.30]
https://freemarker.apache.org/
- org.fusesource.mqtt-client:mqtt-client [1.15 -> 1.16]
http://${forge-project-id}.fusesource.org/
- org.hamcrest:hamcrest-core [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.hamcrest:hamcrest-library [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.jboss.marshalling:jboss-marshalling [1.4.11.Final -> 2.0.9.Final]
http://www.jboss.org
- org.jboss.modules:jboss-modules [1.1.0.Beta1 -> 1.10.1.Final]
http://www.jboss.org
- org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin:kotlin-stdlib-jdk8 [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin [1.3.21 ->
1.3.72]
- org.mockito:mockito-core [3.0.0 -> 3.3.3]
https://github.com/mockito/mockito
- org.mongodb:mongo-java-driver [3.9.1 -> 3.12.3]
http://www.mongodb.org
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin [0.4.0 ->
0.6.0]
- org.postgresql:postgresql [42.2.2 -> 42.2.12]
https://github.com/pgjdbc/pgjdbc
- org.powermock:powermock-api-mockito2 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.powermock:powermock-module-junit4 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.scala-lang:scala-library [2.11.8 -> 2.13.2]
https://www.scala-lang.org/
- org.scala-lang:scala-library [2.12.7 -> 2.13.2]
https://www.scala-lang.org/
- org.slf4j:jcl-over-slf4j [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.21 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-jdk14 [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-simple [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 2.8]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.2.5.RELEASE]
https://github.com/spring-projects/spring-framework
- org.testcontainers:clickhouse [1.10.5 -> 1.14.1]
https://testcontainers.org
- org.testcontainers:localstack [1.11.2 -> 1.14.1]
https://testcontainers.org
- org.testcontainers:testcontainers [1.11.3 -> 1.14.1]
https://testcontainers.org
- org.xerial.snappy:snappy-java [1.1.4 -> 1.1.7.3]
https://github.com/xerial/snappy-java
- redis.clients:jedis [3.0.1 -> 3.2.0]
https://github.com/xetorthio/jedis
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.2.4]
https://github.com/ClickHouse/clickhouse-jdbc
- software.amazon.awssdk:apache-client [2.10.61 -> 2.13.3]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:auth [2.10.61 -> 2.13.3]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:cloudwatch [2.10.61 -> 2.13.3]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:dynamodb [2.10.61 -> 2.13.3]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sdk-core [2.10.61 -> 2.13.3]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sns [2.10.61 -> 2.13.3]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sqs [2.10.61 -> 2.13.3]
https://aws.amazon.com/sdkforjava
- sqlline:sqlline [1.4.0 -> 1.9.0]
https://github.com/julianhyde/sqlline
Gradle updates:
- Gradle: [5.2.1 -> 6.3 -> 6.4-rc-2]
Generated report file build/dependencyUpdates/report.txt
> Task :sdks:python:dependencyUpdates
# Assume that python virtual env is already active
pip install -e .[docs,test,gcp,aws,interactive]
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020.
Please upgrade your Python as Python 2.7 is no longer maintained. A future
version of pip will drop support for Python 2.7. More details about Python 2
support in pip, can be found at
https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Obtaining
file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
Processing
/home/jenkins/.cache/pip/wheels/50/24/4d/4580ca4a299f1ad6fd63443e6e584cb21e9a07988e4aa8daac/crcmod-1.7-cp27-cp27mu-linux_x86_64.whl
Processing
/home/jenkins/.cache/pip/wheels/54/6e/1d/172ed90bc541c925faff97e03c7a110b8ce876ab13e10b0c77/dill-0.3.1.1-py2-none-any.whl
Collecting fastavro<0.24,>=0.21.4
Using cached fastavro-0.23.2-cp27-cp27mu-manylinux2010_x86_64.whl (1.1 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.12.1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (1.28.1)
Processing
/home/jenkins/.cache/pip/wheels/3a/18/11/31dfb768f5d55108760cdd028ad7026173f7c0e847cb71fe4b/hdfs-2.5.8-py2-none-any.whl
Processing
/home/jenkins/.cache/pip/wheels/e4/d1/46/7cd382f626d8c00c26d3a6199017ca9868f48e2903c8a79d6a/httplib2-0.15.0-py2-none-any.whl
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting numpy<2,>=1.14.3
Using cached numpy-1.16.6-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached pymongo-3.10.1-cp27-cp27mu-manylinux1_x86_64.whl (444 kB)
Processing
/home/jenkins/.cache/pip/wheels/48/f7/87/b932f09c6335dbcf45d916937105a372ab14f353a9ca431d7d/oauth2client-3.0.0-cp27-none-any.whl
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.11.3)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting pytz>=2018.3
Using cached pytz-2019.3-py2.py3-none-any.whl (509 kB)
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.2-py2-none-any.whl (9.0 kB)
Processing
/home/jenkins/.cache/pip/wheels/28/a0/fc/a3d4892b81eedc9e027323c08e9890bee1ec2d35edd1c1ac96/avro-1.9.2-py2-none-any.whl
Collecting funcsigs<2,>=1.0.2
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.3.0)
Processing
/home/jenkins/.cache/pip/wheels/81/91/41/3272543c0b9c61da9c525f24ee35bae6fe8f60d4858c66805d/PyVCF-0.6.8-cp27-none-any.whl
Collecting pyarrow<0.17.0,>=0.15.1
Using cached pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.7.4.1)
Collecting boto3>=1.9
Using cached boto3-1.12.46-py2.py3-none-any.whl (128 kB)
Collecting Sphinx<2.0,>=1.5.2
Using cached Sphinx-1.8.5-py2.py3-none-any.whl (3.1 MB)
Collecting cachetools<4,>=3.1.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting google-apitools<0.5.29,>=0.5.28
Using cached google_apitools-0.5.28-py2-none-any.whl (134 kB)
Collecting google-cloud-datastore<1.8.0,>=1.7.1
Using cached google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting google-cloud-pubsub<1.1.0,>=0.39.0
Using cached google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery<=1.24.0,>=1.6.0
Using cached google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-bigtable<1.1.0,>=0.31.1
Using cached google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-spanner<1.14.0,>=1.13.0
Using cached google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<=0.13.0,>=0.12.0
Using cached google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<1.14.0,>=1.8.0
Using cached google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177
kB)
Collecting google-cloud-vision<0.43.0,>=0.38.0
Using cached google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB)
Collecting facets-overview<2,>=1.0.0
Using cached facets_overview-1.0.0-py2.py3-none-any.whl (24 kB)
Collecting ipython<8,>=5.8.0
Using cached ipython-5.9.0-py2-none-any.whl (760 kB)
ERROR: Could not find a version that satisfies the requirement
ipykernel<6,>=5.2.0 (from apache-beam==2.22.0.dev0) (from versions: 4.0.1,
4.0.2, 4.0.3, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0, 4.3.1, 4.4.0, 4.4.1,
4.5.0, 4.5.1, 4.5.2, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.10.0,
4.10.1)
ERROR: No matching distribution found for ipykernel<6,>=5.2.0 (from
apache-beam==2.22.0.dev0)
> Task :sdks:python:dependencyUpdates FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'>
line: 95
* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 4m 33s
3 actionable tasks: 3 executed
Publishing build scan...
https://gradle.com/s/6xckrbc4dkmng
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
