See
<https://builds.apache.org/job/beam_Dependency_Check/267/display/redirect?page=changes>
Changes:
[sjvanrossum] [BEAM-9776] Fixes filesystem not found error
[kcweaver] [BEAM-9875] Use FlinkRunner instead of PortableRunner in
cross-language
[kcweaver] Remove runner check in xlang wordcount.
[kamil.wasilewski] [BEAM-6710] Add landing page with links to relevant
dashboards
[kcweaver] [BEAM-9835] [Portable Spark] Broadcast a PCollection at most once.
[robertwb] [BEAM-9935] Respect allowed split points in Python.
[mxm] [BEAM-9930] Add image to Beam Summit blog post
[github] Add License file for the Go SDK for pkg.go.dev
[sniemitz] Allow users of AvroIO to specify a custom DatumReader implementation
[pawel.pasterz] [BEAM-2530] PreCommit Dataflow examples - test compiled with
java 11
[mxm] [BEAM-9947] Store updated ParDoPayload for length-prefixed timer coders
[kamil.wasilewski] Fix InfluxDB credentials binding
[mxm] [BEAM-9947] Add unit test to check length prefixing of timer key
[robertwb] More comments.
[rohde.samuel] Return empty iterator on empty cache
[rohde.samuel] Change TestStreamImpl to a producer/consumer pattern
[borzoo.esmailloo] [BEAM-9216] Upgrade katas gradle to version 5.2.1
[github] [BEAM-9887] Throw IllegalArgumentException when building Row with
[klk] [BEAM-9952] Revert "remove PipelineRunner.fromOptions call"
[github] Merge pull request #11637 from Waiting for BQ Query and Export jobs for
[robertwb] Make grpc-requiring class definition optional.
[github] [BEAM-9884] Add options to SqlTransform for specifying planner (#11647)
[daniel.o.programmer] [BEAM-9642] Adding Go SDF fallback for unexpanded SDFs.
[kamil.wasilewski] Fix metrics reporting in HDFS IO IT tests
[mxm] [BEAM-9963] Fix coder type in failing ParDo streaming load test
[github] Merge pull request #11567: [BEAM-8132] Report Python metrics to
InfluxDB
[mxm] [BEAM-9164] Re-enable UnboundedSourceWrapper#testWatermarkEmission test
[kamil.wasilewski] Fix InfluxDB measurement names to match those in Grafana
dashboards
[github] [BEAM-9945] Report data channel progress via a designated counter.
[kawaigin] Use csv reader instead of split to read csv data.
[github] [BEAM-9577] Update Java Runners to handle dependency-based artifact
[github] Merge pull request #11673 from [BEAM-9967] Adding support for BQ labels
[github] [BEAM-9622] Add Python SqlTransform test that joins tagged PCollections
[github] [BEAM-9959] Root Transform fixes (#11686)
[mxm] [BEAM-9966] Use dataproc staging bucket for checkpoints directory
[tysonjh] Disambiguate method filter for toArray.
[pabloem] Revert "Merge pull request #11673 from [BEAM-9967] Adding support for
BQ
[thw] Bump Flink 1.10 version
[kcweaver] [BEAM-9975] Log invalid dictionary after unsuccessful struct
conversion.
[github] [BEAM-9945] Ensure that the read index represents the number of fully
[github] [BEAM-9942] reduce groovy code duplication in python test-suites
[boyuanz] [BEAM-9935] Respect allowed split points in Java
[apilloud] [BEAM-9522] Reject FULL JOIN ON false
[pabloem] [BEAM-9967] Adding support for BQ labels on Query/Export jobs. (Roll
[github] Switch to %s
[github] [BEAM-9001, BEAM-6327] Ensure that all transforms (except for required
[github] [BEAM-9928] Add qualified import name to task descriptors (#11690)
[mxm] [BEAM-9966] Remove unnecessary Reshuffles
[omarismail] [BEAM-9964] Setting --workerCacheMB to make its way to the
[github] [BEAM-9634] Add natural language analysis transform (#11611)
[github] [BEAM-9430] Fixes the bounds of initial watermark set to estimators
[kcweaver] [BEAM-9993] Add option defaults for Flink Python tests.
[github] [BEAM-9941] Added a test of a GBK followed by a Flatten with an unknown
[github] Clarify pubsub IO comment about timestamps (#11672)
[omarismail] [BEAM-9964] Added testMaxWeight method in WIndmillStateCacheTest
as per
[iemejia] [BEAM-9833] Add yamllint config
[iemejia] [BEAM-9833] Fix .asf.yaml issues, sort labels and disable rebase
button
[github] Clarifies an error message in Katas to explain what is actually wrong.
[github] Merge pull request #11210 from [BEAM-8949] SpannerIO integration tests
[github] [BEAM-9876] Migrate the Beam website from Jekyll to Hugo to enable
[github] Update the range for pyarrow to qualify pyarrow 0.17.x (#11699)
[yifanzou] Run Inventory job twice a day at 6 and 18.
[github] Update release notes link for 2.20.0
[jiangxuehua1213] [BEAM-9136] Update doc about docker image license pulling
[kamil.wasilewski] Make Post-Commits status dashboard compatible with the
latest Grafana
[bntnam.app] Modified the codeblock background
[mxm] [BEAM-9966] Propagate the keys to the load generator correctly
[github] [BEAM-2939] Ensure that we don't checkpoint the initial restriction as
[github] support isRelease tag for docker build command & update release guide
[github] [BEAM-1866] Enable validation of PAssert counts in Java validates
runner
[daniel.o.programmer] [BEAM-9951] Creating a synthetic source for the Go SDK.
[daniel.o.programmer] [BEAM-9951] Creating a synthetic step for the Go SDK.
[github] Merge pull request #11725: [BEAM-10015] Fix output timestamp on
dataflow
[github] [BEAM-2939] Ensure that we update the watermark even when no elements
[github] [BEAM-2530] Implement Zeta SQL precommit compile tests and run on java
------------------------------------------
[...truncated 35.19 KB...]
https://lucene.apache.org
- org.apache.solr:solr-test-framework [5.5.4 -> 8.5.1]
https://lucene.apache.org
- org.apache.zookeeper:zookeeper [3.4.11 -> 3.6.1]
http://zookeeper.apache.org
- org.assertj:assertj-core [3.11.1 -> 3.16.1]
http://assertj.org
- org.bouncycastle:bcpkix-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.bouncycastle:bcprov-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.3]
https://groovy-lang.org
- org.codehaus.janino:commons-compiler [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.janino:janino [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.woodstox:stax2-api [3.1.4 -> 4.2.1]
http://github.com/FasterXML/stax2-api
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.4.0]
https://conscrypt.org/
- org.conscrypt:conscrypt-openjdk-uber [1.3.0 -> 2.4.0]
https://conscrypt.org/
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 10.0.0.alpha2]
http://www.eclipse.org/jetty
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 10.0.0.alpha2]
http://www.eclipse.org/jetty
- org.eclipse.jetty.alpn:alpn-api [1.1.2.v20150522 -> 1.1.3.v20160715]
http://www.eclipse.org/jetty
- org.eclipse.jetty.npn:npn-api [1.1.1.v20141010 -> 8.1.2.v20120308]
${jetty.url}
- org.elasticmq:elasticmq-rest-sqs_2.12 [0.14.1 -> 0.15.6]
http://softwaremill.com/open-source
- org.elasticsearch:elasticsearch [2.4.1 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.0.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.6.3 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [6.4.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [7.5.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch-hadoop [5.0.0 -> 7.7.0]
http://github.com/elastic/elasticsearch-hadoop
- org.elasticsearch.client:elasticsearch-rest-client [5.6.3 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [6.4.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [7.5.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:transport [5.0.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.0.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.6.3 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [6.4.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [7.5.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [5.6.3 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [6.4.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [7.5.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.freemarker:freemarker [2.3.28 -> 2.3.30]
https://freemarker.apache.org/
- org.fusesource.mqtt-client:mqtt-client [1.15 -> 1.16]
http://${forge-project-id}.fusesource.org/
- org.hamcrest:hamcrest-core [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.hamcrest:hamcrest-library [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.jboss.marshalling:jboss-marshalling [1.4.11.Final -> 2.0.9.Final]
http://www.jboss.org
- org.jboss.modules:jboss-modules [1.1.0.Beta1 -> 1.10.1.Final]
http://www.jboss.org
- org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin:kotlin-stdlib-jdk8 [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin [1.3.21 ->
1.3.72]
- org.mockito:mockito-core [3.0.0 -> 3.3.3]
https://github.com/mockito/mockito
- org.mongodb:mongo-java-driver [3.9.1 -> 3.12.4]
http://www.mongodb.org
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin [0.4.0 ->
0.6.0]
- org.postgresql:postgresql [42.2.2 -> 42.2.12]
https://github.com/pgjdbc/pgjdbc
- org.powermock:powermock-api-mockito2 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.powermock:powermock-module-junit4 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.scala-lang:scala-library [2.11.8 -> 2.13.2]
https://www.scala-lang.org/
- org.scala-lang:scala-library [2.12.7 -> 2.13.2]
https://www.scala-lang.org/
- org.slf4j:jcl-over-slf4j [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.21 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-jdk14 [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-simple [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 2.8]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.2.6.RELEASE]
https://github.com/spring-projects/spring-framework
- org.testcontainers:clickhouse [1.10.5 -> 1.14.2]
https://testcontainers.org
- org.testcontainers:localstack [1.11.2 -> 1.14.2]
https://testcontainers.org
- org.testcontainers:testcontainers [1.11.3 -> 1.14.2]
https://testcontainers.org
- org.xerial.snappy:snappy-java [1.1.4 -> 1.1.7.5]
https://github.com/xerial/snappy-java
- redis.clients:jedis [3.0.1 -> 3.3.0]
https://github.com/xetorthio/jedis
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.2.4]
https://github.com/ClickHouse/clickhouse-jdbc
- software.amazon.awssdk:apache-client [2.10.61 -> 2.13.18]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:auth [2.10.61 -> 2.13.18]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:cloudwatch [2.10.61 -> 2.13.18]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:dynamodb [2.10.61 -> 2.13.18]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sdk-core [2.10.61 -> 2.13.18]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sns [2.10.61 -> 2.13.18]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sqs [2.10.61 -> 2.13.18]
https://aws.amazon.com/sdkforjava
- sqlline:sqlline [1.4.0 -> 1.9.0]
https://github.com/julianhyde/sqlline
Gradle updates:
- Gradle: [5.2.1 -> 6.4.1]
Generated report file build/dependencyUpdates/report.txt
> Task :sdks:python:dependencyUpdates
# Assume that python virtual env is already active
pip install -e .[docs,test,gcp,aws,interactive]
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020.
Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will
drop support for Python 2.7 in January 2021. More details about Python 2
support in pip, can be found at
https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Obtaining
file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
Processing
/home/jenkins/.cache/pip/wheels/50/24/4d/4580ca4a299f1ad6fd63443e6e584cb21e9a07988e4aa8daac/crcmod-1.7-cp27-cp27mu-linux_x86_64.whl
Processing
/home/jenkins/.cache/pip/wheels/59/b1/91/f02e76c732915c4015ab4010f3015469866c1eb9b14058d8e7/dill-0.3.1.1-cp27-none-any.whl
Collecting fastavro<0.24,>=0.21.4
Using cached fastavro-0.23.4-cp27-cp27mu-manylinux2010_x86_64.whl (1.1 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.12.1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (1.29.0)
Processing
/home/jenkins/.cache/pip/wheels/fe/a7/05/23e3699975fc20f8a30e00ac1e515ab8c61168e982abe4ce70/hdfs-2.5.8-cp27-none-any.whl
Processing
/home/jenkins/.cache/pip/wheels/e4/d1/46/7cd382f626d8c00c26d3a6199017ca9868f48e2903c8a79d6a/httplib2-0.15.0-py2-none-any.whl
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting numpy<2,>=1.14.3
Using cached numpy-1.16.6-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached pymongo-3.10.1-cp27-cp27mu-manylinux1_x86_64.whl (444 kB)
Processing
/home/jenkins/.cache/pip/wheels/48/f7/87/b932f09c6335dbcf45d916937105a372ab14f353a9ca431d7d/oauth2client-3.0.0-cp27-none-any.whl
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.12.0)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting pytz>=2018.3
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.2-py2-none-any.whl (9.0 kB)
Processing
/home/jenkins/.cache/pip/wheels/51/14/c1/d4e383d261ced6c549ea2d072cc3a3955744948d9b0d2698f6/avro-1.9.2-cp27-none-any.whl
Collecting funcsigs<2,>=1.0.2
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.3.0)
Processing
/home/jenkins/.cache/pip/wheels/81/91/41/3272543c0b9c61da9c525f24ee35bae6fe8f60d4858c66805d/PyVCF-0.6.8-cp27-none-any.whl
Collecting pyarrow<0.18.0,>=0.15.1
Using cached pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.7.4.1)
Collecting boto3>=1.9
Using cached boto3-1.13.11-py2.py3-none-any.whl (128 kB)
Collecting Sphinx<2.0,>=1.5.2
Using cached Sphinx-1.8.5-py2.py3-none-any.whl (3.1 MB)
Collecting cachetools<4,>=3.1.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting google-apitools<0.5.29,>=0.5.28
Using cached google_apitools-0.5.28-py2-none-any.whl (134 kB)
Collecting google-cloud-datastore<1.8.0,>=1.7.1
Using cached google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting google-cloud-pubsub<1.1.0,>=0.39.0
Using cached google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery<=1.24.0,>=1.6.0
Using cached google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-bigtable<1.1.0,>=0.31.1
Using cached google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-spanner<1.14.0,>=1.13.0
Using cached google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<=0.13.0,>=0.12.0
Using cached google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<1.14.0,>=1.8.0
Using cached google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177
kB)
Collecting google-cloud-vision<0.43.0,>=0.38.0
Using cached google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB)
Collecting facets-overview<2,>=1.0.0
Using cached facets_overview-1.0.0-py2.py3-none-any.whl (24 kB)
Collecting ipython<8,>=5.8.0
Using cached ipython-5.10.0-py2-none-any.whl (760 kB)
ERROR: Could not find a version that satisfies the requirement
ipykernel<6,>=5.2.0 (from apache-beam==2.22.0.dev0) (from versions: 4.0.1,
4.0.2, 4.0.3, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0, 4.3.1, 4.4.0, 4.4.1,
4.5.0, 4.5.1, 4.5.2, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.10.0,
4.10.1)
ERROR: No matching distribution found for ipykernel<6,>=5.2.0 (from
apache-beam==2.22.0.dev0)
> Task :sdks:python:dependencyUpdates FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'>
line: 95
* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 4s
3 actionable tasks: 3 executed
Publishing build scan...
https://gradle.com/s/b3nbbg3to42qc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
