See
<https://builds.apache.org/job/beam_Dependency_Check/266/display/redirect?page=changes>
Changes:
[sebastian.graca] [BEAM-9439] Return split instead of total backlog size
[nielm] Remove spurious error message.
[aiyangar] Changed sns writes to async
[jhnmora000] [BEAM-9418] Support ANY_VALUE aggregation functions
[lcwik] [BEAM-8944] Improve UnboundedThreadPoolExecutor performance
[lcwik] fixup! Fix lint
[pawel.pasterz] Update error prone
[pawel.pasterz] Aling EP core and annotations versions
[tudor.marian] Do not attempt to estimate sizes of group-by-key values behind a
key;
[tudor.marian] remove comments
[github] [BEAM-9870] Always generate Dataflow-compatible FnApi protos. (#11593)
[tudor.marian] Make BatchGroupAlsoByWindowViaIteratorsFn extend the
[tudor.marian] revert changes to grouping shuffle reader and iterable like coder
[aiyangar] [BEAM-8542] V2 async changes for SNSIO
[tudor.marian] fix merge conflicts
[tudor.marian] remove obsolete class
[github] Go fmt changes. (#11576)
[apilloud] [BEAM-9661] Fix ORDER BY with LIMIT
[apilloud] [BEAM-9659][BEAM-9657][BEAM-9664] Reject unsupported unnest joins
[daniel.o.programmer] [BEAM-9799] Automated validation for RTrackers.
[daniel.o.programmer] [BEAM-9643] Adding Go SDF Documentation.
[github] [BEAM-9880] fix cannot touch issue (#11606)
[daniel.o.programmer] [BEAM-9643] Adjusting signature for TrySplit.
[github] Merge pull request #11560 from [BEAM-9886] Auto-inferring project for
[github] [BEAM-9650] Add PeriodicSequence generator. (#11477)
[je.ik] Disable two flaky tests (BEAM-8035, BEAM-9164)
[github] Pass pipeline options from caller to expansion service (#11574)
[je.ik] [BEAM-9888] Drop data based on input watermark in
[robertwb] Move job server to its own module.
[robertwb] [BEAM-9845] Stage artifacts over expansion service.
[robertwb] [BEAM-9577] Resolve dependencies in Java expansion service.
[robertwb] Start artifact service in expansion service driver. 0;256;0c# Please
[robertwb] [BEAM-7746] Enable mypy type checking for Beam Python code.
[kcweaver] [BEAM-9908] Fix Python build failures in release script.
[github] [BEAM-9840] Support for Parameterized Types when converting from
[kcweaver] Update instructions in release guide.
[iemejia] [BEAM-9836] Exclude Spark runner from UsesKeyInParDo tests
[robertwb] Fix thread local to be initialized on every thread.
[alxavier] [BEAM-9911]Replace SpannerIO.write latency counter to distribution
[github] un-duplicate _BEAM_SERVICES
[github] Update sdks/python/mypy.ini
[github] Remove a bunch of spurious warnings in tests. (#11621)
[github] [BEAM-8134] Grafana dashboards for Load Tests and IO IT Performance
[github] [BEAM-8133] Push ioit tests metrics to influxdb
[mxm] [BEAM-8742] Add stateful and timely processing benchmarks
[mxm] [BEAM-9900] Remove shutdownSourcesOnFinalWatermark flag
[github] [BEAM-9913] remove license dir if exists (#11630)
[github] Merge pull request #11624 from [BEAM-9767] Make streaming_wordcount use
[github] [BEAM-9731] passert.Equals: sort output strings for easier reading
[github] Revert "Pass pipeline options from caller to expansion service
(#11574)"
[kcweaver] [BEAM-4782] Remove workaround in Python multimap tests.
[klk] Remove tests of Java on Dataflows Java Runner Harness
[github] [Beam-9679] Add Core Transforms section / Map lesson to the Go SDK
katas
[amaliujia] [BEAM-9929] Support UNNEST(array_column) in ZetaSQL.
[mxm] [BEAM-9930] Beam Summit Digital 2020 announcement on blog
[mxm] Correct URL in blog post
[matthias.baetens] Minor (markup) changes
[kamil.wasilewski] [BEAM-8132, BEAM-8133] Apply InfluxDB pipeline options in
Load Tests and
[kamil.wasilewski] [BEAM-8132, BEAM-8133] Assume no trailing slash after a
hostname
[iemejia] [BEAM-2530] Compile and run tests on java 11 for Precommit portability
[github] [BEAM-9883] Refactor SDF test restrictions. (#11605)
[chambers] Add a BeamJava test with Flatten with different input and output
Coders
[github] [BEAM-3288] Add suggested fix to error message (#11622)
[jferriero] check lastAttemptedOffset non-null
[zyichi] [BEAM-9940] Set timer family spec for TimerDeclarations in dataflow
[mxm] [BEAM-9930] Correct authors of beam summit digital blog post
------------------------------------------
[...truncated 34.76 KB...]
https://lucene.apache.org
- org.apache.solr:solr-test-framework [5.5.4 -> 8.5.1]
https://lucene.apache.org
- org.apache.zookeeper:zookeeper [3.4.11 -> 3.6.1]
http://zookeeper.apache.org
- org.assertj:assertj-core [3.11.1 -> 3.16.1]
http://assertj.org
- org.bouncycastle:bcpkix-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.bouncycastle:bcprov-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.3]
https://groovy-lang.org
- org.codehaus.janino:commons-compiler [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.janino:janino [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.woodstox:stax2-api [3.1.4 -> 4.2]
http://github.com/FasterXML/stax2-api
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.4.0]
https://conscrypt.org/
- org.conscrypt:conscrypt-openjdk-uber [1.3.0 -> 2.4.0]
https://conscrypt.org/
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 10.0.0.alpha2]
http://www.eclipse.org/jetty
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 10.0.0.alpha2]
http://www.eclipse.org/jetty
- org.eclipse.jetty.alpn:alpn-api [1.1.2.v20150522 -> 1.1.3.v20160715]
http://www.eclipse.org/jetty
- org.eclipse.jetty.npn:npn-api [1.1.1.v20141010 -> 8.1.2.v20120308]
${jetty.url}
- org.elasticmq:elasticmq-rest-sqs_2.12 [0.14.1 -> 0.15.6]
http://softwaremill.com/open-source
- org.elasticsearch:elasticsearch [2.4.1 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch-hadoop [5.0.0 -> 7.6.2]
http://github.com/elastic/elasticsearch-hadoop
- org.elasticsearch.client:elasticsearch-rest-client [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:transport [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.freemarker:freemarker [2.3.28 -> 2.3.30]
https://freemarker.apache.org/
- org.fusesource.mqtt-client:mqtt-client [1.15 -> 1.16]
http://${forge-project-id}.fusesource.org/
- org.hamcrest:hamcrest-core [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.hamcrest:hamcrest-library [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.jboss.marshalling:jboss-marshalling [1.4.11.Final -> 2.0.9.Final]
http://www.jboss.org
- org.jboss.modules:jboss-modules [1.1.0.Beta1 -> 1.10.1.Final]
http://www.jboss.org
- org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin:kotlin-stdlib-jdk8 [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin [1.3.21 ->
1.3.72]
- org.mockito:mockito-core [3.0.0 -> 3.3.3]
https://github.com/mockito/mockito
- org.mongodb:mongo-java-driver [3.9.1 -> 3.12.4]
http://www.mongodb.org
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin [0.4.0 ->
0.6.0]
- org.postgresql:postgresql [42.2.2 -> 42.2.12]
https://github.com/pgjdbc/pgjdbc
- org.powermock:powermock-api-mockito2 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.powermock:powermock-module-junit4 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.scala-lang:scala-library [2.11.8 -> 2.13.2]
https://www.scala-lang.org/
- org.scala-lang:scala-library [2.12.7 -> 2.13.2]
https://www.scala-lang.org/
- org.slf4j:jcl-over-slf4j [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.21 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-jdk14 [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-simple [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 2.8]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.2.6.RELEASE]
https://github.com/spring-projects/spring-framework
- org.testcontainers:clickhouse [1.10.5 -> 1.14.1]
https://testcontainers.org
- org.testcontainers:localstack [1.11.2 -> 1.14.1]
https://testcontainers.org
- org.testcontainers:testcontainers [1.11.3 -> 1.14.1]
https://testcontainers.org
- org.xerial.snappy:snappy-java [1.1.4 -> 1.1.7.5]
https://github.com/xerial/snappy-java
- redis.clients:jedis [3.0.1 -> 3.3.0]
https://github.com/xetorthio/jedis
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.2.4]
https://github.com/ClickHouse/clickhouse-jdbc
- software.amazon.awssdk:apache-client [2.10.61 -> 2.13.13]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:auth [2.10.61 -> 2.13.13]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:cloudwatch [2.10.61 -> 2.13.13]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:dynamodb [2.10.61 -> 2.13.13]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sdk-core [2.10.61 -> 2.13.13]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sns [2.10.61 -> 2.13.13]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sqs [2.10.61 -> 2.13.13]
https://aws.amazon.com/sdkforjava
- sqlline:sqlline [1.4.0 -> 1.9.0]
https://github.com/julianhyde/sqlline
Gradle updates:
- Gradle: [5.2.1 -> 6.4]
Generated report file build/dependencyUpdates/report.txt
> Task :sdks:python:dependencyUpdates
# Assume that python virtual env is already active
pip install -e .[docs,test,gcp,aws,interactive]
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020.
Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will
drop support for Python 2.7 in January 2021. More details about Python 2
support in pip, can be found at
https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Obtaining
file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
Processing
/home/jenkins/.cache/pip/wheels/50/24/4d/4580ca4a299f1ad6fd63443e6e584cb21e9a07988e4aa8daac/crcmod-1.7-cp27-cp27mu-linux_x86_64.whl
Processing
/home/jenkins/.cache/pip/wheels/59/b1/91/f02e76c732915c4015ab4010f3015469866c1eb9b14058d8e7/dill-0.3.1.1-cp27-none-any.whl
Collecting fastavro<0.24,>=0.21.4
Using cached fastavro-0.23.3-cp27-cp27mu-manylinux2010_x86_64.whl (1.1 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.12.1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (1.28.1)
Processing
/home/jenkins/.cache/pip/wheels/fe/a7/05/23e3699975fc20f8a30e00ac1e515ab8c61168e982abe4ce70/hdfs-2.5.8-cp27-none-any.whl
Processing
/home/jenkins/.cache/pip/wheels/e4/d1/46/7cd382f626d8c00c26d3a6199017ca9868f48e2903c8a79d6a/httplib2-0.15.0-py2-none-any.whl
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting numpy<2,>=1.14.3
Using cached numpy-1.16.6-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached pymongo-3.10.1-cp27-cp27mu-manylinux1_x86_64.whl (444 kB)
Processing
/home/jenkins/.cache/pip/wheels/48/f7/87/b932f09c6335dbcf45d916937105a372ab14f353a9ca431d7d/oauth2client-3.0.0-cp27-none-any.whl
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.11.3)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting pytz>=2018.3
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.2-py2-none-any.whl (9.0 kB)
Processing
/home/jenkins/.cache/pip/wheels/51/14/c1/d4e383d261ced6c549ea2d072cc3a3955744948d9b0d2698f6/avro-1.9.2-cp27-none-any.whl
Collecting funcsigs<2,>=1.0.2
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.3.0)
Processing
/home/jenkins/.cache/pip/wheels/81/91/41/3272543c0b9c61da9c525f24ee35bae6fe8f60d4858c66805d/PyVCF-0.6.8-cp27-none-any.whl
Collecting pyarrow<0.17.0,>=0.15.1
Using cached pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.7.4.1)
Collecting boto3>=1.9
Using cached boto3-1.13.6-py2.py3-none-any.whl (128 kB)
Collecting Sphinx<2.0,>=1.5.2
Using cached Sphinx-1.8.5-py2.py3-none-any.whl (3.1 MB)
Collecting cachetools<4,>=3.1.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting google-apitools<0.5.29,>=0.5.28
Using cached google_apitools-0.5.28-py2-none-any.whl (134 kB)
Collecting google-cloud-datastore<1.8.0,>=1.7.1
Using cached google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting google-cloud-pubsub<1.1.0,>=0.39.0
Using cached google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery<=1.24.0,>=1.6.0
Using cached google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-bigtable<1.1.0,>=0.31.1
Using cached google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-spanner<1.14.0,>=1.13.0
Using cached google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<=0.13.0,>=0.12.0
Using cached google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<1.14.0,>=1.8.0
Using cached google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177
kB)
Collecting google-cloud-vision<0.43.0,>=0.38.0
Using cached google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB)
Collecting facets-overview<2,>=1.0.0
Using cached facets_overview-1.0.0-py2.py3-none-any.whl (24 kB)
Collecting ipython<8,>=5.8.0
Using cached ipython-5.10.0-py2-none-any.whl (760 kB)
ERROR: Could not find a version that satisfies the requirement
ipykernel<6,>=5.2.0 (from apache-beam==2.22.0.dev0) (from versions: 4.0.1,
4.0.2, 4.0.3, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0, 4.3.1, 4.4.0, 4.4.1,
4.5.0, 4.5.1, 4.5.2, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.10.0,
4.10.1)
ERROR: No matching distribution found for ipykernel<6,>=5.2.0 (from
apache-beam==2.22.0.dev0)
> Task :sdks:python:dependencyUpdates FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'>
line: 95
* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1m 57s
3 actionable tasks: 3 executed
Publishing build scan...
https://gradle.com/s/otbwidg65b5s4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
