See
<https://builds.apache.org/job/beam_Dependency_Check/269/display/redirect?page=changes>
Changes:
[kmjung] Reject fractional values outside of (0.0, 1.0)
[kcweaver] Update Beam website to release 2.21.0.
[kcweaver] Add blog post announcing the Beam 2.21.0 release.
[rohde.samuel] Add to/from_runner_api_parameters to WriteToBigQuery
[zyichi] [BEAM-9603] Add timer family support to FnApiDoFnRunner
[zyichi] Address comments and add tests
[zyichi] comments
[bhulette] add def args
[github] Fix typo Portabillity -> Portability
[heejong] [BEAM-10064] Fix google3 import error for BEAM-9383
[aramaswamis] Fix typo copyLicenseScrips -> copyLicenseScripts
[aramaswamis] [BEAM-10067] Minify website assets with --minify flag
[aramaswamis] add io-matrix
[aramaswamis] add descriptions, links to guides
[aramaswamis] fix typo
[aramaswamis] format
[aramaswamis] update CHANGES.md
[heejong] [BEAM-10077] using filename + hash instead of UUID for staging name
[rarokni] [BEAM-9770] BigQueryIO Patterns. Add Document update to snippit
update.
[github] [BEAM-10073] Add pubsub performance tests results to the grafana
[darshanjani100] [BEAM-10074] | implement hashing functions
[github] [BEAM-10065] Fix beam release guide template (#11797)
[github] Fix typo in doc "and and" -> "and" (#11810)
[github] [BEAM-2939, BEAM-10057] Ensure that we can process an
[github] [BEAM-7370] Upgrade sphinx to 3.0.3 (#11798)
[zyichi] Clear redundant debug statements in pr-11756
[github] [BEAM-10076] Fix dataflow worker status page rendering (#11812)
[lcwik] [BEAM-10016, BEAM-10094] Disable single test to get portable validates
[altay] Add a bare bones powered by page.
[kamil.wasilewski] [BEAM-9936] Reduce the code duplication across
python/container/py*
[kamil.wasilewski] [BEAM-9936] Create SDK harness containers with Python3.8
[kamil.wasilewski] [BEAM-9810] Tox suites for Python 3.8
[kamil.wasilewski] [BEAM-9810] Fix 'dictionary keys changed during iteration'
error
[kamil.wasilewski] [BEAM-9810] Disable all failing tests until Dataflow runner
supports
[iemejia] [BEAM-7770] Make ReplicaInfo part of Read on SolrIO
[iemejia] [BEAM-7770] Add ReadAll transform for SolrIO
[piotr.szuberski] [BEAM-10102] Fix query in pubsub read grafana dashoard
[kcweaver] [BEAM-10106] Script the deployment of artifacts to pypi
[kcweaver] Add pypi script to release guide.
[kcweaver] [BEAM-10108] Update Flink versions in publish_docker_images.sh.
[github] Add release date.
[github] Add release date.
[github] Add release date.
[github] Remove HTML comment (causes formatting issues)
[github] Add a flag to tune the size of the grouping tables used by the dataflow
[github] Add Pub/Sub Lite to in progress IOs
[kcweaver] Move 2.20 download addresses to archive.
[pabloem] [BEAM-10098] Enabling javadoc export for RabbitMqIO and KuduIO
[kcweaver] Improve log messages in release scripts.
[kcweaver] Install twine in virtual env.
[bhulette] remove as_cloud_object override
[github] Merge pull request #11796 from [BEAM-10003] Use local code for building
[github] [BEAM-9971] Do not use context classloader. (#11784)
[chamikaramj] Enables proto holders for testing runner API. Without this x-lang
can be
[github] [BEAM-9363] Support TUMBLE aggregation (#11807)
[aromanenko.dev] [BEAM-9916] Fixed some IO Urls on website
[github] Avoid re-encoding value state cells each commit (#11823)
[sniemitz] [BEAM-9964] Move workerCacheMb to a user-visible place
[github] [BEAM-9679] Flatten Kata for Go (#11806)
[github] [BEAM-9220] Go Dataflow jobs to use runner v2 (#11207)
[robertwb] Update multi-language roadmap status.
[daniel.o.programmer] [BEAM-9935] Respect allowed split points and fraction in
Go.
[github] [BEAM-8280] Blog post: Python typing changes (#11070)
[github] Update website/www/site/content/en/roadmap/connectors-multi-sdk.md
[heejong] [BEAM-10125] adding cross-language KafkaIO integration test
[david.moravek] [BEAM-8608] Chain DoFns in Flink batch runner when possible.
[github] [BEAM-10078] uniquify Dataflow specific jars when staging (#11814)
[github] [BEAM-10107] Remove outdated instructions for website updates in rele…
[github] [BEAM-9679] Add a CoGroupByKey lesson to the Core Transforms section
[github] [BEAM-10110] Propagate ids for custom coders. (#11832)
[rohde.samuel] Moves apply_WriteToBigQuery to override
[github] [BEAM-10121] Python RowCoder doesn't support nested structs (#11841)
[rohde.samuel] Skip test if py=3.8 see BEAM-9754
[github] [BEAM-7746] Fix type errors and enable checks for
[github] Update programming-guide.md
[david.moravek] [BEAM-8608] Code review. Fix checkstyle.
[github] [BEAM-9421] Better documentation of output results from AnnotateText
[github] [BEAM-9421] Website section that describes getting predictions using AI
------------------------------------------
[...truncated 35.24 KB...]
https://lucene.apache.org
- org.apache.solr:solr-test-framework [5.5.4 -> 8.5.2]
https://lucene.apache.org
- org.apache.zookeeper:zookeeper [3.4.11 -> 3.6.1]
http://zookeeper.apache.org
- org.assertj:assertj-core [3.11.1 -> 3.16.1]
http://assertj.org
- org.bouncycastle:bcpkix-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.bouncycastle:bcprov-jdk15on [1.54 -> 1.65.01]
http://www.bouncycastle.org/java.html
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.4]
https://groovy-lang.org
- org.codehaus.janino:commons-compiler [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.janino:janino [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.woodstox:stax2-api [3.1.4 -> 4.2.1]
http://github.com/FasterXML/stax2-api
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.4.0]
https://conscrypt.org/
- org.conscrypt:conscrypt-openjdk-uber [1.3.0 -> 2.4.0]
https://conscrypt.org/
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 10.0.0.beta0]
http://www.eclipse.org/jetty
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 10.0.0.beta0]
http://www.eclipse.org/jetty
- org.eclipse.jetty.alpn:alpn-api [1.1.2.v20150522 -> 1.1.3.v20160715]
http://www.eclipse.org/jetty
- org.eclipse.jetty.npn:npn-api [1.1.1.v20141010 -> 8.1.2.v20120308]
${jetty.url}
- org.elasticmq:elasticmq-rest-sqs_2.12 [0.14.1 -> 0.15.6]
http://softwaremill.com/open-source
- org.elasticsearch:elasticsearch [2.4.1 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.0.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.6.3 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [6.4.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [7.5.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch-hadoop [5.0.0 -> 7.7.0]
http://github.com/elastic/elasticsearch-hadoop
- org.elasticsearch.client:elasticsearch-rest-client [5.6.3 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [6.4.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [7.5.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:transport [5.0.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.0.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.6.3 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [6.4.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [7.5.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [5.6.3 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [6.4.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [7.5.0 -> 7.7.0]
https://github.com/elastic/elasticsearch
- org.freemarker:freemarker [2.3.28 -> 2.3.30]
https://freemarker.apache.org/
- org.fusesource.mqtt-client:mqtt-client [1.15 -> 1.16]
http://${forge-project-id}.fusesource.org/
- org.hamcrest:hamcrest-core [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.hamcrest:hamcrest-library [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.jboss.marshalling:jboss-marshalling [1.4.11.Final -> 2.0.9.Final]
http://www.jboss.org
- org.jboss.modules:jboss-modules [1.1.0.Beta1 -> 1.10.1.Final]
http://www.jboss.org
- org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin:kotlin-stdlib-jdk8 [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin [1.3.21 ->
1.3.72]
- org.mockito:mockito-core [3.0.0 -> 3.3.3]
https://github.com/mockito/mockito
- org.mongodb:mongo-java-driver [3.9.1 -> 3.12.4]
http://www.mongodb.org
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin [0.4.0 ->
0.6.0]
- org.postgresql:postgresql [42.2.2 -> 42.2.13]
https://jdbc.postgresql.org
- org.powermock:powermock-api-mockito2 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.powermock:powermock-module-junit4 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.scala-lang:scala-library [2.11.8 -> 2.13.2]
https://www.scala-lang.org/
- org.scala-lang:scala-library [2.12.7 -> 2.13.2]
https://www.scala-lang.org/
- org.slf4j:jcl-over-slf4j [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.21 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-jdk14 [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-simple [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 3.0]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.2.6.RELEASE]
https://github.com/spring-projects/spring-framework
- org.testcontainers:clickhouse [1.10.5 -> 1.14.3]
https://testcontainers.org
- org.testcontainers:localstack [1.11.2 -> 1.14.3]
https://testcontainers.org
- org.testcontainers:testcontainers [1.11.3 -> 1.14.3]
https://testcontainers.org
- org.xerial.snappy:snappy-java [1.1.4 -> 1.1.7.5]
https://github.com/xerial/snappy-java
- redis.clients:jedis [3.0.1 -> 3.3.0]
https://github.com/xetorthio/jedis
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.2.4]
https://github.com/ClickHouse/clickhouse-jdbc
- software.amazon.awssdk:apache-client [2.10.61 -> 2.13.26]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:auth [2.10.61 -> 2.13.26]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:cloudwatch [2.10.61 -> 2.13.26]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:dynamodb [2.10.61 -> 2.13.26]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sdk-core [2.10.61 -> 2.13.26]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sns [2.10.61 -> 2.13.26]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sqs [2.10.61 -> 2.13.26]
https://aws.amazon.com/sdkforjava
- sqlline:sqlline [1.4.0 -> 1.9.0]
https://github.com/julianhyde/sqlline
Gradle updates:
- Gradle: [5.2.1 -> 6.4.1 -> 6.5-rc-1]
Generated report file build/dependencyUpdates/report.txt
> Task :sdks:python:dependencyUpdates
# Assume that python virtual env is already active
pip install -e .[docs,test,gcp,aws,interactive]
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020.
Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will
drop support for Python 2.7 in January 2021. More details about Python 2
support in pip, can be found at
https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Obtaining
file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
Processing
/home/jenkins/.cache/pip/wheels/50/24/4d/4580ca4a299f1ad6fd63443e6e584cb21e9a07988e4aa8daac/crcmod-1.7-cp27-cp27mu-linux_x86_64.whl
Processing
/home/jenkins/.cache/pip/wheels/54/6e/1d/172ed90bc541c925faff97e03c7a110b8ce876ab13e10b0c77/dill-0.3.1.1-py2-none-any.whl
Collecting fastavro<0.24,>=0.21.4
Using cached fastavro-0.23.4-cp27-cp27mu-manylinux2010_x86_64.whl (1.1 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.12.1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (1.29.0)
Processing
/home/jenkins/.cache/pip/wheels/3a/18/11/31dfb768f5d55108760cdd028ad7026173f7c0e847cb71fe4b/hdfs-2.5.8-py2-none-any.whl
Processing
/home/jenkins/.cache/pip/wheels/ce/98/d0/7cbebe9de22c986e85e2561069d25c9752b43523240f803199/httplib2-0.17.4-py2-none-any.whl
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting numpy<2,>=1.14.3
Using cached numpy-1.16.6-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached pymongo-3.10.1-cp27-cp27mu-manylinux1_x86_64.whl (444 kB)
Processing
/home/jenkins/.cache/pip/wheels/48/f7/87/b932f09c6335dbcf45d916937105a372ab14f353a9ca431d7d/oauth2client-3.0.0-cp27-none-any.whl
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (3.12.2)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting pytz>=2018.3
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.2-py2-none-any.whl (9.0 kB)
Processing
/home/jenkins/.cache/pip/wheels/28/a0/fc/a3d4892b81eedc9e027323c08e9890bee1ec2d35edd1c1ac96/avro-1.9.2-py2-none-any.whl
Collecting funcsigs<2,>=1.0.2
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (3.3.0)
Processing
/home/jenkins/.cache/pip/wheels/81/91/41/3272543c0b9c61da9c525f24ee35bae6fe8f60d4858c66805d/PyVCF-0.6.8-cp27-none-any.whl
Collecting pyarrow<0.18.0,>=0.15.1
Using cached pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (3.7.4.1)
Collecting boto3>=1.9
Using cached boto3-1.13.19-py2.py3-none-any.whl (128 kB)
Collecting Sphinx<2.0,>=1.5.2
Using cached Sphinx-1.8.5-py2.py3-none-any.whl (3.1 MB)
Collecting cachetools<4,>=3.1.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py2-none-any.whl (135 kB)
Collecting google-cloud-datastore<1.8.0,>=1.7.1
Using cached google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting google-cloud-pubsub<1.1.0,>=0.39.0
Using cached google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery<=1.24.0,>=1.6.0
Using cached google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-bigtable<1.1.0,>=0.31.1
Using cached google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-spanner<1.14.0,>=1.13.0
Using cached google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<=0.13.0,>=0.12.0
Using cached google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<1.14.0,>=1.8.0
Using cached google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177
kB)
Collecting google-cloud-vision<0.43.0,>=0.38.0
Using cached google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB)
Collecting facets-overview<2,>=1.0.0
Using cached facets_overview-1.0.0-py2.py3-none-any.whl (24 kB)
Collecting ipython<8,>=5.8.0
Downloading ipython-5.10.0-py2-none-any.whl (760 kB)
ERROR: Could not find a version that satisfies the requirement
ipykernel<6,>=5.2.0 (from apache-beam==2.23.0.dev0) (from versions: 4.0.1,
4.0.2, 4.0.3, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0, 4.3.1, 4.4.0, 4.4.1,
4.5.0, 4.5.1, 4.5.2, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.10.0,
4.10.1)
ERROR: No matching distribution found for ipykernel<6,>=5.2.0 (from
apache-beam==2.23.0.dev0)
> Task :sdks:python:dependencyUpdates FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'>
line: 95
* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 5m 12s
3 actionable tasks: 3 executed
Publishing build scan...
https://gradle.com/s/ic7m322jgvwac
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
