See
<https://builds.apache.org/job/beam_Dependency_Check/263/display/redirect?page=changes>
Changes:
[robertwb] [BEAM-9496] Evaluation of deferred dataframes via Beam operations.
[robertwb] Fix and test tuple inputs and outputs.
[suztomo] google-api-client 1.30.9
[ehudm] [BEAM-8466] Make strip_iterable more strict
[amaliujia] add 2.20.0 blog post
[amaliujia] add a known issue
[huangry] Include user distritribution into metric-dedicated validate runner
test.
[huangry] update inline comment.
[huangry] To allow only assert on committed metrics, bypassing the attempted
ones.
[huangry] Use distribution matcher for testing.
[kamil.wasilewski] [BEAM-8671] Migrate Load Tests to Python 3.7
[robertwb] Comments and clarification.
[APryor] Correct a typo in documentation
[chamikara] Updates Dataflow stateful DoFn setup to support external transforms
[github] [BEAM-9738] Update dataflow to setup correct docker environment
options.
[github] [BEAM-9136]Add licenses for dependencies for Java (#11243)
[kcweaver] [BEAM-9744] Add missing region option to py perf tests.
[lcwik] [BEAM-9562] Fix output timestamp to be inferred from scheduled time when
[kcweaver] [BEAM-9744] Remove --region option from SQL tests.
[lcwik] [BEAM-2939] Update unbounded source as SDF wrapper to resume
[pabloem] Fixing type names for BQ Avro Tools
[github] Merge pull request #11389 from Refactor the BCJ and capture controls to
[github] [BEAM-i9751] upgrade zetasql to 2020.04.1 (#11410)
[xhan] Documentation bug fix for FlatMapElements#via() SimpleFunction in the
[github] [BEAM-9650] Add PeriodicImpulse Transform and slowly changing side
input
[github] [BEAM-7923] Screendiff Integration Tests (#11338)
[lcwik] fixup! Fix spotbugs warning
[kcweaver] [BEAM-9756] Nexmark: only use --region in Dataflow.
[github] [BEAM-9642] Add SDF execution units. (#11327)
[lcwik] [BEAM-9577] Fix test to create urls from paths which are compatible with
[github] [BEAM-9136] reduce third_party_dependencies size (#11416)
[thw] Fix py37-lint
[thw] Maven compatible publish repository authentication via settings.xml
[github] [BEAM-9746] check for 0 length copies from state (#11413)
[pabloem] Removing underscore from _ReadFromBigQuery to make it external. It
[daniel.o.programmer] [BEAM-9642] Fix infinite recursion.
[kamil.wasilewski] Remove outdated doc for ReadFromBigQuery transform
[ehudm] [BEAM-9119] Disable flaky test
[github] [BEAM-8889] add gRPC suport in GCS connector (behind an
[amaliujia] fixup! update 2.20.0 date
[github] [BEAM-9729, BEAM-8486] Runner-side bundle registration cleanup.
(#11358)
[kcweaver] [BEAM-9765] Exclude module-info.class from vendored Calcite.
[robertwb] [BEAM-9577] Small fixes to portable runner staging.
[robertwb] [BEAM-9768] Gradle command for Python ULR.
[github] Add new release 2.20.0 to beam website (#11285)
[jkw] Fix typo
[pabloem] [BEAM-9769] Ensuring JSON is the default export format for BQ sink
[github] Merge pull request #11151 from [BEAM-9468] Hl7v2 io
[echauchot] Add GBK load tests script for spark structured streaming runner
[echauchot] Add CoGBK load tests script for spark structured streaming runner
[echauchot] Add Combine load tests script for spark structured streaming runner
[echauchot] Add Pardo load tests script for spark structured streaming runner
[github] [BEAM-9678] Create Go SDK introduction kata (#11340)
[github] Merge pull request #11436: Document Beam Schemas (forked PR)
[github] [BEAM-9648]: DirectRunner should return null on timeout (#11275)
[ehudm] [BEAM-9737] Don't use docker create option -u
[github] [BEAM-5379] Ignore go.sum files in RAT checks
[github] [BEAM-5605, BEAM-2939] Add support for FnApiDoFnRunner to handle split
[github] [BEAM-9674] Don't specify selected fields when fetching BigQuery table
[github] [BEAM-9650] Cleanup documentation on side inputs patterns (#11415)
[github] [BEAM-8646] Fix external environment on OS X as well. (#11431)
[github] [BEAM-9743] Fix TFRecordCodec to try harder to read/write (#11397)
[github] Updates and clarifications on type safety. (#11449)
[github] [BEAM-3836] Enable dynamic splitting/checkpointing within the Java SDK
[github] [BEAM-8872] Support split at fraction for OffsetRangeTracker (#11418)
------------------------------------------
[...truncated 33.89 KB...]
https://lucene.apache.org
- org.apache.solr:solr-test-framework [5.5.4 -> 8.5.1]
https://lucene.apache.org
- org.apache.zookeeper:zookeeper [3.4.11 -> 3.6.0]
http://zookeeper.apache.org
- org.assertj:assertj-core [3.11.1 -> 3.15.0]
http://assertj.org
- org.bouncycastle:bcpkix-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.bouncycastle:bcprov-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.3]
https://groovy-lang.org
- org.codehaus.janino:commons-compiler [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.janino:janino [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.woodstox:stax2-api [3.1.4 -> 4.2]
http://github.com/FasterXML/stax2-api
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.4.0]
https://conscrypt.org/
- org.conscrypt:conscrypt-openjdk-uber [1.3.0 -> 2.4.0]
https://conscrypt.org/
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 10.0.0.alpha2]
http://www.eclipse.org/jetty
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 10.0.0.alpha2]
http://www.eclipse.org/jetty
- org.eclipse.jetty.alpn:alpn-api [1.1.2.v20150522 -> 1.1.3.v20160715]
http://www.eclipse.org/jetty
- org.eclipse.jetty.npn:npn-api [1.1.1.v20141010 -> 8.1.2.v20120308]
${jetty.url}
- org.elasticmq:elasticmq-rest-sqs_2.12 [0.14.1 -> 0.15.6]
http://softwaremill.com/open-source
- org.elasticsearch:elasticsearch [2.4.1 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch-hadoop [5.0.0 -> 7.6.2]
http://github.com/elastic/elasticsearch-hadoop
- org.elasticsearch.client:elasticsearch-rest-client [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:transport [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.0.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [5.6.3 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [6.4.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [7.5.0 -> 7.6.2]
https://github.com/elastic/elasticsearch
- org.freemarker:freemarker [2.3.28 -> 2.3.30]
https://freemarker.apache.org/
- org.fusesource.mqtt-client:mqtt-client [1.15 -> 1.16]
http://${forge-project-id}.fusesource.org/
- org.hamcrest:hamcrest-core [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.hamcrest:hamcrest-library [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.jboss.marshalling:jboss-marshalling [1.4.11.Final -> 2.0.9.Final]
http://www.jboss.org
- org.jboss.modules:jboss-modules [1.1.0.Beta1 -> 1.10.1.Final]
http://www.jboss.org
- org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin:kotlin-stdlib-jdk8 [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin [1.3.21 ->
1.3.72]
- org.mockito:mockito-core [3.0.0 -> 3.3.3]
https://github.com/mockito/mockito
- org.mongodb:mongo-java-driver [3.9.1 -> 3.12.3]
http://www.mongodb.org
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin [0.4.0 ->
0.6.0]
- org.postgresql:postgresql [42.2.2 -> 42.2.12]
https://github.com/pgjdbc/pgjdbc
- org.powermock:powermock-api-mockito2 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.powermock:powermock-module-junit4 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.scala-lang:scala-library [2.11.8 -> 2.13.1]
https://www.scala-lang.org/
- org.scala-lang:scala-library [2.12.7 -> 2.13.1]
https://www.scala-lang.org/
- org.slf4j:jcl-over-slf4j [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.21 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-jdk14 [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-simple [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 2.8]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.2.5.RELEASE]
https://github.com/spring-projects/spring-framework
- org.testcontainers:clickhouse [1.10.5 -> 1.14.0]
https://testcontainers.org
- org.testcontainers:localstack [1.11.2 -> 1.14.0]
https://testcontainers.org
- org.testcontainers:testcontainers [1.11.3 -> 1.14.0]
https://testcontainers.org
- org.xerial.snappy:snappy-java [1.1.4 -> 1.1.7.3]
https://github.com/xerial/snappy-java
- redis.clients:jedis [3.0.1 -> 3.2.0]
https://github.com/xetorthio/jedis
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.2.4]
https://github.com/ClickHouse/clickhouse-jdbc
- software.amazon.awssdk:apache-client [2.10.61 -> 2.11.14]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:auth [2.10.61 -> 2.11.14]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:cloudwatch [2.10.61 -> 2.11.14]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:dynamodb [2.10.61 -> 2.11.14]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sdk-core [2.10.61 -> 2.11.14]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sns [2.10.61 -> 2.11.14]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sqs [2.10.61 -> 2.11.14]
https://aws.amazon.com/sdkforjava
- sqlline:sqlline [1.4.0 -> 1.9.0]
https://github.com/julianhyde/sqlline
Gradle updates:
- Gradle: [5.2.1 -> 6.3 -> 6.4-rc-1]
Generated report file build/dependencyUpdates/report.txt
> Task :sdks:python:dependencyUpdates
# Assume that python virtual env is already active
pip install -e .[docs,test,gcp,aws,interactive]
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020.
Please upgrade your Python as Python 2.7 is no longer maintained. A future
version of pip will drop support for Python 2.7. More details about Python 2
support in pip, can be found at
https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Obtaining
file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
Processing
/home/jenkins/.cache/pip/wheels/50/24/4d/4580ca4a299f1ad6fd63443e6e584cb21e9a07988e4aa8daac/crcmod-1.7-cp27-cp27mu-linux_x86_64.whl
Processing
/home/jenkins/.cache/pip/wheels/54/6e/1d/172ed90bc541c925faff97e03c7a110b8ce876ab13e10b0c77/dill-0.3.1.1-py2-none-any.whl
Collecting fastavro<0.22,>=0.21.4
Using cached fastavro-0.21.24-cp27-cp27mu-manylinux1_x86_64.whl (1.0 MB)
Requirement already satisfied: future<1.0.0,>=0.16.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (0.16.0)
Requirement already satisfied: grpcio<2,>=1.12.1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (1.28.1)
Processing
/home/jenkins/.cache/pip/wheels/3a/18/11/31dfb768f5d55108760cdd028ad7026173f7c0e847cb71fe4b/hdfs-2.5.8-py2-none-any.whl
Processing
/home/jenkins/.cache/pip/wheels/6d/41/4b/2b369d6e2b7eaebcdd423516d3fb659c7658c16a2be8fd04ec/httplib2-0.12.0-cp27-none-any.whl
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting numpy<2,>=1.14.3
Using cached numpy-1.16.6-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached pymongo-3.10.1-cp27-cp27mu-manylinux1_x86_64.whl (444 kB)
Processing
/home/jenkins/.cache/pip/wheels/48/f7/87/b932f09c6335dbcf45d916937105a372ab14f353a9ca431d7d/oauth2client-3.0.0-cp27-none-any.whl
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.11.3)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting pytz>=2018.3
Using cached pytz-2019.3-py2.py3-none-any.whl (509 kB)
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.2-py2-none-any.whl (9.0 kB)
Processing
/home/jenkins/.cache/pip/wheels/28/a0/fc/a3d4892b81eedc9e027323c08e9890bee1ec2d35edd1c1ac96/avro-1.9.2-py2-none-any.whl
Collecting funcsigs<2,>=1.0.2
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.3.0)
Processing
/home/jenkins/.cache/pip/wheels/81/91/41/3272543c0b9c61da9c525f24ee35bae6fe8f60d4858c66805d/PyVCF-0.6.8-cp27-none-any.whl
Collecting pyarrow<0.17.0,>=0.15.1
Using cached pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.22.0.dev0) (3.7.4.1)
Collecting boto3>=1.9
Using cached boto3-1.12.41-py2.py3-none-any.whl (128 kB)
Collecting Sphinx<2.0,>=1.5.2
Using cached Sphinx-1.8.5-py2.py3-none-any.whl (3.1 MB)
Collecting cachetools<4,>=3.1.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting google-apitools<0.5.29,>=0.5.28
Using cached google_apitools-0.5.28-py2-none-any.whl (134 kB)
Collecting google-cloud-datastore<1.8.0,>=1.7.1
Using cached google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting google-cloud-pubsub<1.1.0,>=0.39.0
Using cached google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery<=1.24.0,>=1.6.0
Using cached google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-bigtable<1.1.0,>=0.31.1
Using cached google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-spanner<1.14.0,>=1.13.0
Using cached google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<=0.13.0,>=0.12.0
Using cached google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<1.14.0,>=1.8.0
Using cached google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177
kB)
Collecting google-cloud-vision<0.43.0,>=0.38.0
Using cached google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB)
Collecting facets-overview<2,>=1.0.0
Using cached facets_overview-1.0.0-py2.py3-none-any.whl (24 kB)
Collecting ipython<8,>=5.8.0
Using cached ipython-5.9.0-py2-none-any.whl (760 kB)
ERROR: Could not find a version that satisfies the requirement
ipykernel<6,>=5.2.0 (from apache-beam==2.22.0.dev0) (from versions: 4.0.1,
4.0.2, 4.0.3, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0, 4.3.1, 4.4.0, 4.4.1,
4.5.0, 4.5.1, 4.5.2, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.10.0,
4.10.1)
ERROR: No matching distribution found for ipykernel<6,>=5.2.0 (from
apache-beam==2.22.0.dev0)
> Task :sdks:python:dependencyUpdates FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'>
line: 95
* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 14s
3 actionable tasks: 3 executed
Publishing build scan...
https://gradle.com/s/xmmm75plws6pc
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
