See
<https://builds.apache.org/job/beam_Dependency_Check/270/display/redirect?page=changes>
Changes:
[kcweaver] [BEAM-10024] Mark testOutputTimestampDefault with
[github] Old Fastjson has a serious security problem
[github] Update fastavro_it_test.py
[github] Update wordcount_debugging.py
[github] Update wordcount_minimal.py
[aramaswamis] Add documentation for python apache-beam[aws] installation
[apilloud] [BEAM-8693] Remove workaround for bigquery client
[nfisher] [BEAM-10017] Expose Cassandra Connect/Read timeouts
[github] fix spacing
[github] add example region
[piotr.szuberski] [BEAM-7774] Move duplicated code from py2 and py37 suites to
[kcweaver] [BEAM-10154] Remove stray version number.
[github] lint
[github] Update programming-guide.md
[github] [BEAM-10162, BEAM-10163] Change PubSubIO and BigQueryIO job names;
[github] [BEAM-10051] Scope instruction data. (#11864)
[github] [BEAM-9679] Add Combine/Simple Function to Core Transforms (#11866)
[github] Updates CHANGES.md to include new I/Os for Beam 2.22.0. (#11879)
[kcweaver] [BEAM-10167] Fix 2.21.0 downloads link in blog post
[zyichi] [BEAM-10112] Add state and timer python examples to website
[kcweaver] Create bounded/unbounded variants of testOutputTimestampDefault.
[github] [BEAM-10158] Use a shared unbounded thread pool within Beam Python.
[github] [BEAM-9825] | Implement Intersect,Union,Except transforms (#11610)
[heejong] [BEAM-9869] adding self-contained Kafka service jar for testing
[github] [BEAM-9723] Add DLP integration transforms (#11566)
[piotr.szuberski] [BEAM-10171] Add Kinesis, Spanner, Jdbc IOs to the
portability roadmap
[iemejia] [BEAM-10173] Upgrade zstd-jni to version 1.4.5-2
[david.moravek] [BEAM-8850,BEAM-8849] FlinkBatchTranslationContext respects
input
[david.moravek] [BEAM-8848] Flink Batch Runner: optimize GBK translation for
non-merging
[david.moravek] [BEAM-8848] Code review.
[piotr.szuberski] [BEAM-7774] Remove Perfkit Benchmarking tool from python
wordcount
[klk] Update Jira priorities to the new Beam custom priority scheme
[david.moravek] [BEAM-10164] Flink Batch Runner: Memory efficient combine
implementation
[piotr.szuberski] [BEAM-7774] Add python wordcount performance test grafana
dashboard
[bhulette] Remove release note cleanup task
[github] [BEAM-4766] Migrate to use vendored protobuf for bytestring (#11891)
[github] [BEAM-10027] Support for Kotlin-based Beam Katas (#11761)
[github] [BEAM-10179] Clean-up URNJavaDoFn workaround in Go SDK. (#11899)
[github] [BEAM-10063] Create a WontImplementError for skipping features.
(#11785)
[github] Remove conditional grpc imports. (#11878)
[kcweaver] [BEAM-10168] Add Github 'publish release' to release guide
[kcweaver] [BEAM-10132] Update Docker images in Flink runner page.
[github] Add a GCThrashingPerPeriod option for MemoryMonitor (#11885)
[github] [BEAM-9946] | added new api in Partition Transform (#11682)
[aizhamal.nk] New directory for Beam mascot assets
[github] [BEAM-5863] Jenkins job to deploy Beam Metrics infrastructure
[github] Fix an issue with kubectl not being configured properly (#11906)
[mxm] [BEAM-10054] Add test which demonstrates a pipeline stall
[mxm] [BEAM-10054] Fix watermark hold for on_time_pane to prevent pipeline
[aromanenko.dev] [BEAM-10096] Fix Spark runners numbering
[mxm] linting
[iemejia] [BEAM-9948] Fix mascot invalid directory link
[github] [BEAM-9646] Add Google Cloud vision integration transform (#11331)
[robertwb] [BEAM-10116] Allow unknown non-merging windowing strategies in ULR.
[robertwb] Never trigger for Python.
[github] Always use python3 for license script virtualenv (#11900)
[github] fix hub existence test (#11903)
[github] Merge pull request #11896 from [BEAM-8841] Make
bigquery_avro_tools_test
[kcweaver] [BEAM-10187] Push release candidate tag to Github.
[github] [BEAM-10166] Context improvements for exec errors. (#11881)
[github] [Beam 9879] support STRING_AGG function in Beam ZetaSQL (#11895)
[robertwb] Add a hack to ensure the Never() trigger fires on window closing in
[robertwb] [BEAM-10118] Unconditionally use safe coders for data channels in
FnAPI
[github] clean up some non-shadow stragglers (#11917)
[echauchot] [BEAM-10017] Minor fixes of javadoc and error messages
[lastomato] Minor formatting updates.
[github] Merge pull request #11898 from [BEAM-10178] Improved error messages
when
[github] [BEAM-10063] Better emulate the pandas testing environment. (#11787)
[kcweaver] [BEAM-10194] Call println() in Katas test failures.
[github] [BEAM-10190] Reduce cost of toString of MetricKey and MetricName
[github] Merge pull request #11893 from [BEAM-10175] use bearer token header
[github] [BEAM-10188] Add instructions to programmatically publish release to
[robertwb] Use trivial Flatten rather than identity DoFn for transcoding.
[robertwb] Fix GetState API to handle timestamps field.
[robertwb] Typing fix.
[kamil.wasilewski] [BEAM-10145] Delete persistent disks after every KafkaIO
performance
[github] [BEAM-9679] Add CombineFn to Core Transforms (#11883)
[github] [BEAM-10036] More flexible dataframes partitioning. (#11766)
[github] [BEAM-9615] Additional coder unit tests (#11926)
[amaliujia] [BEAM-10205] @Ignore:BYTES can work with UNION ALL.
[github] [BEAM-9615] Add string coder utility functions. (#11925)
[github] [BEAM-9615] finish standardizing proto import name (#11927)
[github] remove LP indicator (#11937)
[github] [BEAM-2939] Fix FnApiDoFnRunner to ensure that we output within the
[github] [BEAM-10204] @Ignore: re-enable LIKE operator related unit tests.
[iemejia] [BEAM-10066] Add support for ValueProviders in
------------------------------------------
[...truncated 35.71 KB...]
http://zookeeper.apache.org
- org.apache.zookeeper:zookeeper [3.5.6 -> 3.6.1]
http://zookeeper.apache.org
- org.assertj:assertj-core [3.11.1 -> 3.16.1]
http://assertj.org
- org.bouncycastle:bcpkix-jdk15on [1.54 -> 1.65]
http://www.bouncycastle.org/java.html
- org.bouncycastle:bcprov-jdk15on [1.54 -> 1.65.01]
http://www.bouncycastle.org/java.html
- org.codehaus.groovy:groovy-all [2.4.13 -> 3.0.4]
https://groovy-lang.org
- org.codehaus.janino:commons-compiler [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.janino:janino [3.0.11 -> 3.1.2]
http://janino-compiler.github.io/janino/
- org.codehaus.woodstox:stax2-api [3.1.4 -> 4.2.1]
http://github.com/FasterXML/stax2-api
- org.conscrypt:conscrypt-openjdk [1.1.3 -> 2.4.0]
https://conscrypt.org/
- org.conscrypt:conscrypt-openjdk-uber [1.3.0 -> 2.4.0]
https://conscrypt.org/
- org.eclipse.jetty:jetty-server [9.2.10.v20150310 -> 11.0.0-alpha0]
http://www.eclipse.org/jetty
- org.eclipse.jetty:jetty-servlet [9.2.10.v20150310 -> 11.0.0-alpha0]
http://www.eclipse.org/jetty
- org.eclipse.jetty.alpn:alpn-api [1.1.2.v20150522 -> 1.1.3.v20160715]
http://www.eclipse.org/jetty
- org.eclipse.jetty.npn:npn-api [1.1.1.v20141010 -> 8.1.2.v20120308]
${jetty.url}
- org.elasticmq:elasticmq-rest-sqs_2.12 [0.14.1 -> 0.15.6]
http://softwaremill.com/open-source
- org.elasticsearch:elasticsearch [2.4.1 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.0.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [5.6.3 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [6.4.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch [7.5.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch:elasticsearch-hadoop [5.0.0 -> 7.7.1]
http://github.com/elastic/elasticsearch-hadoop
- org.elasticsearch.client:elasticsearch-rest-client [5.6.3 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [6.4.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:elasticsearch-rest-client [7.5.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.client:transport [5.0.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.0.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [5.6.3 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [6.4.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.plugin:transport-netty4-client [7.5.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [5.6.3 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [6.4.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.elasticsearch.test:framework [7.5.0 -> 7.7.1]
https://github.com/elastic/elasticsearch
- org.freemarker:freemarker [2.3.28 -> 2.3.30]
https://freemarker.apache.org/
- org.fusesource.mqtt-client:mqtt-client [1.15 -> 1.16]
http://${forge-project-id}.fusesource.org/
- org.hamcrest:hamcrest-core [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.hamcrest:hamcrest-library [2.1 -> 2.2]
http://hamcrest.org/JavaHamcrest/
- org.jboss.marshalling:jboss-marshalling [1.4.11.Final -> 2.0.9.Final]
http://www.jboss.org
- org.jboss.modules:jboss-modules [1.1.0.Beta1 -> 1.10.1.Final]
http://www.jboss.org
- org.jetbrains.kotlin:kotlin-scripting-compiler-embeddable [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin:kotlin-stdlib-jdk8 [1.3.21 -> 1.3.72]
https://kotlinlang.org/
- org.jetbrains.kotlin.jvm:org.jetbrains.kotlin.jvm.gradle.plugin [1.3.21 ->
1.3.72]
- org.mockito:mockito-core [3.0.0 -> 3.3.3]
https://github.com/mockito/mockito
- org.mongodb:mongo-java-driver [3.9.1 -> 3.12.5]
http://www.mongodb.org
- org.nosphere.apache.rat:org.nosphere.apache.rat.gradle.plugin [0.4.0 ->
0.7.0]
- org.postgresql:postgresql [42.2.2 -> 42.2.13]
https://jdbc.postgresql.org
- org.powermock:powermock-api-mockito2 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.powermock:powermock-module-junit4 [2.0.2 -> 2.0.7]
http://www.powermock.org
- org.scala-lang:scala-library [2.11.8 -> 2.13.2]
https://www.scala-lang.org/
- org.scala-lang:scala-library [2.12.7 -> 2.13.2]
https://www.scala-lang.org/
- org.slf4j:jcl-over-slf4j [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.21 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-api [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-jdk14 [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-log4j12 [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.slf4j:slf4j-simple [1.7.25 -> 2.0.0-alpha1]
http://www.slf4j.org
- org.sonarqube:org.sonarqube.gradle.plugin [2.7 -> 3.0]
- org.springframework:spring-expression [4.3.18.RELEASE -> 5.2.6.RELEASE]
https://github.com/spring-projects/spring-framework
- org.testcontainers:clickhouse [1.10.5 -> 1.14.3]
https://testcontainers.org
- org.testcontainers:localstack [1.11.2 -> 1.14.3]
https://testcontainers.org
- org.testcontainers:testcontainers [1.11.3 -> 1.14.3]
https://testcontainers.org
- org.xerial.snappy:snappy-java [1.1.4 -> 1.1.7.5]
https://github.com/xerial/snappy-java
- redis.clients:jedis [3.0.1 -> 3.3.0]
https://github.com/xetorthio/jedis
- ru.yandex.clickhouse:clickhouse-jdbc [0.1.47 -> 0.2.4]
https://github.com/ClickHouse/clickhouse-jdbc
- software.amazon.awssdk:apache-client [2.10.61 -> 2.13.31]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:auth [2.10.61 -> 2.13.31]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:cloudwatch [2.10.61 -> 2.13.31]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:dynamodb [2.10.61 -> 2.13.31]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sdk-core [2.10.61 -> 2.13.31]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sns [2.10.61 -> 2.13.31]
https://aws.amazon.com/sdkforjava
- software.amazon.awssdk:sqs [2.10.61 -> 2.13.31]
https://aws.amazon.com/sdkforjava
- sqlline:sqlline [1.4.0 -> 1.9.0]
https://github.com/julianhyde/sqlline
Gradle updates:
- Gradle: [5.2.1 -> 6.5]
Generated report file build/dependencyUpdates/report.txt
> Task :sdks:python:dependencyUpdates
# Assume that python virtual env is already active
pip install -e .[docs,test,gcp,aws,interactive]
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020.
Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will
drop support for Python 2.7 in January 2021. More details about Python 2
support in pip, can be found at
https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Obtaining
file://<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python>
Processing
/home/jenkins/.cache/pip/wheels/50/24/4d/4580ca4a299f1ad6fd63443e6e584cb21e9a07988e4aa8daac/crcmod-1.7-cp27-cp27mu-linux_x86_64.whl
Processing
/home/jenkins/.cache/pip/wheels/54/6e/1d/172ed90bc541c925faff97e03c7a110b8ce876ab13e10b0c77/dill-0.3.1.1-py2-none-any.whl
Collecting fastavro<0.24,>=0.21.4
Using cached fastavro-0.23.4-cp27-cp27mu-manylinux2010_x86_64.whl (1.1 MB)
Requirement already satisfied: future<1.0.0,>=0.18.2 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (0.18.2)
Requirement already satisfied: grpcio<2,>=1.12.1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (1.29.0)
Processing
/home/jenkins/.cache/pip/wheels/3a/18/11/31dfb768f5d55108760cdd028ad7026173f7c0e847cb71fe4b/hdfs-2.5.8-py2-none-any.whl
Processing
/home/jenkins/.cache/pip/wheels/ce/98/d0/7cbebe9de22c986e85e2561069d25c9752b43523240f803199/httplib2-0.17.4-py2-none-any.whl
Collecting mock<3.0.0,>=1.0.1
Using cached mock-2.0.0-py2.py3-none-any.whl (56 kB)
Collecting numpy<2,>=1.14.3
Using cached numpy-1.16.6-cp27-cp27mu-manylinux1_x86_64.whl (17.0 MB)
Collecting pymongo<4.0.0,>=3.8.0
Using cached pymongo-3.10.1-cp27-cp27mu-manylinux1_x86_64.whl (444 kB)
Processing
/home/jenkins/.cache/pip/wheels/48/f7/87/b932f09c6335dbcf45d916937105a372ab14f353a9ca431d7d/oauth2client-3.0.0-cp27-none-any.whl
Requirement already satisfied: protobuf<4,>=3.5.0.post1 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (3.12.2)
Collecting pydot<2,>=1.2.0
Using cached pydot-1.4.1-py2.py3-none-any.whl (19 kB)
Collecting python-dateutil<3,>=2.8.0
Using cached python_dateutil-2.8.1-py2.py3-none-any.whl (227 kB)
Collecting pytz>=2018.3
Using cached pytz-2020.1-py2.py3-none-any.whl (510 kB)
Collecting typing-extensions<3.8.0,>=3.7.0
Using cached typing_extensions-3.7.4.2-py2-none-any.whl (9.0 kB)
Processing
/home/jenkins/.cache/pip/wheels/28/a0/fc/a3d4892b81eedc9e027323c08e9890bee1ec2d35edd1c1ac96/avro-1.9.2-py2-none-any.whl
Collecting funcsigs<2,>=1.0.2
Using cached funcsigs-1.0.2-py2.py3-none-any.whl (17 kB)
Requirement already satisfied: futures<4.0.0,>=3.2.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (3.3.0)
Processing
/home/jenkins/.cache/pip/wheels/81/91/41/3272543c0b9c61da9c525f24ee35bae6fe8f60d4858c66805d/PyVCF-0.6.8-cp27-none-any.whl
Collecting pyarrow<0.18.0,>=0.15.1
Using cached pyarrow-0.16.0-cp27-cp27mu-manylinux2010_x86_64.whl (20.5 MB)
Requirement already satisfied: typing<3.8.0,>=3.7.0 in
<https://builds.apache.org/job/beam_Dependency_Check/ws/src/build/gradleenv/1922375555/lib/python2.7/site-packages>
(from apache-beam==2.23.0.dev0) (3.7.4.1)
Collecting boto3>=1.9
Using cached boto3-1.13.24-py2.py3-none-any.whl (128 kB)
Collecting Sphinx<2.0,>=1.5.2
Using cached Sphinx-1.8.5-py2.py3-none-any.whl (3.1 MB)
Collecting cachetools<4,>=3.1.0
Using cached cachetools-3.1.1-py2.py3-none-any.whl (11 kB)
Collecting google-apitools<0.5.32,>=0.5.31
Using cached google_apitools-0.5.31-py2-none-any.whl (135 kB)
Collecting google-cloud-datastore<1.8.0,>=1.7.1
Using cached google_cloud_datastore-1.7.4-py2.py3-none-any.whl (82 kB)
Collecting google-cloud-pubsub<1.1.0,>=0.39.0
Using cached google_cloud_pubsub-1.0.2-py2.py3-none-any.whl (118 kB)
Collecting google-cloud-bigquery<=1.24.0,>=1.6.0
Using cached google_cloud_bigquery-1.24.0-py2.py3-none-any.whl (165 kB)
Collecting google-cloud-core<2,>=0.28.1
Using cached google_cloud_core-1.3.0-py2.py3-none-any.whl (26 kB)
Collecting google-cloud-bigtable<1.1.0,>=0.31.1
Using cached google_cloud_bigtable-1.0.0-py2.py3-none-any.whl (232 kB)
Collecting google-cloud-spanner<1.14.0,>=1.13.0
Using cached google_cloud_spanner-1.13.0-py2.py3-none-any.whl (212 kB)
Collecting grpcio-gcp<1,>=0.2.2
Using cached grpcio_gcp-0.2.2-py2.py3-none-any.whl (9.4 kB)
Collecting google-cloud-dlp<=0.13.0,>=0.12.0
Using cached google_cloud_dlp-0.13.0-py2.py3-none-any.whl (151 kB)
Collecting google-cloud-language<2,>=1.3.0
Using cached google_cloud_language-1.3.0-py2.py3-none-any.whl (83 kB)
Collecting google-cloud-videointelligence<1.14.0,>=1.8.0
Using cached google_cloud_videointelligence-1.13.0-py2.py3-none-any.whl (177
kB)
Collecting google-cloud-vision<0.43.0,>=0.38.0
Using cached google_cloud_vision-0.42.0-py2.py3-none-any.whl (435 kB)
Collecting facets-overview<2,>=1.0.0
Using cached facets_overview-1.0.0-py2.py3-none-any.whl (24 kB)
Collecting ipython<8,>=5.8.0
Using cached ipython-5.10.0-py2-none-any.whl (760 kB)
ERROR: Could not find a version that satisfies the requirement
ipykernel<6,>=5.2.0 (from apache-beam==2.23.0.dev0) (from versions: 4.0.1,
4.0.2, 4.0.3, 4.1.0, 4.1.1, 4.2.0, 4.2.1, 4.2.2, 4.3.0, 4.3.1, 4.4.0, 4.4.1,
4.5.0, 4.5.1, 4.5.2, 4.6.0, 4.6.1, 4.7.0, 4.8.0, 4.8.1, 4.8.2, 4.9.0, 4.10.0,
4.10.1)
ERROR: No matching distribution found for ipykernel<6,>=5.2.0 (from
apache-beam==2.23.0.dev0)
> Task :sdks:python:dependencyUpdates FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_Dependency_Check/ws/src/sdks/python/build.gradle'>
line: 95
* What went wrong:
Execution failed for task ':sdks:python:dependencyUpdates'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 33s
3 actionable tasks: 3 executed
Publishing build scan...
https://gradle.com/s/737e2rh4fyy6g
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
