See
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/2/display/redirect?page=changes>
Changes:
[joar] [BEAM-5417] Parity between GCS and local match
[joar] Give test a more descriptive name
[joar] [BEAM-5417] ** matches anything, * matches [^/\]*
[joar] Make isort happy
[joar] Remove invalid sphinx references
[joar] Tidy up logging
[joar] Add test cases for {only,no}-root-level
[joar] Use str.join
[joar] Update FileSystems.match docstring
[joar] Remove reference to excluded method
[migryz] Add beamsyncjenkins container to docker-compose config
[joar] Parameterize test_match_glob
[huangry] Expose flag min_cpu_platform in PipelineOption.
[boyuanz] Fix bugs found in 2.8.0 release
[valentyn] Move SDK dependencies from Dockerfile to base_image_requirements.txt
[valentyn] Sort the dependencies alphabetically.
[valentyn] Update the versions of SDK dependencies to be installed into the
[valentyn] Add a Python container based on Python 3 interpreter.
[huangry] Update doc and log more info.
[pablo] Revert "Merge pull request #6411 from huygaa11/revert-6311-twsit"
[boyuanz] Address Charles's comments
[github] Avoid KeyError on Python 3 when BEAM_EXPERIMENTAL_PY3 is not defined.
[joar] Include CPython's license for translate_pattern
[pablo] Fixing odd Options bug
[migryz] Update README.md with instructions to spinup service locally.
[scott] [BEAM-5611] Fix failure in testWebsite due to 508 resource limit error
[sekikn] [BEAM-5619] Fix minor bug in JdbcIO example code
[ankurgoenka] Remove default worker id in python
[thw] [BEAM-5625] Add missing CancelJobRequest parameter.
[joar] isort: Reorder imports
[ankurgoenka] Store and server termination state after portable job termination
[ankurgoenka] Correctly deserialize pipeline options on Fn harness
[aaltay] [BEAM-5322] Partially port typehints (#6541)
[apilloud] [BEAM-5112] Don't use BeamSqlInputRefExpression to pass Integer
[scott] [BEAM-5427] Fix and update sample code for CombineFn. (#6439)
[valentyn] Update dependency versions and switch gradle build to use /target
[amyrvold] [BEAM-4495] Create precommit to stage website on GCS
[github] Use standard format for python dependencies (#6560)
[yifanzou] [BEAM-5643] fix broken python it test
[robertwb] [BEAM-4660] Add well known timer coder for Python SDK.
[robertwb] [BEAM-2687] Implement timers in Python SDK harness.
[stijn.decubber] Partially port testing
[github] [BEAM-5651] Add --update-snapshots flag to archetype tests
[scott] Add .htaccess file to redirect javadoc/pydoc URLs to the new location
[scott] Update existing links to point to new javadoc/pydoc location
[scott] Remove outdated IDE pages and point to wiki instead
[github] Fix redirect for current release docs
[github] [BEAM-5529] Before starting the final countdown, check that job is not
------------------------------------------
[...truncated 7.26 KB...]
Skipping task ':buildSrc:classes' as it has no actions.
:buildSrc:classes (Thread[Task worker for ':buildSrc',5,main]) completed. Took
0.0 secs.
:buildSrc:jar (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:jar
Build cache key for task ':buildSrc:jar' is 60c54a62be893247a90eb1dbbfdbb239
Caching disabled for task ':buildSrc:jar': Caching has not been enabled for the
task
Task ':buildSrc:jar' is not up-to-date because:
No history is available.
:buildSrc:jar (Thread[Task worker for ':buildSrc',5,main]) completed. Took 0.11
secs.
:buildSrc:assemble (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:assemble
Skipping task ':buildSrc:assemble' as it has no actions.
:buildSrc:assemble (Thread[Task worker for ':buildSrc',5,main]) completed. Took
0.0 secs.
:buildSrc:spotlessGroovy (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovy
file or directory
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/buildSrc/src/test/groovy',>
not found
file or directory
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/buildSrc/src/test/groovy',>
not found
file or directory
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/buildSrc/src/test/groovy',>
not found
Caching disabled for task ':buildSrc:spotlessGroovy': Caching has not been
enabled for the task
Task ':buildSrc:spotlessGroovy' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task
':buildSrc:spotlessGroovy'.
file or directory
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/buildSrc/src/test/groovy',>
not found
:buildSrc:spotlessGroovy (Thread[Task worker for ':buildSrc',5,main])
completed. Took 1.19 secs.
:buildSrc:spotlessGroovyCheck (Thread[Task worker for ':buildSrc',5,main])
started.
> Task :buildSrc:spotlessGroovyCheck
Skipping task ':buildSrc:spotlessGroovyCheck' as it has no actions.
:buildSrc:spotlessGroovyCheck (Thread[Task worker for ':buildSrc',5,main])
completed. Took 0.001 secs.
:buildSrc:spotlessGroovyGradle (Thread[Task worker for ':buildSrc',5,main])
started.
> Task :buildSrc:spotlessGroovyGradle
Caching disabled for task ':buildSrc:spotlessGroovyGradle': Caching has not
been enabled for the task
Task ':buildSrc:spotlessGroovyGradle' is not up-to-date because:
No history is available.
All input files are considered out-of-date for incremental task
':buildSrc:spotlessGroovyGradle'.
:buildSrc:spotlessGroovyGradle (Thread[Task worker for ':buildSrc',5,main])
completed. Took 0.027 secs.
:buildSrc:spotlessGroovyGradleCheck (Thread[Task worker for
':buildSrc',5,main]) started.
> Task :buildSrc:spotlessGroovyGradleCheck
Skipping task ':buildSrc:spotlessGroovyGradleCheck' as it has no actions.
:buildSrc:spotlessGroovyGradleCheck (Thread[Task worker for
':buildSrc',5,main]) completed. Took 0.0 secs.
:buildSrc:spotlessCheck (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:spotlessCheck
Skipping task ':buildSrc:spotlessCheck' as it has no actions.
:buildSrc:spotlessCheck (Thread[Task worker for ':buildSrc',5,main]) completed.
Took 0.0 secs.
:buildSrc:compileTestJava (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:compileTestJava NO-SOURCE
file or directory
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/buildSrc/src/test/java',>
not found
Skipping task ':buildSrc:compileTestJava' as it has no source files and no
previous output files.
:buildSrc:compileTestJava (Thread[Task worker for ':buildSrc',5,main])
completed. Took 0.001 secs.
:buildSrc:compileTestGroovy (Thread[Task worker for ':buildSrc',5,main])
started.
> Task :buildSrc:compileTestGroovy NO-SOURCE
file or directory
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/buildSrc/src/test/groovy',>
not found
Skipping task ':buildSrc:compileTestGroovy' as it has no source files and no
previous output files.
:buildSrc:compileTestGroovy (Thread[Task worker for ':buildSrc',5,main])
completed. Took 0.001 secs.
:buildSrc:processTestResources (Thread[Task worker for ':buildSrc',5,main])
started.
> Task :buildSrc:processTestResources NO-SOURCE
file or directory
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/buildSrc/src/test/resources',>
not found
Skipping task ':buildSrc:processTestResources' as it has no source files and no
previous output files.
:buildSrc:processTestResources (Thread[Task worker for ':buildSrc',5,main])
completed. Took 0.002 secs.
:buildSrc:testClasses (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:testClasses UP-TO-DATE
Skipping task ':buildSrc:testClasses' as it has no actions.
:buildSrc:testClasses (Thread[Task worker for ':buildSrc',5,main]) completed.
Took 0.0 secs.
:buildSrc:test (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:test NO-SOURCE
Skipping task ':buildSrc:test' as it has no source files and no previous output
files.
:buildSrc:test (Thread[Task worker for ':buildSrc',5,main]) completed. Took
0.002 secs.
:buildSrc:check (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:check
Skipping task ':buildSrc:check' as it has no actions.
:buildSrc:check (Thread[Task worker for ':buildSrc',5,main]) completed. Took
0.0 secs.
:buildSrc:build (Thread[Task worker for ':buildSrc',5,main]) started.
> Task :buildSrc:build
Skipping task ':buildSrc:build' as it has no actions.
:buildSrc:build (Thread[Task worker for ':buildSrc',5,main]) completed. Took
0.0 secs.
Settings evaluated using settings file
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/settings.gradle'.>
Using local directory build cache for the root build (location =
/home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days).
Projects loaded. Root project using build file
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/build.gradle'.>
Included projects: [root project 'beam', project ':beam-examples-java', project
':beam-model-fn-execution', project ':beam-model-job-management', project
':beam-model-pipeline', project ':beam-runners-apex', project
':beam-runners-core-construction-java', project ':beam-runners-core-java',
project ':beam-runners-direct-java', project
':beam-runners-extensions-java-metrics', project ':beam-runners-flink_2.11',
project ':beam-runners-flink_2.11-job-server', project
':beam-runners-flink_2.11-job-server-container', project
':beam-runners-gearpump', project ':beam-runners-google-cloud-dataflow-java',
project ':beam-runners-google-cloud-dataflow-java-examples', project
':beam-runners-google-cloud-dataflow-java-examples-streaming', project
':beam-runners-java-fn-execution', project ':beam-runners-local-java-core',
project ':beam-runners-reference-java', project
':beam-runners-reference-job-server', project ':beam-runners-samza', project
':beam-runners-spark', project ':beam-sdks-go', project
':beam-sdks-go-container', project ':beam-sdks-go-examples', project
':beam-sdks-go-test', project ':beam-sdks-java-build-tools', project
':beam-sdks-java-container', project ':beam-sdks-java-core', project
':beam-sdks-java-extensions-google-cloud-platform-core', project
':beam-sdks-java-extensions-join-library', project
':beam-sdks-java-extensions-json-jackson', project
':beam-sdks-java-extensions-protobuf', project
':beam-sdks-java-extensions-sketching', project
':beam-sdks-java-extensions-sorter', project ':beam-sdks-java-extensions-sql',
project ':beam-sdks-java-extensions-sql-jdbc', project
':beam-sdks-java-extensions-sql-shell', project ':beam-sdks-java-fn-execution',
project ':beam-sdks-java-harness', project
':beam-sdks-java-io-amazon-web-services', project ':beam-sdks-java-io-amqp',
project ':beam-sdks-java-io-cassandra', project ':beam-sdks-java-io-common',
project ':beam-sdks-java-io-elasticsearch', project
':beam-sdks-java-io-elasticsearch-tests-2', project
':beam-sdks-java-io-elasticsearch-tests-5', project
':beam-sdks-java-io-elasticsearch-tests-6', project
':beam-sdks-java-io-elasticsearch-tests-common', project
':beam-sdks-java-io-file-based-io-tests', project
':beam-sdks-java-io-google-cloud-platform', project
':beam-sdks-java-io-hadoop-common', project
':beam-sdks-java-io-hadoop-file-system', project
':beam-sdks-java-io-hadoop-input-format', project ':beam-sdks-java-io-hbase',
project ':beam-sdks-java-io-hcatalog', project ':beam-sdks-java-io-jdbc',
project ':beam-sdks-java-io-jms', project ':beam-sdks-java-io-kafka', project
':beam-sdks-java-io-kinesis', project ':beam-sdks-java-io-kudu', project
':beam-sdks-java-io-mongodb', project ':beam-sdks-java-io-mqtt', project
':beam-sdks-java-io-parquet', project ':beam-sdks-java-io-redis', project
':beam-sdks-java-io-solr', project ':beam-sdks-java-io-synthetic', project
':beam-sdks-java-io-tika', project ':beam-sdks-java-io-xml', project
':beam-sdks-java-javadoc', project ':beam-sdks-java-maven-archetypes-examples',
project ':beam-sdks-java-maven-archetypes-starter', project
':beam-sdks-java-nexmark', project ':beam-sdks-python', project
':beam-sdks-python-container', project ':beam-sdks-python-container-py3',
project ':beam-vendor-sdks-java-extensions-protobuf', project ':beam-website',
project ':release']
Parallel execution with configuration on demand is an incubating feature.
> Configure project :
Evaluating root project 'beam' using build file
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/build.gradle'.>
> Configure project :beam-website
Evaluating project ':beam-website' using build file
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website/build.gradle'.>
Selected primary task ':beam-website:stageWebsite' from project :beam-website
All projects evaluated.
Tasks to be executed: [task ':beam-website:setupBuildDir', task
':beam-website:buildDockerImage', task ':beam-website:createDockerContainer',
task ':beam-website:startDockerContainer', task ':beam-website:buildWebsite',
task ':beam-website:stopAndRemoveDockerContainer', task
':beam-website:setupVirtualenv', task ':beam-website:stageWebsite']
VisTEG: Dependency graph written into
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/build/reports/visteg.dot>
:beam-website:setupBuildDir (Thread[Task worker for ':',5,main]) started.
> Task :beam-website:setupBuildDir
Build cache key for task ':beam-website:setupBuildDir' is
c5e21d016c48068107da8d6494775c33
Caching disabled for task ':beam-website:setupBuildDir': Caching has not been
enabled for the task
Task ':beam-website:setupBuildDir' is not up-to-date because:
No history is available.
:beam-website:setupBuildDir (Thread[Task worker for ':',5,main]) completed.
Took 0.021 secs.
:beam-website:buildDockerImage (Thread[Task worker for ':',5,main]) started.
> Task :beam-website:buildDockerImage
Caching disabled for task ':beam-website:buildDockerImage': Caching has not
been enabled for the task
Task ':beam-website:buildDockerImage' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory:
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website>
Command: docker build -t beam-website .
Successfully started process 'command 'docker''
Sending build context to Docker daemon 26.02MB
Step 1/7 : FROM ruby:2.5
---> eb8759981348
Step 2/7 : WORKDIR /ruby
---> Using cache
---> 1094fdf2d34a
Step 3/7 : RUN gem install bundler
---> Using cache
---> 27fb1694ab2f
Step 4/7 : ADD Gemfile Gemfile.lock /ruby/
---> Using cache
---> 9a944e30461d
Step 5/7 : RUN bundle install --deployment --path $GEM_HOME
---> Using cache
---> 22776211c925
Step 6/7 : ENV LC_ALL C.UTF-8
---> Using cache
---> b66fd558fb37
Step 7/7 : CMD sleep 3600
---> Using cache
---> 526343940df2
Successfully built 526343940df2
Successfully tagged beam-website:latest
:beam-website:buildDockerImage (Thread[Task worker for ':',5,main]) completed.
Took 0.297 secs.
:beam-website:createDockerContainer (Thread[Task worker for ':',5,main])
started.
> Task :beam-website:createDockerContainer
Caching disabled for task ':beam-website:createDockerContainer': Caching has
not been enabled for the task
Task ':beam-website:createDockerContainer' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command '/bin/bash''. Working directory:
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website>
Command: /bin/bash -c docker create -v
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src>:/repo
-u $(id -u):$(id -g) beam-website
Successfully started process 'command '/bin/bash''
:beam-website:createDockerContainer (Thread[Task worker for ':',5,main])
completed. Took 1.865 secs.
:beam-website:startDockerContainer (Thread[Task worker for ':',5,main]) started.
> Task :beam-website:startDockerContainer
Caching disabled for task ':beam-website:startDockerContainer': Caching has not
been enabled for the task
Task ':beam-website:startDockerContainer' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory:
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website>
Command: docker start
199e94f524dc917c9f9e38e1da76ec3444ec8893937c16764a30c1b4cec1273d
Successfully started process 'command 'docker''
199e94f524dc917c9f9e38e1da76ec3444ec8893937c16764a30c1b4cec1273d
:beam-website:startDockerContainer (Thread[Task worker for ':',5,main])
completed. Took 0.27 secs.
:beam-website:buildWebsite (Thread[Task worker for ':',5,main]) started.
> Task :beam-website:buildWebsite
Build cache key for task ':beam-website:buildWebsite' is
5570f02c363b833e8703d49cd9a5fb1b
Caching disabled for task ':beam-website:buildWebsite': Caching has not been
enabled for the task
Task ':beam-website:buildWebsite' is not up-to-date because:
No history is available.
Starting process 'command 'docker''. Working directory:
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website>
Command: docker exec
199e94f524dc917c9f9e38e1da76ec3444ec8893937c16764a30c1b4cec1273d /bin/bash -c
cd /repo/build/website && bundle exec jekyll build --config
/repo/website/_config.yml --incremental --baseurl=/${ghprbPullId}
--source /repo/website/src
Successfully started process 'command 'docker''
`/` is not writable.
Bundler will use `/tmp/bundler/home/unknown' as your home directory temporarily.
Configuration file: /repo/website/_config.yml
Source: /repo/website/src
Destination: generated-content
Incremental build: enabled
Generating...
done in 10.447 seconds.
Auto-regeneration: disabled. Use --watch to enable.
:beam-website:buildWebsite (Thread[Task worker for ':',5,main]) completed. Took
11.99 secs.
:beam-website:stopAndRemoveDockerContainer (Thread[Task worker for ':',5,main])
started.
> Task :beam-website:stopAndRemoveDockerContainer
Caching disabled for task ':beam-website:stopAndRemoveDockerContainer': Caching
has not been enabled for the task
Task ':beam-website:stopAndRemoveDockerContainer' is not up-to-date because:
Task has not declared any outputs despite executing actions.
Starting process 'command 'docker''. Working directory:
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website>
Command: docker rm -f
199e94f524dc917c9f9e38e1da76ec3444ec8893937c16764a30c1b4cec1273d
Successfully started process 'command 'docker''
199e94f524dc917c9f9e38e1da76ec3444ec8893937c16764a30c1b4cec1273d
:beam-website:stopAndRemoveDockerContainer (Thread[Task worker for ':',5,main])
completed. Took 0.515 secs.
:beam-website:setupVirtualenv (Thread[Task worker for ':',5,main]) started.
> Task :beam-website:setupVirtualenv
Build cache key for task ':beam-website:setupVirtualenv' is
0d23e9107f88706f313893fc8f88d6be
Caching disabled for task ':beam-website:setupVirtualenv': Caching has not been
enabled for the task
Task ':beam-website:setupVirtualenv' is not up-to-date because:
No history is available.
Starting process 'command 'virtualenv''. Working directory:
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website>
Command: virtualenv
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/build/website/gradleenv>
Successfully started process 'command 'virtualenv''
New python executable in
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/build/website/gradleenv/bin/python2>
Also creating executable in
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/build/website/gradleenv/bin/python>
Installing setuptools, pkg_resources, pip, wheel...done.
Running virtualenv with interpreter /usr/bin/python2
Starting process 'command 'sh''. Working directory:
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website>
Command: sh -c .
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/build/website/gradleenv/bin/activate>
&& pip install beautifulsoup4
Successfully started process 'command 'sh''
Collecting beautifulsoup4
Downloading
https://files.pythonhosted.org/packages/f8/c7/741c97d7366f4779ca73d244904978b43a81fd37d85fcf05ad19d472c1ce/beautifulsoup4-4.6.3-py2-none-any.whl
(90kB)
Installing collected packages: beautifulsoup4
Successfully installed beautifulsoup4-4.6.3
:beam-website:setupVirtualenv (Thread[Task worker for ':',5,main]) completed.
Took 4.068 secs.
:beam-website:stageWebsite (Thread[Task worker for ':',5,main]) started.
> Task :beam-website:stageWebsite FAILED
Caching disabled for task ':beam-website:stageWebsite': Caching has not been
enabled for the task
Task ':beam-website:stageWebsite' is not up-to-date because:
Task has not declared any outputs despite executing actions.
:beam-website:stageWebsite (Thread[Task worker for ':',5,main]) completed. Took
0.008 secs.
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/website/build.gradle'>
line: 212
* What went wrong:
Execution failed for task ':beam-website:stageWebsite'.
> assert githubPullRequestId.isInteger()
| |
${ghprbPullId} false
* Try:
Run with --stacktrace option to get the stack trace. Run with --debug option to
get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 5.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/4.10.2/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 26s
8 actionable tasks: 8 executed
Publishing build scan...
https://gradle.com/s/e4ayo4bfqw7nk
Closing Git repo:
<https://builds.apache.org/job/beam_PreCommit_Website_Stage_GCS_Cron/ws/src/.git>
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure