See
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/2525/display/redirect?page=changes>
Changes:
[github] Merge pull request #11725: [BEAM-10015] Fix output timestamp on
dataflow
------------------------------------------
[...truncated 200.56 KB...]
apache_beam.utils.subprocess_server: INFO: BeamCalcRel(expr#0=[{inputs}],
expr#1=[1], expr#2=['foo':VARCHAR], expr#3=[3.14:DOUBLE], int=[$t1], str=[$t2],
flt=[$t3])
apache_beam.utils.subprocess_server: INFO: BeamValuesRel(tuples=[[{ 0 }]])
apache_beam.utils.subprocess_server: INFO:
root: DEBUG: Sending SIGINT to job_server
root: WARNING: Make sure that locally built Python SDK docker image has Python
2.7 interpreter.
root: INFO: Using Python SDK docker image:
apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local,
we will try to pull from hub.docker.com
root: WARNING: Make sure that locally built Python SDK docker image has Python
2.7 interpreter.
root: INFO: Using Python SDK docker image:
apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local,
we will try to pull from hub.docker.com
apache_beam.runners.portability.fn_api_runner.translations: INFO:
==================== <function lift_combiners at 0x7f59b74425f0>
====================
apache_beam.runners.portability.fn_api_runner.translations: DEBUG: 16 [1, 1, 1,
1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
apache_beam.runners.portability.fn_api_runner.translations: DEBUG: Stages:
['external_3SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_15/Create.Values/Read(CreateSource)/Impulse\n
SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_15/Create.Values/Read(CreateSource)/Impulse:beam:transform:impulse:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'external_3SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_15/Create.Values/Read(CreateSource)/MapElements/Map/ParMultiDo(Anonymous)\n
SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_15/Create.Values/Read(CreateSource)/MapElements/Map/ParMultiDo(Anonymous):beam:transform:pardo:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'external_3SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_15/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper)\n
SqlTransform(beam:external:java:sql:v1)/BeamValuesRel_15/Create.Values/Read(CreateSource)/ParDo(BoundedSourceAsSDFWrapper)/ParMultiDo(BoundedSourceAsSDFWrapper):beam:transform:pardo:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'external_3SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_19/ParDo(Calc)/ParMultiDo(Calc)\n
SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_19/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Create/Impulse_5\n
assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at core.py:2713>)_6\n
assert_that/Create/FlatMap(<lambda at core.py:2713>):beam:transform:pardo:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Create/Map(decode)_8\n
assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_9\n
assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must
follow: \n downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/ToVoidKey_10\n
assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/pair_with_0_12\n
assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/pair_with_1_13\n
assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/Flatten_14\n
assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/GroupByKey_15\n
assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_19\n
assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Unkey_20\n
assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Match_21\n
assert_that/Match:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>']
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'job_name' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'runner'
was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'temp_location' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'dataflow_kms_key' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'enable_streaming_engine' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'project'
was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'worker_region' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'worker_zone' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'zone'
was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'streaming' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'environment_cache_millis' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'files_to_stage' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'job_endpoint' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'output_executable_path' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'sdk_worker_parallelism' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'experiments' was already added
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
STOPPED
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
STARTING
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
RUNNING
root: DEBUG: org.apache.spark.SparkException: Only one SparkContext may be
running in this JVM (see SPARK-2243). To ignore this error, set
spark.driver.allowMultipleContexts = true. The currently running SparkContext
was created at:
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:98)
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:64)
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:109)
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
at
org.apache.spark.SparkContext$$anonfun$assertNoOtherContextIsRunning$2.apply(SparkContext.scala:2483)
at
org.apache.spark.SparkContext$$anonfun$assertNoOtherContextIsRunning$2.apply(SparkContext.scala:2479)
at scala.Option.foreach(Option.scala:257)
at
org.apache.spark.SparkContext$.assertNoOtherContextIsRunning(SparkContext.scala:2479)
at
org.apache.spark.SparkContext$.markPartiallyConstructed(SparkContext.scala:2568)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:85)
at
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
at
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:98)
at
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:64)
at
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:109)
at
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
root: ERROR: org.apache.spark.SparkException: Only one SparkContext may be
running in this JVM (see SPARK-2243). To ignore this error, set
spark.driver.allowMultipleContexts = true. The currently running SparkContext
was created at:
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:98)
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:64)
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:109)
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
FAILED
--------------------- >> end captured logging << ---------------------
======================================================================
ERROR: test_project (apache_beam.transforms.sql_test.SqlTransformTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/transforms/sql_test.py";,>
line 84, in test_project
assert_that(out, equal_to([(1, 3.14)]))
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/pipeline.py";,>
line 546, in __exit__
self.run().wait_until_finish()
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/testing/test_pipeline.py";,>
line 114, in run
state = result.wait_until_finish()
File
"<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/runners/portability/portable_runner.py";,>
line 583, in wait_until_finish
raise self._runtime_exception
RuntimeError: Pipeline
BeamApp-jenkins-0516121620-7a4677e2_01234984-371c-4d33-ba5c-ddb4d215b44f failed
in state FAILED: org.apache.spark.SparkException: Only one SparkContext may be
running in this JVM (see SPARK-2243). To ignore this error, set
spark.driver.allowMultipleContexts = true. The currently running SparkContext
was created at:
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:98)
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:64)
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:109)
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
-------------------- >> begin captured logging << --------------------
apache_beam.utils.subprocess_server: INFO: Using pre-built snapshot at
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.22.0-SNAPSHOT.jar>
apache_beam.utils.subprocess_server: INFO: Starting service with ['java' '-jar'
'<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/sql/expansion-service/build/libs/beam-sdks-java-extensions-sql-expansion-service-2.22.0-SNAPSHOT.jar'>
'54039']
root: DEBUG: Waiting for grpc channel to be ready at localhost:54039.
apache_beam.utils.subprocess_server: INFO: Starting expansion service at
localhost:54039
root: DEBUG: Waiting for grpc channel to be ready at localhost:54039.
apache_beam.utils.subprocess_server: INFO: beam:external:java:sql:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$1/598446861@deb6432
apache_beam.utils.subprocess_server: INFO:
beam:external:java:generate_sequence:v1:
org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$1/598446861@28ba21f3
root: DEBUG: Waiting for grpc channel to be ready at localhost:54039.
root: DEBUG: Waiting for grpc channel to be ready at localhost:54039.
root: DEBUG: Waiting for grpc channel to be ready at localhost:54039.
root: DEBUG: Waiting for grpc channel to be ready at localhost:54039.
apache_beam.utils.subprocess_server: INFO: May 16, 2020 12:16:13 PM
org.apache.beam.sdk.expansion.service.ExpansionService expand
apache_beam.utils.subprocess_server: INFO: INFO: Expanding
'SqlTransform(beam:external:java:sql:v1)' with URN 'beam:external:java:sql:v1'
apache_beam.utils.subprocess_server: INFO: May 16, 2020 12:16:15 PM
org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
apache_beam.utils.subprocess_server: INFO: INFO: SQL:
apache_beam.utils.subprocess_server: INFO: SELECT `PCOLLECTION`.`int`,
`PCOLLECTION`.`flt`
apache_beam.utils.subprocess_server: INFO: FROM `beam`.`PCOLLECTION` AS
`PCOLLECTION`
apache_beam.utils.subprocess_server: INFO: May 16, 2020 12:16:16 PM
org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
apache_beam.utils.subprocess_server: INFO: INFO: SQLPlan>
apache_beam.utils.subprocess_server: INFO: LogicalProject(int=[$0], flt=[$2])
apache_beam.utils.subprocess_server: INFO: BeamIOSourceRel(table=[[beam,
PCOLLECTION]])
apache_beam.utils.subprocess_server: INFO:
apache_beam.utils.subprocess_server: INFO: May 16, 2020 12:16:16 PM
org.apache.beam.sdk.extensions.sql.impl.CalciteQueryPlanner convertToBeamRel
apache_beam.utils.subprocess_server: INFO: INFO: BEAMPlan>
apache_beam.utils.subprocess_server: INFO: BeamCalcRel(expr#0..2=[{inputs}],
int=[$t0], flt=[$t2])
apache_beam.utils.subprocess_server: INFO: BeamIOSourceRel(table=[[beam,
PCOLLECTION]])
apache_beam.utils.subprocess_server: INFO:
root: DEBUG: Sending SIGINT to job_server
root: WARNING: Make sure that locally built Python SDK docker image has Python
2.7 interpreter.
root: INFO: Using Python SDK docker image:
apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local,
we will try to pull from hub.docker.com
root: WARNING: Make sure that locally built Python SDK docker image has Python
2.7 interpreter.
root: INFO: Using Python SDK docker image:
apache/beam_python2.7_sdk:2.22.0.dev. If the image is not available at local,
we will try to pull from hub.docker.com
apache_beam.runners.portability.fn_api_runner.translations: INFO:
==================== <function lift_combiners at 0x7f59b74425f0>
====================
apache_beam.runners.portability.fn_api_runner.translations: DEBUG: 17 [1, 1, 1,
1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1, 1]
apache_beam.runners.portability.fn_api_runner.translations: DEBUG: Stages:
['ref_AppliedPTransform_Create/Impulse_3\n
Create/Impulse:beam:transform:impulse:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_Create/FlatMap(<lambda at core.py:2713>)_4\n
Create/FlatMap(<lambda at core.py:2713>):beam:transform:pardo:v1\n must
follow: \n downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_Create/Map(decode)_6\n
Create/Map(decode):beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'external_4SqlTransform(beam:external:java:sql:v1)/BeamIOSourceRel_2/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous)\n
SqlTransform(beam:external:java:sql:v1)/BeamIOSourceRel_2/Convert.ConvertTransform/ParDo(Anonymous)/ParMultiDo(Anonymous):beam:transform:pardo:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'external_4SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParDo(Calc)/ParMultiDo(Calc)\n
SqlTransform(beam:external:java:sql:v1)/BeamCalcRel_18/ParDo(Calc)/ParMultiDo(Calc):beam:transform:pardo:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Create/Impulse_10\n
assert_that/Create/Impulse:beam:transform:impulse:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Create/FlatMap(<lambda at
core.py:2713>)_11\n assert_that/Create/FlatMap(<lambda at
core.py:2713>):beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Create/Map(decode)_13\n
assert_that/Create/Map(decode):beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/WindowInto(WindowIntoFn)_14\n
assert_that/WindowInto(WindowIntoFn):beam:transform:window_into:v1\n must
follow: \n downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/ToVoidKey_15\n
assert_that/ToVoidKey:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/pair_with_0_17\n
assert_that/Group/pair_with_0:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/pair_with_1_18\n
assert_that/Group/pair_with_1:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/Flatten_19\n
assert_that/Group/Flatten:beam:transform:flatten:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/GroupByKey_20\n
assert_that/Group/GroupByKey:beam:transform:group_by_key:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Group/Map(_merge_tagged_vals_under_key)_24\n
assert_that/Group/Map(_merge_tagged_vals_under_key):beam:transform:pardo:v1\n
must follow: \n downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Unkey_25\n
assert_that/Unkey:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>',
'ref_AppliedPTransform_assert_that/Match_26\n
assert_that/Match:beam:transform:pardo:v1\n must follow: \n
downstream_side_inputs: <unknown>']
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'job_name' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'runner'
was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'temp_location' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'dataflow_kms_key' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'enable_streaming_engine' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'project'
was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'worker_region' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'worker_zone' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option 'zone'
was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'streaming' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'environment_cache_millis' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'files_to_stage' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'job_endpoint' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'output_executable_path' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'sdk_worker_parallelism' was already added
apache_beam.runners.portability.portable_runner: DEBUG: Runner option
'experiments' was already added
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
STOPPED
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
STARTING
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
RUNNING
root: DEBUG: org.apache.spark.SparkException: Only one SparkContext may be
running in this JVM (see SPARK-2243). To ignore this error, set
spark.driver.allowMultipleContexts = true. The currently running SparkContext
was created at:
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:98)
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:64)
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:109)
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
at
org.apache.spark.SparkContext$$anonfun$assertNoOtherContextIsRunning$2.apply(SparkContext.scala:2483)
at
org.apache.spark.SparkContext$$anonfun$assertNoOtherContextIsRunning$2.apply(SparkContext.scala:2479)
at scala.Option.foreach(Option.scala:257)
at
org.apache.spark.SparkContext$.assertNoOtherContextIsRunning(SparkContext.scala:2479)
at
org.apache.spark.SparkContext$.markPartiallyConstructed(SparkContext.scala:2568)
at org.apache.spark.SparkContext.<init>(SparkContext.scala:85)
at
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
at
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:98)
at
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:64)
at
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:109)
at
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
root: ERROR: org.apache.spark.SparkException: Only one SparkContext may be
running in this JVM (see SPARK-2243). To ignore this error, set
spark.driver.allowMultipleContexts = true. The currently running SparkContext
was created at:
org.apache.spark.api.java.JavaSparkContext.<init>(JavaSparkContext.scala:58)
org.apache.beam.runners.spark.translation.SparkContextFactory.createSparkContext(SparkContextFactory.java:98)
org.apache.beam.runners.spark.translation.SparkContextFactory.getSparkContext(SparkContextFactory.java:64)
org.apache.beam.runners.spark.SparkPipelineRunner.run(SparkPipelineRunner.java:109)
org.apache.beam.runners.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:83)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
java.lang.Thread.run(Thread.java:748)
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML: nosetests-xlangSqlValidateRunner.xml
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 5 tests in 80.293s
FAILED (errors=3)
> Task
> :runners:flink:1.10:job-server:validatesCrossLanguageRunnerPythonUsingSql
> FAILED
> Task :runners:flink:1.10:job-server:flinkJobServerCleanup
Stopping job server pid: 26946.
FAILURE: Build completed with 2 failures.
1: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task ':sdks:java:container:pullLicenses'.
> Process 'command './sdks/java/container/license_scripts/license_script.sh''
> finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
2: Task failed with an exception.
-----------
* What went wrong:
Execution failed for task
':runners:flink:1.10:job-server:validatesCrossLanguageRunnerPythonUsingSql'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 11m 51s
128 actionable tasks: 99 executed, 27 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/pahjenajqpvcg
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
