See
<https://builds.apache.org/job/beam_LoadTests_Python_GBK_Flink_Batch/209/display/redirect?page=changes>
Changes:
[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes
from
[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes
from
[mzobii.baig] Beam-2535 : Pursue pull request 4700 with manual apply changes
from
[mzobii.baig] Beam-2535 : Replace timeStamp with outputTimeStamp
[mzobii.baig] Beam-2535 : Apply Spotless
[mzobii.baig] Beam-2535 : Pass outputTimestamp param in onTimer method
[mzobii.baig] Beam-2535 : Minor changed
[rehman.muradali] [BEAM-2535] : Add Commit State in ParDoEvaluator
[rehman.muradali] [BEAM-2535] : Add outputTimestamp in compare method, Revert
[mzobii.baig] Beam-2535 : Modifying default minimum target and GC time
[rehman.muradali] BEAM-2535 : Removal of extra lines
[mzobii.baig] Beam-2535 : Proposed changes
[mzobii.baig] Beam-2535 : Added original PR watermark hold functionality.
[rehman.muradali] [BEAM-2535] Apply Spotless
[mzobii.baig] [Beam-2535] Variable renaming and added output timestamp in
[mzobii.baig] Beam-2535 : Apply Spotless
[mzobii.baig] [Beam-2535] Modify test case
[mzobii.baig] [Beam-2535] Added comments
[mzobii.baig] [Beam-2535] Apply Spotless
[mzobii.baig] [Beam-2535] Set Processing Time with outputTimestamp
[mzobii.baig] [Beam-2535] Minor renaming
[rehman.muradali] [BEAM-2535] Revert Processing Time, Addition of
OutputTimestamp
[rehman.muradali] [BEAM-2535] Revert TimerReceiver outputTimestamp
[rehman.muradali] [BEAM-2535] Revert TimerReceiver outputTimestamp
[rehman.muradali] [BEAM-2535] Making OnTimer compatible
[rehman.muradali] [BEAM-2535] Making OnTimer compatible
[rehman.muradali] Adding OutputTimestamp in Timer Object
[rehman.muradali] Apply Spotless and checkstyle
[mzobii.baig] [Beam-2535] Added watermark functionality for the dataflow runner
[mzobii.baig] [Beam-2535] Used boolean instead boxed type
[mzobii.baig] [Beam-2535] Modify required watermark hold functionality
[rehman.muradali] EarliestTimestamp Fix for outputTimestamp
[sunjincheng121] [BEAM-9030] Bump grpc to 1.26.0
[sunjincheng121] [BEAM-9030] Update the dependencies to make sure the
dependency linkage
[rehman.muradali] Rebase TimerData PR
[sunjincheng121] fixup
[mxm] Rename FlinkClassloading to Workarounds
[mxm] [BEAM-9060] Restore stdout/stderr in case Flink's
[iemejia] [BEAM-8717] Update commons-lang3 to version 3.9
[iemejia] [BEAM-8717] Make non core modules use only the repackaged
commons-lang3
[sunjincheng121] fixup
[github] Update ParDoTest.java
[rehman.muradali] Apply spotless
[rehman.muradali] Compilation Fix PardoTest
[rehman.muradali] Reverting outputTimestamp validation
[rehman.muradali] CheckStyle Fix
[rehman.muradali] Adding Category to exclude Flink Runner
[jkai] [BEAM-8496] remove SDF translators in flink streaming transform
[github] Fix blogpost typo (#10532)
[12602502+Ardagan] Fix headings in downloads.md
[github] Add # pytype: skip-file before first import statement in each py file
------------------------------------------
[...truncated 267.38 KB...]
value {
bool_value: false
}
}
fields {
key: "beam:option:job_endpoint:v1"
value {
string_value: "localhost:8099"
}
}
fields {
key: "beam:option:job_name:v1"
value {
string_value: "load_tests_Python_Flink_Batch_GBK_3_0109110031"
}
}
fields {
key: "beam:option:job_port:v1"
value {
string_value: "0"
}
}
fields {
key: "beam:option:job_server_timeout:v1"
value {
string_value: "60"
}
}
fields {
key: "beam:option:load_balance_bundles:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:no_auth:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:object_reuse:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:parallelism:v1"
value {
string_value: "5"
}
}
fields {
key: "beam:option:pipeline_type_check:v1"
value {
bool_value: true
}
}
fields {
key: "beam:option:profile_cpu:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:profile_memory:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:profile_sample_rate:v1"
value {
number_value: 1.0
}
}
fields {
key: "beam:option:project:v1"
value {
string_value: "apache-beam-testing"
}
}
fields {
key: "beam:option:retain_docker_containers:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:retain_externalized_checkpoints_on_cancellation:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:runtime_type_check:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:save_main_session:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:sdk_location:v1"
value {
string_value: "container"
}
}
fields {
key: "beam:option:sdk_worker_parallelism:v1"
value {
string_value: "1"
}
}
fields {
key: "beam:option:shutdown_sources_on_final_watermark:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:spark_master_url:v1"
value {
string_value: "local[4]"
}
}
fields {
key: "beam:option:spark_submit_uber_jar:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:streaming:v1"
value {
bool_value: false
}
}
fields {
key: "beam:option:type_check_strictness:v1"
value {
string_value: "DEFAULT_TO_ANY"
}
}
fields {
key: "beam:option:update:v1"
value {
bool_value: false
}
}
}
job_name: "job"
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
STOPPED
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
STARTING
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
RUNNING
root: DEBUG: org.apache.flink.client.program.ProgramInvocationException: Job
failed. (JobID: 408aa49e71690b992a1eef9064037a41)
at
org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:262)
at
org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:338)
at
org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:326)
at
org.apache.flink.client.program.ClusterClient.run(ClusterClient.java:301)
at
org.apache.flink.client.RemoteExecutor.executePlanWithJars(RemoteExecutor.java:209)
at
org.apache.flink.client.RemoteExecutor.executePlan(RemoteExecutor.java:186)
at
org.apache.flink.api.java.RemoteEnvironment.execute(RemoteEnvironment.java:173)
at
org.apache.beam.runners.flink.FlinkBatchPortablePipelineTranslator$BatchTranslationContext.execute(FlinkBatchPortablePipelineTranslator.java:191)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.runPipelineWithTranslator(FlinkPipelineRunner.java:116)
at
org.apache.beam.runners.flink.FlinkPipelineRunner.run(FlinkPipelineRunner.java:84)
at
org.apache.beam.runners.fnexecution.jobsubmission.JobInvocation.runPipeline(JobInvocation.java:81)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask$TrustedFutureInterruptibleTask.runInterruptibly(TrustedListenableFutureTask.java:125)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.InterruptibleTask.run(InterruptibleTask.java:57)
at
org.apache.beam.vendor.guava.v26_0_jre.com.google.common.util.concurrent.TrustedListenableFutureTask.run(TrustedListenableFutureTask.java:78)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.flink.runtime.client.JobExecutionException: Job execution
failed.
at
org.apache.flink.runtime.jobmaster.JobResult.toJobExecutionResult(JobResult.java:146)
at
org.apache.flink.client.program.rest.RestClusterClient.submitJob(RestClusterClient.java:259)
... 16 more
Caused by: java.util.concurrent.TimeoutException: Heartbeat of TaskManager with
id container_e01_1578575615166_0001_01_000002 timed out.
at
org.apache.flink.runtime.jobmaster.JobMaster$TaskManagerHeartbeatListener.notifyHeartbeatTimeout(JobMaster.java:1149)
at
org.apache.flink.runtime.heartbeat.HeartbeatMonitorImpl.run(HeartbeatMonitorImpl.java:109)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRunAsync(AkkaRpcActor.java:397)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleRpcMessage(AkkaRpcActor.java:190)
at
org.apache.flink.runtime.rpc.akka.FencedAkkaRpcActor.handleRpcMessage(FencedAkkaRpcActor.java:74)
at
org.apache.flink.runtime.rpc.akka.AkkaRpcActor.handleMessage(AkkaRpcActor.java:152)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:26)
at akka.japi.pf.UnitCaseStatement.apply(CaseStatements.scala:21)
at scala.PartialFunction$class.applyOrElse(PartialFunction.scala:123)
at akka.japi.pf.UnitCaseStatement.applyOrElse(CaseStatements.scala:21)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:170)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
at scala.PartialFunction$OrElse.applyOrElse(PartialFunction.scala:171)
at akka.actor.Actor$class.aroundReceive(Actor.scala:517)
at akka.actor.AbstractActor.aroundReceive(AbstractActor.scala:225)
at akka.actor.ActorCell.receiveMessage(ActorCell.scala:592)
at akka.actor.ActorCell.invoke(ActorCell.scala:561)
at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:258)
at akka.dispatch.Mailbox.run(Mailbox.scala:225)
at akka.dispatch.Mailbox.exec(Mailbox.scala:235)
at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at
akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at
akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
root: ERROR: java.util.concurrent.TimeoutException: Heartbeat of TaskManager
with id container_e01_1578575615166_0001_01_000002 timed out.
apache_beam.runners.portability.portable_runner: INFO: Job state changed to
FAILED
--------------------- >> end captured logging << ---------------------
----------------------------------------------------------------------
XML:
<https://builds.apache.org/job/beam_LoadTests_Python_GBK_Flink_Batch/ws/src/sdks/python/nosetests.xml>
----------------------------------------------------------------------
Ran 1 test in 144.297s
FAILED (errors=1)
> Task :sdks:python:apache_beam:testing:load_tests:run FAILED
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://builds.apache.org/job/beam_LoadTests_Python_GBK_Flink_Batch/ws/src/sdks/python/apache_beam/testing/load_tests/build.gradle'>
line: 53
* What went wrong:
Execution failed for task ':sdks:python:apache_beam:testing:load_tests:run'.
> error occurred
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 6.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/5.2.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2m 29s
3 actionable tasks: 2 executed, 1 up-to-date
Publishing build scan...
https://gradle.com/s/ygzmbsh4cmaik
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
