[
https://issues.apache.org/jira/browse/IMPALA-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978774#comment-16978774
]
ASF subversion and git services commented on IMPALA-9165:
---------------------------------------------------------
Commit fc4a91cf8c87966a910106dded7e7eb8d215270a in impala's branch
refs/heads/master from Joe McDonnell
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=fc4a91c ]
IMPALA-9165: Add timeout for create-load-data.sh
This converts the existing bin/run-all-tests-timeout-check.sh
to a more generic bin/script-timeout-check.sh. It uses this
new script for both bin/run-all-tests.sh and
testdata/bin/create-load-data.sh. The new script takes two
arguments:
-timeout : timeout in minutes
-script_name : name of the calling script
The script_name is used in debugging output / output filenames
to make it clear what timed out.
The run-all-tests.sh timeout remains the same.
testdata/bin/create-load-data.sh uses a 2.5 hour timeout.
This should help debug the issue in IMPALA-9165, because at
least the logs would be preserved on the Jenkins job.
Testing:
- Tested the timeout script by hand with a caller script that
sleeps longer than the timeout
- Ran a gerrit-verify-dryrun-external
Change-Id: I19d76bd8850c7d4b5affff4d21f32d8715a382c6
Reviewed-on: http://gerrit.cloudera.org:8080/14741
Reviewed-by: Joe McDonnell <[email protected]>
Tested-by: Joe McDonnell <[email protected]>
> Precommit jobs getting stuck in testdata/bin/create-hbase.sh
> ------------------------------------------------------------
>
> Key: IMPALA-9165
> URL: https://issues.apache.org/jira/browse/IMPALA-9165
> Project: IMPALA
> Issue Type: Bug
> Components: Infrastructure
> Affects Versions: Impala 3.4.0
> Reporter: Joe McDonnell
> Priority: Blocker
> Labels: broken-build
>
> Several of our precommit jobs have been getting stuck and cancelled with this
> log:
> {noformat}
> 01:54:19 /home/ubuntu/Impala/testdata/target
> 01:54:19 SUCCESS, data generated into /home/ubuntu/Impala/testdata/target
> 01:54:20 Executing: create-load-data.sh
> 01:54:20 Generating HBase data (logging to
> /home/ubuntu/Impala/logs/data_loading/create-hbase.log)...
> 11:23:26 FATAL: Unable to delete script file
> /tmp/jenkins4199210326564796706.sh
> 11:23:26 java.lang.InterruptedException
> 11:23:26 at java.lang.Object.wait(Native Method)
> 11:23:26 at hudson.remoting.Request.call(Request.java:177)
> 11:23:26 at hudson.remoting.Channel.call(Channel.java:956)
> 11:23:26 at hudson.FilePath.act(FilePath.java:1070)
> 11:23:26 at hudson.FilePath.act(FilePath.java:1059)
> 11:23:26 at hudson.FilePath.delete(FilePath.java:1540)
> 11:23:26 at
> hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:123)
> 11:23:26 at
> hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:66)
> 11:23:26 at
> hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> 11:23:26 at
> hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741)
> 11:23:26 at hudson.model.Build$BuildExecution.build(Build.java:206)
> 11:23:26 at hudson.model.Build$BuildExecution.doRun(Build.java:163)
> 11:23:26 at
> hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
> 11:23:26 at hudson.model.Run.execute(Run.java:1818)
> 11:23:26 at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> 11:23:26 at
> hudson.model.ResourceController.execute(ResourceController.java:97)
> 11:23:26 at hudson.model.Executor.run(Executor.java:429){noformat}
> This indicates that the job is getting stuck inside
> testdata/bin/create-hbase.sh. The logs are not available, because the job
> gets cancelled.
> Some example jobs with this problem:
> [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/8847/]
> [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/8762/]
> [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/8850/]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
