[ 
https://issues.apache.org/jira/browse/IMPALA-9165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16978776#comment-16978776
 ] 

Joe McDonnell commented on IMPALA-9165:
---------------------------------------

The HBase master log has output that is similar to IMPALA-9150:

{noformat}
19/11/19 01:52:26 WARN master.HMaster: hbase:meta,,1.1588230740 is NOT online; 
state={1588230740 state=OPEN, ts=1574128341757, 
server=172.18.0.1,16020,1574121687036}; ServerCrashProcedures=false. Master 
startup cannot progress, in holding-pattern until region onlined.
19/11/19 01:52:27 WARN master.HMaster: hbase:meta,,1.1588230740 is NOT online; 
state={1588230740 state=OPEN, ts=1574128341757, 
server=172.18.0.1,16020,1574121687036}; ServerCrashProcedures=false. Master 
startup cannot progress, in holding-pattern until region onlined.
19/11/19 01:52:29 WARN master.HMaster: hbase:meta,,1.1588230740 is NOT online; 
state={1588230740 state=OPEN, ts=1574128341757, 
server=172.18.0.1,16020,1574121687036}; ServerCrashProcedures=false. Master 
startup cannot progress, in holding-pattern until region onlined.
19/11/19 01:52:33 WARN master.HMaster: hbase:meta,,1.1588230740 is NOT online; 
state={1588230740 state=OPEN, ts=1574128341757, 
server=172.18.0.1,16020,1574121687036}; ServerCrashProcedures=false. Master 
startup cannot progress, in holding-pattern until region onlined.
19/11/19 01:52:41 WARN master.HMaster: hbase:meta,,1.1588230740 is NOT online; 
state={1588230740 state=OPEN, ts=1574128341757, 
server=172.18.0.1,16020,1574121687036}; ServerCrashProcedures=false. Master 
startup cannot progress, in holding-pattern until region onlined.
19/11/19 01:52:57 WARN master.HMaster: hbase:meta,,1.1588230740 is NOT online; 
state={1588230740 state=OPEN, ts=1574128341757, 
server=172.18.0.1,16020,1574121687036}; ServerCrashProcedures=false. Master 
startup cannot progress, in holding-pattern until region onlined.
{noformat}


> Precommit jobs getting stuck in testdata/bin/create-hbase.sh
> ------------------------------------------------------------
>
>                 Key: IMPALA-9165
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9165
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Infrastructure
>    Affects Versions: Impala 3.4.0
>            Reporter: Joe McDonnell
>            Priority: Blocker
>              Labels: broken-build
>
> Several of our precommit jobs have been getting stuck and cancelled with this 
> log:
> {noformat}
> 01:54:19 /home/ubuntu/Impala/testdata/target
> 01:54:19 SUCCESS, data generated into /home/ubuntu/Impala/testdata/target
> 01:54:20 Executing: create-load-data.sh 
> 01:54:20 Generating HBase data (logging to 
> /home/ubuntu/Impala/logs/data_loading/create-hbase.log)... 
> 11:23:26 FATAL: Unable to delete script file 
> /tmp/jenkins4199210326564796706.sh
> 11:23:26 java.lang.InterruptedException
> 11:23:26      at java.lang.Object.wait(Native Method)
> 11:23:26      at hudson.remoting.Request.call(Request.java:177)
> 11:23:26      at hudson.remoting.Channel.call(Channel.java:956)
> 11:23:26      at hudson.FilePath.act(FilePath.java:1070)
> 11:23:26      at hudson.FilePath.act(FilePath.java:1059)
> 11:23:26      at hudson.FilePath.delete(FilePath.java:1540)
> 11:23:26      at 
> hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:123)
> 11:23:26      at 
> hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:66)
> 11:23:26      at 
> hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
> 11:23:26      at 
> hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:741)
> 11:23:26      at hudson.model.Build$BuildExecution.build(Build.java:206)
> 11:23:26      at hudson.model.Build$BuildExecution.doRun(Build.java:163)
> 11:23:26      at 
> hudson.model.AbstractBuild$AbstractBuildExecution.run(AbstractBuild.java:504)
> 11:23:26      at hudson.model.Run.execute(Run.java:1818)
> 11:23:26      at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
> 11:23:26      at 
> hudson.model.ResourceController.execute(ResourceController.java:97)
> 11:23:26      at hudson.model.Executor.run(Executor.java:429){noformat}
> This indicates that the job is getting stuck inside 
> testdata/bin/create-hbase.sh. The logs are not available, because the job 
> gets cancelled.
> Some example jobs with this problem:
> [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/8847/]
> [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/8762/]
> [https://jenkins.impala.io/job/ubuntu-16.04-from-scratch/8850/]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to