[jira] [Commented] (KYLIN-4372) Docker entrypoint delete file too later cause ZK started by HBase crash
[
https://issues.apache.org/jira/browse/KYLIN-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17105169#comment-17105169
]
ASF subversion and git services commented on KYLIN-4372:
Commit 8cf0a736a03d9868819d13c12d4bead0f3016f74 in kylin's branch
refs/heads/3.0.x from weibin0516
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=8cf0a73 ]
KYLIN-4372 Fix bug of delete file too later cause ZK started by HBase crash
> Docker entrypoint delete file too later cause ZK started by HBase crash
> ---
>
> Key: KYLIN-4372
> URL: https://issues.apache.org/jira/browse/KYLIN-4372
> Project: Kylin
> Issue Type: Bug
> Components: Others
>Affects Versions: v3.0.0-alpha2
>Reporter: Yue Zhang
>Assignee: weibin0516
>Priority: Critical
> Fix For: v3.0.2
>
>
> In docker/entrypoint.sh
>
> {code:java}
> # start hbase
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> rm -rf /data/zookeeper/*
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties &
> {code}
> rm -rf /data/zookeeper/* should before starting HBase instead of before
> starting Kafka.
> It executes after HBase will cause ZK started by HBase crash.
> The crash logs of /home/admin/hbase-1.1.2/logs/hbase--master-9aef5f427eb6.log:
> {code:java}
> 2020-02-10 09:25:56,402 INFO [SyncThread:0] persistence.FileTxnLog: Creating
> new log file: log.1 2020-02-10 09:25:56,402 ERROR [SyncThread:0]
> server.SyncRequestProcessor: Severe unrecoverable error, exiting
> java.io.FileNotFoundException: /data/zookeeper/zookeeper_0/version-2/log.1
> (No such file or directory) at java.io.FileOutputStream.open0(Native Method)
> at java.io.FileOutputStream.open(FileOutputStream.java:270) at
> java.io.FileOutputStream.(FileOutputStream.java:213) at
> java.io.FileOutputStream.(FileOutputStream.java:162) at
> org.apache.zookeeper.server.persistence.FileTxnLog.append(FileTxnLog.java:205)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.append(FileTxnSnapLog.java:314)
> at org.apache.zookeeper.server.ZKDatabase.append(ZKDatabase.java:476) at
> org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:140)
> {code}
> I think the shell should be like this
> {code:java}
> # start hbase
> rm -rf /data/zookeeper/*
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties & {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4372) Docker entrypoint delete file too later cause ZK started by HBase crash
[
https://issues.apache.org/jira/browse/KYLIN-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17037000#comment-17037000
]
ASF subversion and git services commented on KYLIN-4372:
Commit fa3862a42815417e157a86dc4a63a391abe0e2d5 in kylin's branch
refs/heads/master from weibin0516
[ https://gitbox.apache.org/repos/asf?p=kylin.git;h=fa3862a ]
KYLIN-4372 Fix bug of delete file too later cause ZK started by HBase crash
> Docker entrypoint delete file too later cause ZK started by HBase crash
> ---
>
> Key: KYLIN-4372
> URL: https://issues.apache.org/jira/browse/KYLIN-4372
> Project: Kylin
> Issue Type: Bug
> Components: Others
>Affects Versions: v3.0.0-alpha2
>Reporter: Yue Zhang
>Assignee: weibin0516
>Priority: Critical
>
> In docker/entrypoint.sh
>
> {code:java}
> # start hbase
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> rm -rf /data/zookeeper/*
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties &
> {code}
> rm -rf /data/zookeeper/* should before starting HBase instead of before
> starting Kafka.
> It executes after HBase will cause ZK started by HBase crash.
> The crash logs of /home/admin/hbase-1.1.2/logs/hbase--master-9aef5f427eb6.log:
> {code:java}
> 2020-02-10 09:25:56,402 INFO [SyncThread:0] persistence.FileTxnLog: Creating
> new log file: log.1 2020-02-10 09:25:56,402 ERROR [SyncThread:0]
> server.SyncRequestProcessor: Severe unrecoverable error, exiting
> java.io.FileNotFoundException: /data/zookeeper/zookeeper_0/version-2/log.1
> (No such file or directory) at java.io.FileOutputStream.open0(Native Method)
> at java.io.FileOutputStream.open(FileOutputStream.java:270) at
> java.io.FileOutputStream.(FileOutputStream.java:213) at
> java.io.FileOutputStream.(FileOutputStream.java:162) at
> org.apache.zookeeper.server.persistence.FileTxnLog.append(FileTxnLog.java:205)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.append(FileTxnSnapLog.java:314)
> at org.apache.zookeeper.server.ZKDatabase.append(ZKDatabase.java:476) at
> org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:140)
> {code}
> I think the shell should be like this
> {code:java}
> # start hbase
> rm -rf /data/zookeeper/*
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties & {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4372) Docker entrypoint delete file too later cause ZK started by HBase crash
[
https://issues.apache.org/jira/browse/KYLIN-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17036998#comment-17036998
]
ASF GitHub Bot commented on KYLIN-4372:
---
nichunen commented on pull request #1103: KYLIN-4372 Fix bug of delete file too
later cause ZK started by HBase…
URL: https://github.com/apache/kylin/pull/1103
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Docker entrypoint delete file too later cause ZK started by HBase crash
> ---
>
> Key: KYLIN-4372
> URL: https://issues.apache.org/jira/browse/KYLIN-4372
> Project: Kylin
> Issue Type: Bug
> Components: Others
>Affects Versions: v3.0.0-alpha2
>Reporter: Yue Zhang
>Assignee: weibin0516
>Priority: Critical
>
> In docker/entrypoint.sh
>
> {code:java}
> # start hbase
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> rm -rf /data/zookeeper/*
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties &
> {code}
> rm -rf /data/zookeeper/* should before starting HBase instead of before
> starting Kafka.
> It executes after HBase will cause ZK started by HBase crash.
> The crash logs of /home/admin/hbase-1.1.2/logs/hbase--master-9aef5f427eb6.log:
> {code:java}
> 2020-02-10 09:25:56,402 INFO [SyncThread:0] persistence.FileTxnLog: Creating
> new log file: log.1 2020-02-10 09:25:56,402 ERROR [SyncThread:0]
> server.SyncRequestProcessor: Severe unrecoverable error, exiting
> java.io.FileNotFoundException: /data/zookeeper/zookeeper_0/version-2/log.1
> (No such file or directory) at java.io.FileOutputStream.open0(Native Method)
> at java.io.FileOutputStream.open(FileOutputStream.java:270) at
> java.io.FileOutputStream.(FileOutputStream.java:213) at
> java.io.FileOutputStream.(FileOutputStream.java:162) at
> org.apache.zookeeper.server.persistence.FileTxnLog.append(FileTxnLog.java:205)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.append(FileTxnSnapLog.java:314)
> at org.apache.zookeeper.server.ZKDatabase.append(ZKDatabase.java:476) at
> org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:140)
> {code}
> I think the shell should be like this
> {code:java}
> # start hbase
> rm -rf /data/zookeeper/*
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties & {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4372) Docker entrypoint delete file too later cause ZK started by HBase crash
[
https://issues.apache.org/jira/browse/KYLIN-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033696#comment-17033696
]
ASF GitHub Bot commented on KYLIN-4372:
---
weibin0516 commented on pull request #1103: KYLIN-4372 Fix bug of delete file
too later cause ZK started by HBase…
URL: https://github.com/apache/kylin/pull/1103
… crash
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> Docker entrypoint delete file too later cause ZK started by HBase crash
> ---
>
> Key: KYLIN-4372
> URL: https://issues.apache.org/jira/browse/KYLIN-4372
> Project: Kylin
> Issue Type: Bug
> Components: Others
>Affects Versions: v3.0.0-alpha2
>Reporter: Yue Zhang
>Assignee: weibin0516
>Priority: Critical
>
> In docker/entrypoint.sh
>
> {code:java}
> # start hbase
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> rm -rf /data/zookeeper/*
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties &
> {code}
> rm -rf /data/zookeeper/* should before starting HBase instead of before
> starting Kafka.
> It executes after HBase will cause ZK started by HBase crash.
> The crash logs of /home/admin/hbase-1.1.2/logs/hbase--master-9aef5f427eb6.log:
> {code:java}
> 2020-02-10 09:25:56,402 INFO [SyncThread:0] persistence.FileTxnLog: Creating
> new log file: log.1 2020-02-10 09:25:56,402 ERROR [SyncThread:0]
> server.SyncRequestProcessor: Severe unrecoverable error, exiting
> java.io.FileNotFoundException: /data/zookeeper/zookeeper_0/version-2/log.1
> (No such file or directory) at java.io.FileOutputStream.open0(Native Method)
> at java.io.FileOutputStream.open(FileOutputStream.java:270) at
> java.io.FileOutputStream.(FileOutputStream.java:213) at
> java.io.FileOutputStream.(FileOutputStream.java:162) at
> org.apache.zookeeper.server.persistence.FileTxnLog.append(FileTxnLog.java:205)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.append(FileTxnSnapLog.java:314)
> at org.apache.zookeeper.server.ZKDatabase.append(ZKDatabase.java:476) at
> org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:140)
> {code}
> I think the shell should be like this
> {code:java}
> # start hbase
> rm -rf /data/zookeeper/*
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties & {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4372) Docker entrypoint delete file too later cause ZK started by HBase crash
[
https://issues.apache.org/jira/browse/KYLIN-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033561#comment-17033561
]
weibin0516 commented on KYLIN-4372:
---
[~cijianzy], ok, if you don't mind, I can submit a pr to fix this bug
> Docker entrypoint delete file too later cause ZK started by HBase crash
> ---
>
> Key: KYLIN-4372
> URL: https://issues.apache.org/jira/browse/KYLIN-4372
> Project: Kylin
> Issue Type: Bug
> Components: Others
>Affects Versions: v3.0.0-alpha2
>Reporter: Yue Zhang
>Priority: Critical
>
> In docker/entrypoint.sh
>
> {code:java}
> # start hbase
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> rm -rf /data/zookeeper/*
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties &
> {code}
> rm -rf /data/zookeeper/* should before starting HBase instead of before
> starting Kafka.
> It executes after HBase will cause ZK started by HBase crash.
> The crash logs of /home/admin/hbase-1.1.2/logs/hbase--master-9aef5f427eb6.log:
> {code:java}
> 2020-02-10 09:25:56,402 INFO [SyncThread:0] persistence.FileTxnLog: Creating
> new log file: log.1 2020-02-10 09:25:56,402 ERROR [SyncThread:0]
> server.SyncRequestProcessor: Severe unrecoverable error, exiting
> java.io.FileNotFoundException: /data/zookeeper/zookeeper_0/version-2/log.1
> (No such file or directory) at java.io.FileOutputStream.open0(Native Method)
> at java.io.FileOutputStream.open(FileOutputStream.java:270) at
> java.io.FileOutputStream.(FileOutputStream.java:213) at
> java.io.FileOutputStream.(FileOutputStream.java:162) at
> org.apache.zookeeper.server.persistence.FileTxnLog.append(FileTxnLog.java:205)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.append(FileTxnSnapLog.java:314)
> at org.apache.zookeeper.server.ZKDatabase.append(ZKDatabase.java:476) at
> org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:140)
> {code}
> I think the shell should be like this
> {code:java}
> # start hbase
> rm -rf /data/zookeeper/*
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties & {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4372) Docker entrypoint delete file too later cause ZK started by HBase crash
[
https://issues.apache.org/jira/browse/KYLIN-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033480#comment-17033480
]
Yue Zhang commented on KYLIN-4372:
--
No, the first time start.
> Docker entrypoint delete file too later cause ZK started by HBase crash
> ---
>
> Key: KYLIN-4372
> URL: https://issues.apache.org/jira/browse/KYLIN-4372
> Project: Kylin
> Issue Type: Bug
> Components: Others
>Affects Versions: v3.0.0-alpha2
>Reporter: Yue Zhang
>Priority: Critical
>
> In docker/entrypoint.sh
>
> {code:java}
> # start hbase
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> rm -rf /data/zookeeper/*
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties &
> {code}
> rm -rf /data/zookeeper/* should before starting HBase instead of before
> starting Kafka.
> It executes after HBase will cause ZK started by HBase crash.
> The crash logs of /home/admin/hbase-1.1.2/logs/hbase--master-9aef5f427eb6.log:
> {code:java}
> 2020-02-10 09:25:56,402 INFO [SyncThread:0] persistence.FileTxnLog: Creating
> new log file: log.1 2020-02-10 09:25:56,402 ERROR [SyncThread:0]
> server.SyncRequestProcessor: Severe unrecoverable error, exiting
> java.io.FileNotFoundException: /data/zookeeper/zookeeper_0/version-2/log.1
> (No such file or directory) at java.io.FileOutputStream.open0(Native Method)
> at java.io.FileOutputStream.open(FileOutputStream.java:270) at
> java.io.FileOutputStream.(FileOutputStream.java:213) at
> java.io.FileOutputStream.(FileOutputStream.java:162) at
> org.apache.zookeeper.server.persistence.FileTxnLog.append(FileTxnLog.java:205)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.append(FileTxnSnapLog.java:314)
> at org.apache.zookeeper.server.ZKDatabase.append(ZKDatabase.java:476) at
> org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:140)
> {code}
> I think the shell should be like this
> {code:java}
> # start hbase
> rm -rf /data/zookeeper/*
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties & {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KYLIN-4372) Docker entrypoint delete file too later cause ZK started by HBase crash
[
https://issues.apache.org/jira/browse/KYLIN-4372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17033479#comment-17033479
]
weibin0516 commented on KYLIN-4372:
---
Hi, [~cijianzy], is it the restart container that encountered this error？
> Docker entrypoint delete file too later cause ZK started by HBase crash
> ---
>
> Key: KYLIN-4372
> URL: https://issues.apache.org/jira/browse/KYLIN-4372
> Project: Kylin
> Issue Type: Bug
> Components: Others
>Affects Versions: v3.0.0-alpha2
>Reporter: Yue Zhang
>Priority: Critical
>
> In docker/entrypoint.sh
>
> {code:java}
> # start hbase
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> rm -rf /data/zookeeper/*
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties &
> {code}
> rm -rf /data/zookeeper/* should before starting HBase instead of before
> starting Kafka.
> It executes after HBase will cause ZK started by HBase crash.
> The crash logs of /home/admin/hbase-1.1.2/logs/hbase--master-9aef5f427eb6.log:
> {code:java}
> 2020-02-10 09:25:56,402 INFO [SyncThread:0] persistence.FileTxnLog: Creating
> new log file: log.1 2020-02-10 09:25:56,402 ERROR [SyncThread:0]
> server.SyncRequestProcessor: Severe unrecoverable error, exiting
> java.io.FileNotFoundException: /data/zookeeper/zookeeper_0/version-2/log.1
> (No such file or directory) at java.io.FileOutputStream.open0(Native Method)
> at java.io.FileOutputStream.open(FileOutputStream.java:270) at
> java.io.FileOutputStream.(FileOutputStream.java:213) at
> java.io.FileOutputStream.(FileOutputStream.java:162) at
> org.apache.zookeeper.server.persistence.FileTxnLog.append(FileTxnLog.java:205)
> at
> org.apache.zookeeper.server.persistence.FileTxnSnapLog.append(FileTxnSnapLog.java:314)
> at org.apache.zookeeper.server.ZKDatabase.append(ZKDatabase.java:476) at
> org.apache.zookeeper.server.SyncRequestProcessor.run(SyncRequestProcessor.java:140)
> {code}
> I think the shell should be like this
> {code:java}
> # start hbase
> rm -rf /data/zookeeper/*
> $HBASE_HOME/bin/start-hbase.sh
> # start kafka
> rm -rf /tmp/kafka-logs
> nohup $KAFKA_HOME/bin/kafka-server-start.sh
> $KAFKA_HOME/config/server.properties & {code}
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
