[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168956#comment-14168956 ] Ashish Singhi commented on HBASE-6970: -- bq. stop command does not return a failed exit code ( 0), if the stop fails because the running process was not found. I think we should not return a failed exit code in this case. If we do then user may assume that the process is still running but it is not. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Components: Usability Reporter: Lars Hofhansl Assignee: Ashish Singhi Fix For: 2.0.0 We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14168501#comment-14168501 ] Enis Soztutar commented on HBASE-6970: -- unscheduling from branch-1. Can bring back if there is a patch. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Components: Usability Reporter: Lars Hofhansl Fix For: 2.0.0 We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13651776#comment-13651776 ] Nicolas Liochon commented on HBASE-6970: [~jdcryans] I haven't found a reasonable way to implement what I initially proposed :-( hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13651486#comment-13651486 ] Jean-Daniel Cryans commented on HBASE-6970: --- Still working on this [~liochon]? hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: Nicolas Liochon We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635421#comment-13635421 ] Himanshu Vashishtha commented on HBASE-6970: [~nkeywal] Can you please tell why we are not deleting the pid file after removing the znode? hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: Nicolas Liochon We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635431#comment-13635431 ] Nicolas Liochon commented on HBASE-6970: In the java code you mean? It is in the context of this jira? hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: Nicolas Liochon We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635460#comment-13635460 ] Himanshu Vashishtha commented on HBASE-6970: No, in the hbase-daemon.sh script, there is a clearZNode() method which deletes the rs znode, but the pid file is kept intact. I wonder why this is so. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: Nicolas Liochon We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635536#comment-13635536 ] Himanshu Vashishtha commented on HBASE-6970: I see, the pid file is deleted in case normal stop command is used. I was using kill -9 rs_proc, in that case, only cleanZnode is called by the script. I wonder shouldn't we delete the pid in either case (just like deleting the znode), irrespective the rs process died? I don't see any benefit of keeping that file. Did I miss anything. Thanks. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: Nicolas Liochon We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13635562#comment-13635562 ] Nicolas Liochon commented on HBASE-6970: the pid file is supposed to be there is the process is still there, so deleting the znode is not enough: we need to be sure that the process died. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: Nicolas Liochon We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13528965#comment-13528965 ] nkeywal commented on HBASE-6970: Doing things completely is actually far from simple... - Ensuring that the java path is clean and we can always return the right status seems very complicated if we don't want to have endless bugs around forgotten cases. - Failure return code from the stop: easy to add in the script shell - Only write a new pid if the start was actually successful. The only way I see to do this is to write the pid file from the java program. This should cover most cases, but we should do it soon enough (likely at the very beginning of the run method) to ensure we've generated the file even if we have a endless loop later. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: nkeywal We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13503690#comment-13503690 ] nkeywal commented on HBASE-6970: I plan to work on it this week. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl Assignee: nkeywal We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473176#comment-13473176 ] nkeywal commented on HBASE-6970: Should we have return codes like: - 0: start ok, stop ok - 1: didn't start - 2: start ok, but then unexpected failure - 3: start ok, operations ok, then failed to stop properly when asked hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473393#comment-13473393 ] Jean-Daniel Cryans commented on HBASE-6970: --- SGTM hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13473443#comment-13473443 ] Lars Hofhansl commented on HBASE-6970: -- I had to look up SGTM. Now I am SGTM. :) I think the first change we can make safely, namely only write a new pid if the start was actually successful (nobody will rely on the _wrong_ pid being in the pid file). The second change (failure return code from the stop) could throw off existing scripts, although I still think we should make that change. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl We just ran into a strange issue where could neither start nor stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is created or updated even when the start of the service failed. The next stop command will then fail, because the pid file has the wrong pid in it. Edit: Spelling and more spelling errors. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13472959#comment-13472959 ] Lars Hofhansl commented on HBASE-6970: -- Also we found that the stop command does not return a failed exit code ( 0), if the stop fails because the running process was not found. I am not sure how risky changing this behavior is for current installation that might rely on the this behavior. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl We just ran into a strange issue where could start or stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is create or update even the start of the service failed. The next stop command will then fail, because the pid file has he wrong pid in it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-6970) hbase-deamon.sh creates/updates pid file even when that start failed.
[ https://issues.apache.org/jira/browse/HBASE-6970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13472964#comment-13472964 ] Jean-Daniel Cryans commented on HBASE-6970: --- lol I'm looking at the same problem and worrying about the same thing. At least changing this behavior would help things like supervisord. hbase-deamon.sh creates/updates pid file even when that start failed. - Key: HBASE-6970 URL: https://issues.apache.org/jira/browse/HBASE-6970 Project: HBase Issue Type: Bug Reporter: Lars Hofhansl We just ran into a strange issue where could start or stop services with hbase-deamon.sh. The problem is this: {code} nohup nice -n $HBASE_NICENESS $HBASE_HOME/bin/hbase \ --config ${HBASE_CONF_DIR} \ $command $@ $startStop $logout 21 /dev/null echo $! $pid {code} So the pid file is create or update even the start of the service failed. The next stop command will then fail, because the pid file has he wrong pid in it. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira