keith-turner commented on issue #270: Support Accumulo installs on Microsoft Azure URL: https://github.com/apache/fluo-muchos/pull/270#issuecomment-521812086 I tried running this branch against EC2 to setup a 12 node cluster and I ran into a few issues. * Accumulo 2.0 does not download, I am still trying to figure out why. Looking at the changes made to the Accumulo ansible files I don't see any problems. I am going to look into this some more tomorrow. * I am seeing some errors with the zookeeper setup because I chose a leader node type that only had a single ephemeral drive. * I saw some errors with the jps commands, but these did not seem to cause a problem. Below are the zookeeper setup errors I saw. The leader nodes only have `/media/ephemeral0` ``` ASK [zookeeper : Create zookeeper log dir] **************************************************************************************************************************************************************** Thursday 15 August 2019 21:40:11 +0000 (0:00:01.844) 0:03:27.249 ******* fatal: [leader2]: FAILED! => {"changed": false, "msg": "There was an issue creating /media/ephemeral1 as requested: [Errno 13] Permission denied: '/media/ephemeral1'", "path": "/media/ephemeral1/logs/zookeeper"} fatal: [leader3]: FAILED! => {"changed": false, "msg": "There was an issue creating /media/ephemeral1 as requested: [Errno 13] Permission denied: '/media/ephemeral1'", "path": "/media/ephemeral1/logs/zookeeper"} changed: [worker1] fatal: [leader1]: FAILED! => {"changed": false, "msg": "There was an issue creating /media/ephemeral1 as requested: [Errno 13] Permission denied: '/media/ephemeral1'", "path": "/media/ephemeral1/logs/zookeeper"} changed: [worker6] changed: [worker7] changed: [worker8] changed: [worker9] changed: [worker4] changed: [worker5] changed: [worker3] changed: [worker2] ``` Below are the jps errors and the failure to download Accumulo. ``` PLAY [journalnode] ***************************************************************************************************************************************************************************************** PLAY [namenode[0]] ***************************************************************************************************************************************************************************************** PLAY [namenode[0]] ***************************************************************************************************************************************************************************************** PLAY [namenode] ******************************************************************************************************************************************************************************************** PLAY [namenode[0]] ***************************************************************************************************************************************************************************************** PLAY [namenode[1]] ***************************************************************************************************************************************************************************************** PLAY [workers] ********************************************************************************************************************************************************************************************* TASK [Check if DataNode is running] ************************************************************************************************************************************************************************ Thursday 15 August 2019 21:41:31 +0000 (0:00:00.576) 0:04:47.205 ******* fatal: [worker1]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.139149", "end": "2019-08-15 21:41:32.007976", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:31.868827", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring fatal: [worker2]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.143752", "end": "2019-08-15 21:41:32.085573", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:31.941821", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring fatal: [worker4]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.143829", "end": "2019-08-15 21:41:32.101101", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:31.957272", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring fatal: [worker3]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.147803", "end": "2019-08-15 21:41:32.102506", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:31.954703", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring fatal: [worker5]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.131862", "end": "2019-08-15 21:41:32.120846", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:31.988984", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring fatal: [worker6]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.146547", "end": "2019-08-15 21:41:32.143614", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:31.997067", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring fatal: [worker8]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.130241", "end": "2019-08-15 21:41:32.165315", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:32.035074", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring fatal: [worker7]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.142849", "end": "2019-08-15 21:41:32.183773", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:32.040924", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring fatal: [worker9]: FAILED! => {"changed": false, "cmd": "jps | grep \" DataNode\" | grep -v grep", "delta": "0:00:00.131396", "end": "2019-08-15 21:41:32.211191", "msg": "non-zero return code", "rc": 1, "start": "2019-08-15 21:41:32.079795", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} ...ignoring TASK [start datanodes] ************************************************************************************************************************************************************************************* Thursday 15 August 2019 21:41:32 +0000 (0:00:00.663) 0:04:47.868 ******* changed: [worker1] changed: [worker2] changed: [worker3] changed: [worker4] changed: [worker5] changed: [worker6] changed: [worker7] changed: [worker8] changed: [worker9] PLAY [resourcemanager] ************************************************************************************************************************************************************************************* PLAY [metrics] ********************************************************************************************************************************************************************************************* PLAY [proxy] *********************************************************************************************************************************************************************************************** PLAY [all:!_] ************************************************************************************************************************************************************************************************* TASK [accumulo : install accumulo from tarball] ************************************************************************************************************************************************************ Thursday 15 August 2019 21:41:34 +0000 (0:00:02.700) 0:04:50.568 ******* fatal: [worker1]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} fatal: [worker7]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} fatal: [worker6]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} fatal: [worker8]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} fatal: [worker9]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} fatal: [worker4]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} fatal: [worker5]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} fatal: [worker3]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} fatal: [worker2]: FAILED! => {"changed": false, "msg": "Could not find or access '/home/centos/tarballs/accumulo-2.0.0-bin.tar.gz' on the Ansible Controller.\nIf you are using a module and expect the file to exist on the remote, see the remote_src option"} PLAY [accumulomaster[0]] *********************************************************************************************************************************************************************************** PLAY [accumulo] ******************************************************************************************************************************************************************************************** PLAY [workers] ********************************************************************************************************************************************************************************************* PLAY [accumulomaster] ************************************************************************************************************************************************************************************** ```
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
