dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605551451 About cmd: hdfs dfs -get /heron/dist/heron-core.tar.gz heron-core.tar.gz && tar zxf heron-core.tar.gz I tried this command on three cluster machine, it works well. My heron.aurora is below: heron_core_release_uri = '{{CORE_PACKAGE_URI}}' heron_topology_jar_uri = '{{TOPOLOGY_PACKAGE_URI}}' core_release_file = "heron-core.tar.gz" topology_package_file = "topology.tar.gz" # --- processes --- fetch_heron_system = Process( name = 'fetch_heron_system', cmdline = 'hdfs dfs -get %s %s && tar zxf %s' % (heron_core_release_uri, core_release_file, core_release_file) ) fetch_user_package = Process( name = 'fetch_user_package', cmdline = 'hdfs dfs -get %s %s && tar zxf %s' % (heron_topology_jar_uri, topology_package_file, topology_package_file) ) result: in aurara stderr: log stderr download /bin/bash: hdfs: command not found mesos stderr: I0329 10:58:19.809157 22467 logging.cpp:201] INFO level logging started! I0329 10:58:19.809937 22467 fetcher.cpp:562] Fetcher Info: {"cache_directory":"/tmp/mesos/fetch/root","items":[{"action":"BYPASS_CACHE","uri":{"executable":true,"extract":true,"value":"/usr/bin/thermos_executor"}}],"sandbox_directory":"/root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-0000/executors/thermos-root-devel-Test3Topology-1-d2093f25-b263-4ada-9a33-823ae2ff5075/runs/bd2f2ba6-9be1-4243-b027-9ac8ddee447a","stall_timeout":{"nanoseconds":60000000000},"user":"root"} I0329 10:58:19.836925 22467 fetcher.cpp:459] Fetching URI '/usr/bin/thermos_executor' I0329 10:58:19.836985 22467 fetcher.cpp:290] Fetching '/usr/bin/thermos_executor' directly into the sandbox directory I0329 10:58:19.849915 22467 fetcher.cpp:618] Fetched '/usr/bin/thermos_executor' to '/root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-0000/executors/thermos-root-devel-Test3Topology-1-d2093f25-b263-4ada-9a33-823ae2ff5075/runs/bd2f2ba6-9be1-4243-b027-9ac8ddee447a/thermos_executor' I0329 10:58:19.850029 22467 fetcher.cpp:623] Successfully fetched all URIs into '/root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-0000/executors/thermos-root-devel-Test3Topology-1-d2093f25-b263-4ada-9a33-823ae2ff5075/runs/bd2f2ba6-9be1-4243-b027-9ac8ddee447a' twitter.common.app debug: Initializing: twitter.common.log (Logging subsystem.) Writing log files to disk in /root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-0000/executors/thermos-root-devel-Test3Topology-1-d2093f25-b263-4ada-9a33-823ae2ff5075/runs/bd2f2ba6-9be1-4243-b027-9ac8ddee447a I0329 10:58:21.379936 22469 exec.cpp:162] Version: 1.1.0 I0329 10:58:21.391768 22481 exec.cpp:237] Executor registered on agent e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1 Writing log files to disk in /root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-0000/executors/thermos-root-devel-Test3Topology-1-d2093f25-b263-4ada-9a33-823ae2ff5075/runs/bd2f2ba6-9be1-4243-b027-9ac8ddee447a ERROR] Regular plan unhealthy! Traceback (most recent call last): File "/root/.pex/install/twitter.common.exceptions-0.3.7-py2-none-any.whl.f6376bcca9bfda5eba4396de2676af5dfe36237d/twitter.common.exceptions-0.3.7-py2-none-any.whl/twitter/common/exceptions/__init__.py", line 126, in _excepting_run self.__real_run(*args, **kw) File "/root/.pex/install/twitter.common.concurrent-0.3.7-py2-none-any.whl.f1ab836a5554c86d07fa3f075905c95fb20c78dd/twitter.common.concurrent-0.3.7-py2-none-any.whl/twitter/common/concurrent/deferred.py", line 42, in run self._closure() File "/root/mesosdata/run/slaves/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-S1/frameworks/e2da2e47-de60-4a1c-a81e-4f14ac3cf16f-0000/executors/thermos-root-devel-Test3Topology-1-d2093f25-b263-4ada-9a33-823ae2ff5075/runs/bd2f2ba6-9be1-4243-b027-9ac8ddee447a/thermos_executor/apache/aurora/executor/common/announcer.py", line 269, in stop AttributeError: 'NoneType' object has no attribute 'stop' twitter.common.app debug: Shutting application down. twitter.common.app debug: Running exit function for twitter.common.log (Logging subsystem.) twitter.common.app debug: Finishing up module teardown. twitter.common.app debug: Active thread: <_MainThread(MainThread, started 140676464191296)> twitter.common.app debug: Active thread (daemon): <Thread(Thread-8, started daemon 140676227225344)> twitter.common.app debug: Active thread (daemon): <_DummyThread(Dummy-3, started daemon 140676277581568)> twitter.common.app debug: Active thread (daemon): <WaitThread(Thread-14, started daemon 140675077109504)> twitter.common.app debug: Active thread (daemon): <ThreadedHealthChecker(Thread-7 [TID=22502], started daemon 140675855664896)> twitter.common.app debug: Active thread (daemon): <Thread(Thread-10, started daemon 140675864057600)> twitter.common.app debug: Active thread (daemon): <WaitThread(Thread-20, started daemon 140675060324096)> twitter.common.app debug: Active thread (daemon): <TaskResourceMonitor(TaskResourceMonitor[root-devel-Test3Topology-1-d2093f25-b263-4ada-9a33-823ae2ff5075] [TID=22503], started daemon 140675847272192)> twitter.common.app debug: Active thread (daemon): <ServerSetJoinThread(Thread-21 [TID=22514], started daemon 140675882415872)> twitter.common.app debug: Active thread (daemon): <WaitThread(Thread-19, started daemon 140675068716800)> twitter.common.app debug: Active thread (daemon): <_DummyThread(Dummy-2, started daemon 140676260796160)> twitter.common.app debug: Active thread (daemon): <Thread(Thread-9, started daemon 140675874023168)> twitter.common.app debug: Exiting cleanly.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
