dttlgotv commented on issue #3502: can not submit to aurora, it seems halt up. URL: https://github.com/apache/incubator-heron/issues/3502#issuecomment-605552785 I used your reference: heron_core_release_uri = '{{CORE_PACKAGE_URI}}' heron_topology_jar_uri = '{{TOPOLOGY_PACKAGE_URI}}' core_release_file = "heron-centos.tar.gz" topology_package_file = "topology.tar.gz" #heron_core_release_uri = '{{CORE_PACKAGE_URI}}' #heron_topology_jar_uri = '{{TOPOLOGY_PACKAGE_URI}}' #core_release_file = "heron-core.tar.gz" #topology_package_file = "topology.tar.gz" # --- processes --- fetch_heron_system = Process( name='fetch_heron_system', cmdline=textwrap.dedent(''' set -x curl %s -o %s && tar zxf %s && { rm -f heron-centos.tar.gz } && tar xvfz dist/heron-core.tar.gz && { rm -f dist/heron-core.tar.gz } ''') % (heron_core_release_uri, core_release_file, core_release_file) ) fetch_user_package = Process( name = 'fetch_user_package', cmdline = 'hdfs dfs -get %s %s && tar zxf %s' % (heron_topology_jar_uri, topology_package_file, topology_package_file) ) result: mesos and aurora stderr can not be seen , perhaps the task is not be scheduled. But I cmd this error can be seen below: Error loading configuration: name 'textwrap' is not defined [2020-03-29 11:15:44 +0800] [严重] org.apache.heron.scheduler.aurora.AuroraCLIController: Failed to run process. Command=[aurora, job, create, --wait-until, RUNNING, --bind, CPUS_PER_CONTAINER=1.0, --bind, EXECUTOR_BINARY=./heron-core/bin/heron-executor, --bind, ROLE=root, --bind, TOPOLOGY_NAME=Test3Topology, --bind, TOPOLOGY_PACKAGE_URI=/heron/topologies/aurora/Test3Topology-root-tag-0--8888688933785017338.tar.gz, --bind, RAM_PER_CONTAINER=2357198848, --bind, CORE_PACKAGE_URI=/heron/dist/heron-core.tar.gz, --bind, TIER=preemptible, --bind, TOPOLOGY_ARGUMENTS=--topology-name=Test3Topology --topology-id=Test3Topologye1439966-dc4f-47b9-9749-136375ba4528 --topology-defn-file=Test3Topology.defn --state-manager-connection=127.0.0.1:2181 --state-manager-root=/heron --state-manager-config-file=./heron-conf/statemgr.yaml --tmaster-binary=./heron-core/bin/heron-tmaster --stmgr-binary=./heron-core/bin/heron-stmgr --metrics-manager-classpath=./heron-core/lib/metricsmgr/* --instance-jvm-opts="" --classpath=heron-streamlet-examples.jar --heron-internals-config-file=./heron-conf/heron_internals.yaml --override-config-file=./heron-conf/override.yaml --component-ram-map=random-sentences-source:209715200 --component-jvm-opts="" --pkg-type=jar --topology-binary-file=heron-streamlet-examples.jar --heron-java-home=/usr/lib/jvm/java-1.8.0-openjdk-amd64 --heron-shell-binary=./heron-core/bin/heron-shell --cluster=aurora --role=root --environment=devel --instance-classpath=./heron-core/lib/instance/* --metrics-sinks-config-file=./heron-conf/metrics_sinks.yaml --scheduler-classpath=./heron-core/lib/scheduler/*:./heron-core/lib/packing/*:./heron-core/lib/statemgr/* --python-instance-binary=./heron-core/bin/heron-python-instance --cpp-instance-binary=./heron-core/bin/heron-cpp-instance --metricscache-manager-classpath=./heron-core/lib/metricscachemgr/* --metricscache-manager-mode=disabled --is-stateful=false --checkpoint-manager-classpath=./heron-core/lib/ckptmgr/*:./heron-core/lib/statefulstorage/*: --stateful-config-file=./heron-conf/stateful.yaml --checkpoint-manager-ram=1073741824 --health-manager-mode=disabled --health-manager-classpath=./heron-core/lib/healthmgr/*, --bind, NUM_CONTAINERS=2, --bind, CLUSTER=aurora, --bind, ENVIRON=devel, --bind, DISK_PER_CONTAINER=13958643712, aurora/root/devel/Test3Topology, /root/.heron/conf/aurora/heron.aurora, --verbose], STDOUT=null, STDERR=null [2020-03-29 11:15:44 +0800] [严重] org.apache.heron.scheduler.utils.LauncherUtils: Failed to invoke IScheduler as library [2020-03-29 11:15:44 +0800] [非常详细] org.apache.curator.utils.DefaultTracerDriver: Trace: DeleteBuilderImpl-Foreground - 20 ms [2020-03-29 11:15:44 +0800] [信息] org.apache.heron.statemgr.zookeeper.curator.CuratorStateManager: Deleted node for path: /heron/executionstate/Test3Topology [2020-03-29 11:15:44 +0800] [非常详细] org.apache.curator.utils.DefaultTracerDriver: Trace: DeleteBuilderImpl-Foreground - 18 ms [2020-03-29 11:15:44 +0800] [信息] org.apache.heron.statemgr.zookeeper.curator.CuratorStateManager: Deleted node for path: /heron/packingplans/Test3Topology [2020-03-29 11:15:44 +0800] [非常详细] org.apache.curator.utils.DefaultTracerDriver: Trace: DeleteBuilderImpl-Foreground - 21 ms [2020-03-29 11:15:44 +0800] [信息] org.apache.heron.statemgr.zookeeper.curator.CuratorStateManager: Deleted node for path: /heron/topologies/Test3Topology [2020-03-29 11:15:44 +0800] [详细] org.apache.heron.spi.utils.ShellUtils: Running synced process: ``hadoop --config /usr/local/hadoop/etc/hadoop fs -rm /heron/topologies/aurora/Test3Topology-root-tag-0--8888688933785017338.tar.gz'' [2020-03-29 11:15:44 +0800] [详细] org.apache.heron.spi.utils.ShellUtils: Process output (stdout+stderr): Deleted /heron/topologies/aurora/Test3Topology-root-tag-0--8888688933785017338.tar.gz [2020-03-29 11:15:47 +0800] [信息] org.apache.heron.statemgr.zookeeper.curator.CuratorStateManager: Closing the CuratorClient to: 127.0.0.1:2181 [2020-03-29 11:15:47 +0800] [详细] org.apache.curator.framework.imps.CuratorFrameworkImpl: Closing [2020-03-29 11:15:47 +0800] [详细] org.apache.curator.CuratorZookeeperClient: Closing [2020-03-29 11:15:47 +0800] [详细] org.apache.curator.ConnectionState: Closing [2020-03-29 11:15:47 +0800] [信息] org.apache.heron.statemgr.zookeeper.curator.CuratorStateManager: Closing the tunnel processes [2020-03-29 11:15:47 +0800] [严重] org.apache.heron.scheduler.SubmitterMain: Exception when submitting topology org.apache.heron.spi.scheduler.LauncherException: Failed to launch topology 'Test3Topology' at org.apache.heron.scheduler.LaunchRunner.call(LaunchRunner.java:177) at org.apache.heron.scheduler.SubmitterMain.callLauncherRunner(SubmitterMain.java:556) at org.apache.heron.scheduler.SubmitterMain.submitTopology(SubmitterMain.java:460) at org.apache.heron.scheduler.SubmitterMain.main(SubmitterMain.java:334) [2020-03-29 11:15:47 +0000] [ERROR]: Failed to launch topology 'Test3Topology' [2020-03-29 11:15:47 +0000] [ERROR]: Failed to launch topology 'Test3Topology' [2020-03-29 11:15:47 +0000] [DEBUG]: Elapsed time: 12.904s.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
