[GitHub] [incubator-heron] nicknezis opened a new pull request #3497: Travis CI update

2020-03-21 Thread GitBox 
nicknezis opened a new pull request #3497: Travis CI update
URL: https://github.com/apache/incubator-heron/pull/3497
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-heron] nwangtw edited a comment on issue #3494: how to reduce cpu resource requirement?

2020-03-21 Thread GitBox 
nwangtw edited a comment on issue #3494: how to reduce cpu resource requirement?
URL: 
https://github.com/apache/incubator-heron/issues/3494#issuecomment-602019721
 
 
   The default cpu config is 1 for each component. Container requires some 
overhead hence there is no way to schedule instances into containers. To fix 
the problem, you need to config the cpu requirement for each component to be 
less than 1.
   
   I have created a PR to show how to config. 
https://github.com/apache/incubator-heron/pull/3496 For now we have to use the 
low level config because the it is not convenient to config components with the 
Streamlet config class.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-heron] nwangtw commented on issue #3494: how to reduce cpu resource requirement?

2020-03-21 Thread GitBox 
nwangtw commented on issue #3494: how to reduce cpu resource requirement?
URL: 
https://github.com/apache/incubator-heron/issues/3494#issuecomment-602019721
 
 
   The default cpu config is 1 for each component. Container requires some 
overhead hence there is no way to schedule instances into containers. To fix 
the problem, you need to config the cpu requirement for each component to be 
less than 1.
   
   I have created a PR to show how to config. For now we have to use the low 
level config because the it is not convenient to config components with the 
Streamlet config class.


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-heron] nwangtw opened a new pull request #3496: Add an example with Streamlet API using component config

2020-03-21 Thread GitBox 
nwangtw opened a new pull request #3496: Add an example with Streamlet API 
using component config
URL: https://github.com/apache/incubator-heron/pull/3496
 
 
   


This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

[GitHub] [incubator-heron] dttlgotv opened a new issue #3495: can not run on yarn of centos, but it can run well on yarn of macos.

2020-03-21 Thread GitBox 
dttlgotv opened a new issue #3495: can not run on yarn of centos, but it can 
run well on yarn of macos.
URL: https://github.com/apache/incubator-heron/issues/3495
 
 
   1.cpu requirement: 1
   2. mem requirement :1g
   3. run well on local mode
   
   I run an simple example well on macos to yarn? But when I submit it to yarn 
on linux virtual machine, the error can be seen below:
   
   
   
   
   driver.err is :
   OpenJDK 64-Bit Server VM warning: ignoring option PermSize=128m; support was 
removed in 8.0
   OpenJDK 64-Bit Server VM warning: ignoring option MaxPermSize=128m; support 
was removed in 8.0
   Mar 21, 2020 12:51:39 PM org.apache.reef.runtime.common.REEFLauncher main
   INFO: Entering REEFLauncher.main().
   Mar 21, 2020 12:51:40 PM org.apache.reef.util.REEFVersion logVersion
   INFO: REEF Version: 0.14.0
   SLF4J: Class path contains multiple SLF4J bindings.
   SLF4J: Found binding in 
[jar:file:/usr/local/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: Found binding in 
[jar:file:/usr/local/hadoop/tmp/nm-local-dir/usercache/root/appcache/application_1584758298231_0004/filecache/10/reef-job-5801454919214133447.jar/global/heron-zookeeper-statemgr.jar!/org/slf4j/impl/StaticLoggerBinder.class]
   SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an 
explanation.
   SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
   Mar 21, 2020 12:51:40 PM org.apache.reef.runtime.yarn.YarnClasspathProvider 

   SEVERE: YarnConfiguration.YARN_APPLICATION_CLASSPATH is empty. This 
indicates a broken cluster configuration.
   2020-03-21 12:51:41,222 WARN util.NativeCodeLoader: Unable to load 
native-hadoop library for your platform... using builtin-java classes where 
applicable
   Mar 21, 2020 12:51:46 PM org.apache.hadoop.yarn.client.RMProxy 
newProxyInstance
   INFO: Connecting to ResourceManager at 
tst-ofc-bj-smy-vmp1-kk01/10.0.15.131:8032
   Mar 21, 2020 12:51:46 PM org.apache.hadoop.yarn.client.RMProxy 
newProxyInstance
   INFO: Connecting to ResourceManager at 
tst-ofc-bj-smy-vmp1-kk01/10.0.15.131:8030
   2020-03-21 12:51:46,628 INFO impl.NMClientAsyncImpl: Upper bound of the 
thread pool size is 500
   2020-03-21 12:51:47,100 INFO conf.Configuration: resource-types.xml not found
   2020-03-21 12:51:47,101 INFO resource.ResourceUtils: Unable to find 
'resource-types.xml'.
   2020-03-21 12:51:47,495 INFO sasl.SaslDataTransferClient: SASL encryption 
trust check: localHostTrusted = false, remoteHostTrusted = false
   Mar 21, 2020 12:51:47 PM org.apache.heron.scheduler.yarn.HeronReefUtils 
extractPackageInSandbox
   INFO: Extracting package: reef/global/topology.tar.gz at: .
   Mar 21, 2020 12:51:47 PM org.apache.heron.scheduler.yarn.HeronReefUtils 
extractPackageInSandbox
   INFO: Extracting package: reef/global/heron-core.tar.gz at: .
   Mar 21, 2020 12:51:51 PM 
org.apache.heron.scheduler.yarn.HeronMasterDriver$HeronSchedulerLauncher 
launchScheduler
   INFO: Launching Heron scheduler
   2020-03-21 12:51:51,636 INFO imps.CuratorFrameworkImpl: Starting
   2020-03-21 12:51:51,646 INFO zookeeper.ZooKeeper: Client 
environment:zookeeper.version=3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03, 
built on 06/29/2018 00:39 GMT
   2020-03-21 12:51:51,646 INFO zookeeper.ZooKeeper: Client 
environment:host.name=kk01
   2020-03-21 12:51:51,647 INFO zookeeper.ZooKeeper: Client 
environment:java.version=1.8.0_242
   2020-03-21 12:51:51,647 INFO zookeeper.ZooKeeper: Client 
environment:java.vendor=Oracle Corporation
   2020-03-21 12:51:51,647 INFO zookeeper.ZooKeeper: Client 
environment:java.home=/usr/lib/jvm/java-1.8.0-openjdk-1.8.0.242.b08-0.el7_7.x86_64/jre
   2020-03-21 12:51:51,647 INFO zookeeper.ZooKeeper: Client