Github user ankurcha commented on the pull request:
https://github.com/apache/flink/pull/948#issuecomment-142825340
Hi @rmetzger,
This completely got buried in scheduler but i think i have finally worked
out the kinks. Thanks for spending the time to try it out.
I think we are closer to having this out of the door so have a go at it and
let me know if you see something off.
```bash
vagrant@mesos:/vagrant$ java
-Dlog4j.configuration=file:/vagrant/log4j.properties -cp *.jar
org.apache.flink.mesos.scheduler.FlinkScheduler --confDir /vagrant --port 10080
INFO 2015-09-24 06:22:04,584 [main] FlinkScheduler$:
--------------------------------------------------------------------------------
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Starting JobManager
(Version: 0.10-SNAPSHOT, Rev:bc21de2, Date:23.09.2015 @ 20:06:33 UTC)
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Current user: vagrant
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: JVM: OpenJDK 64-Bit
Server VM - Oracle Corporation - 1.7/24.79-b02
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: Maximum heap size:
592 MiBytes
INFO 2015-09-24 06:22:04,585 [main] FlinkScheduler$: JAVA_HOME: (not set)
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: Hadoop version: 2.3.0
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: JVM Options:
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$:
-Dlog4j.configuration=file:/vagrant/log4j.properties
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: Program Arguments:
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: --confDir
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: /vagrant
INFO 2015-09-24 06:22:04,588 [main] FlinkScheduler$: --port
INFO 2015-09-24 06:22:04,589 [main] FlinkScheduler$: 10080
INFO 2015-09-24 06:22:04,589 [main] FlinkScheduler$:
--------------------------------------------------------------------------------
INFO 2015-09-24 06:22:04,595 [main] FlinkScheduler$: Maximum number of
open file descriptors is 4096
INFO 2015-09-24 06:22:04,596 [main] FlinkScheduler$: Loading configuration
from /vagrant
DEBUG 2015-09-24 06:22:04,665 [main] FlinkScheduler$: Serving configuration
via: Some(http://127.0.0.1:10080)
INFO 2015-09-24 06:22:04,725 [Thread-3] JobManager: Starting JobManager
INFO 2015-09-24 06:22:04,726 [Thread-3] JobManager: Starting JobManager
actor system at :6123.
I0924 06:22:04.812088 7312 sched.cpp:157] Version: 0.22.1
2015-09-24 06:22:04,815:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@712: Client
environment:zookeeper.version=zookeeper C client 3.4.5
2015-09-24 06:22:04,816:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@716: Client
environment:host.name=mesos
2015-09-24 06:22:04,818:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@723: Client
environment:os.name=Linux
2015-09-24 06:22:04,821:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@724: Client
environment:os.arch=3.16.0-30-generic
2015-09-24 06:22:04,822:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@725: Client
environment:os.version=#40~14.04.1-Ubuntu SMP Thu Jan 15 17:43:14 UTC 2015
2015-09-24 06:22:04,824:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@733: Client
environment:user.name=vagrant
2015-09-24 06:22:04,827:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@741: Client
environment:user.home=/home/vagrant
2015-09-24 06:22:04,829:7311(0x7fcaf8bbb700):ZOO_INFO@log_env@753: Client
environment:user.dir=/vagrant
2015-09-24 06:22:04,830:7311(0x7fcaf8bbb700):ZOO_INFO@zookeeper_init@786:
Initiating client connection, host=127.0.0.1:2181 sessionTimeout=10000
watcher=0x7fcb29b99a60 sessionId=0 sessionPasswd=<null> context=0x1c0f350
flags=0
2015-09-24 06:22:04,837:7311(0x7fcaf2ffd700):ZOO_INFO@check_events@1703:
initiated connection to server [127.0.0.1:2181]
2015-09-24 06:22:04,839:7311(0x7fcaf2ffd700):ZOO_INFO@check_events@1750:
session establishment complete on server [127.0.0.1:2181],
sessionId=0x14ffdcf98d00015, negotiated timeout=10000
I0924 06:22:04.840190 7333 group.cpp:313] Group process
(group(1)@127.0.1.1:36068) connected to ZooKeeper
I0924 06:22:04.840239 7333 group.cpp:790] Syncing group operations: queue
size (joins, cancels, datas) = (0, 0, 0)
I0924 06:22:04.840265 7333 group.cpp:385] Trying to create path '/mesos'
in ZooKeeper
I0924 06:22:04.843736 7333 detector.cpp:138] Detected a new leader:
(id='0')
I0924 06:22:04.843868 7331 group.cpp:659] Trying to get
'/mesos/info_0000000000' in ZooKeeper
I0924 06:22:04.844832 7331 detector.cpp:452] A new leading master
([email protected]:5050) is detected
I0924 06:22:04.844923 7331 sched.cpp:254] New master detected at
[email protected]:5050
I0924 06:22:04.845263 7331 sched.cpp:264] No credentials provided.
Attempting to register without authentication
I0924 06:22:04.847537 7331 sched.cpp:448] Framework registered with
20150924-052444-16842879-5050-1219-0012
INFO 2015-09-24 06:22:04,872 [Thread-2] log: jetty-0.10-SNAPSHOT
INFO 2015-09-24 06:22:04,948 [Thread-2] log: Started
[email protected]:10080
Embedded server listening at
http://127.0.0.1:10080
Press any key to stop.
INFO 2015-09-24 06:22:05,194 [Thread-5] FlinkScheduler$: Accepting
INFO 2015-09-24 06:22:05,951 [flink-akka.actor.default-dispatcher-4]
Slf4jLogger: Slf4jLogger started
INFO 2015-09-24 06:22:06,243 [flink-akka.actor.default-dispatcher-4]
Remoting: Starting remoting
INFO 2015-09-24 06:22:06,536 [flink-akka.actor.default-dispatcher-4]
Remoting: Remoting started; listening on addresses
:[akka.tcp://[email protected]:6123]
INFO 2015-09-24 06:22:06,549 [Thread-3] JobManager: Starting JobManager
actor
INFO 2015-09-24 06:22:06,559 [Thread-3] BlobServer: Created BLOB server
storage directory /tmp/blobStore-b226277a-1f52-47ad-b3a5-c981cc67cb02
INFO 2015-09-24 06:22:06,560 [Thread-3] BlobServer: Started BLOB server at
0.0.0.0:50466 - max concurrent requests: 50 - max backlog: 1000
INFO 2015-09-24 06:22:06,588 [flink-akka.actor.default-dispatcher-4]
MemoryArchivist: Started memory archivist akka://flink/user/archive
INFO 2015-09-24 06:22:06,595 [flink-akka.actor.default-dispatcher-2]
JobManager: Starting JobManager at
akka.tcp://[email protected]:6123/user/jobmanager.
INFO 2015-09-24 06:22:06,623 [flink-akka.actor.default-dispatcher-2]
JobManager: JobManager akka.tcp://[email protected]:6123/user/jobmanager was
granted leadership with leader session ID None.
INFO 2015-09-24 06:22:06,638 [Thread-3] JobManager: Starting JobManger web
frontend
INFO 2015-09-24 06:22:06,640 [Thread-3] WebInfoServer: Setting up web info
server, using web-root directory
jar:file:/vagrant/flink-dist-0.10-SNAPSHOT.jar!/web-docs-infoserver.
INFO 2015-09-24 06:22:06,650 [Thread-3] log: jetty-0.10-SNAPSHOT
INFO 2015-09-24 06:22:06,656 [Thread-3] log: Started
[email protected]:8081
INFO 2015-09-24 06:22:06,656 [Thread-3] WebInfoServer: Started web info
server for JobManager on 0.0.0.0:8081
INFO 2015-09-24 06:22:06,978 [Thread-27] FlinkScheduler$: statusUpdate
received from taskId: TaskManager_1 slaveId:
20150924-052444-16842879-5050-1219-S0 [TASK_RUNNING]
DEBUG 2015-09-24 06:22:06,979 [Thread-27] FlinkScheduler$: No action to
take for statusUpdate TASK_RUNNING
INFO 2015-09-24 06:22:10,768 [Thread-28] FlinkScheduler$: Declining
offer(s) from slave 20150924-052444-16842879-5050-1219-S0 offered [cpus: 1.5 |
mem : 488.0 | disk: 33044.0] required [cpus: 0.5 | mem: 512.0 | disk: 1024.0]
```
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
