Hi all, This is to discuss $subject.
Most of the issues we faced were due to the unavailability of a default overlay network/ SDN in mesos. Because of that, its not possible to communicate from container to container directly. The network related issues are discussed in detail in the mail [1] in dev list. After patching to get over the connection issue [2], another issue is seen where after the connection is established between spark client and mesos(spark) master, where the spark client just hang executing after the log lines [3]. This can be noticed in both DAS and a standalone spark sample. Doing some research, I suspect this *might* be because of a network issue again. As per the discussions where the same issue has been reported earlier [4, 5], a possible cause might be since its needed communicate from spark client to master and master to client (bi-directional). I did not check this in full detail. But, this can cause issues in the Mesos environment again, since the DAS spark client will be binding to the local IP. Considering all these facts, shall we go for the docker HOST networking mode for DAS as the default option in mesos? This might introduce some limitations such as not being able to have more than one DAS container in a single mesos worker node, etc. But IMHO it might not be practical to try and fix/workaround all limitations that we get in mesos. However, if an SDN/overlay network support is available, we can switch back to the BRIDGE networking mode. Please share your thoughts. [1]. [Mesos-Marathon] Issues in Creating Point to Point TCP Connections in Mesos-Marathon based Deployments [2]. Association with remote system [akka.tcp://[email protected]:5050] has failed, address is now gated for [5000] ms [3]. I0721 10:49:05.939699 19943 sched.cpp:222] Version: 0.28.1 I0721 10:49:05.947686 19939 sched.cpp:326] New master detected at [email protected]:5050 I0721 10:49:05.950932 19939 sched.cpp:336] No credentials provided. Attempting to register without authentication [4]. http://stackoverflow.com/questions/31867136/spark-shell-connect-to-mesos-hangs-no-credentials-provided-attempting-to-regis [5]. http://stackoverflow.com/questions/33727154/spark-shell-connecting-to-mesos-stuck-at-sched-cpp -- Thanks and Regards, Isuru H. +94 716 358 048
_______________________________________________ Architecture mailing list [email protected] https://mail.wso2.org/cgi-bin/mailman/listinfo/architecture
