@Ekrem Sure! Would be great to work together on this. I'm assuming you already have the basic docker setup on your dev machine. If you're new to kubernetes, the first step is to get a local k8s setup going - single node (minikube) or multi-node (vagrant). Alternatively, you can setup a container environment on GCP or AWS. It'll help packaging and test-driving the images/ pods as they're built.
Let me know if you'd like to chat real time (on Slack) about it. Thanks, Nitin On Mon, Feb 20, 2017 at 9:41 PM Ekrem Aksoy <[email protected]> wrote: > I'm also interested in this effort. How can I contribute? > > > Best, > > Ekrem > > On Tue, Feb 21, 2017 at 4:12 AM, Nitin Lamba <[email protected]> > wrote: > > > Thanks JB, Davor! > > > > Yes, the step-by-step Spark/Mesos guide will certainly help. > > > > I'll start with packaging java runner/ examples first and see how far I > > get. Will create a JIRA and should have an update in the next week or so. > > > > Best, > > Nitin > > > > On Mon, Feb 20, 2017 at 2:05 PM, Davor Bonaci <[email protected]> wrote: > > > > > I think these are great ideas for simplifying the getting started > > > experience across runners -- we'd love a contribution in this space! > > > > > > On Mon, Feb 20, 2017 at 12:46 AM, Jean-Baptiste Onofré < > [email protected]> > > > wrote: > > > > > > > Hi Nitin, > > > > > > > > It sounds like a good candidate for blog or documentation, or even an > > > > example. > > > > > > > > I have a step-by-step example of a pipeline running on Spark with > Mesos > > > > (not yet Kubernetes) if you are interested. > > > > > > > > Regards > > > > JB > > > > > > > > > > > > On 02/20/2017 08:47 AM, Nitin Lamba wrote: > > > > > > > >> Hi, > > > >> > > > >> Trying to restart this thread from last November [1]. Packaging an > > > >> end-2-end Beam example for k8s environment, similar to the one from > > the > > > >> TensorFlow team [2], may be interesting to look at. The logical > > > >> progression > > > >> is: > > > >> > > > >> - Start with an example using the local (java) runner > > > >> - Build the next one for Spark; k8s repo already has Spark v1.5.x as > > an > > > >> example [3] that can be updated/ modified > > > >> - Other runners to follow using Spark as a template > > > >> > > > >> Let me know if there is interest in pursuing/ collaborating on this. > > > >> > > > >> Thanks, > > > >> Nitin > > > >> > > > >> [1] > > > >> https://www.mail-archive.com/[email protected]. > > > org/msg00881.html > > > >> [2] https://tensorflow.github.io/serving/serving_inception > > > >> [3] https://github.com/kubernetes/kubernetes/tree/master/ > > examples/spark > > > >> > > > >> > > > > -- > > > > Jean-Baptiste Onofré > > > > [email protected] > > > > http://blog.nanthrax.net > > > > Talend - http://www.talend.com > > > > > > > > > >
