Hi Greg, Is it possible to share the set-up?
On Monday, 27 June 2016 12:46:26 UTC+1, Gerg wrote: > > Hi Deepak- > > We are not there yet, but information that min provided will be helpful in > setting up HUB. > We will update you once we have something > > Thanks > > On Friday, June 24, 2016 at 6:38:25 AM UTC-4, Deepak Subhramanian wrote: >> >> We are also trying to get Jupyter working with Kerberized cluster. Did >> anyone managed to get it working ? >> >> On Thursday, 16 June 2016 05:58:17 UTC-7, Min RK wrote: >>> >>> I’m afraid that I don’t know too much about Kerberos, but it should be >>> doable with the right custom Authenticator and/or Spawner. The JHU setup >>> <https://git.acm.jhu.edu/jhuacm/jhuacm_jupyterhub/tree/master> Carol >>> linked to is probably the place to start. If you have IT folks who know the >>> moving parts for your Kerberos setup, then we should be able to work it >>> out. Here are the pieces of information you need: >>> >>> 1. How do users authenticate? From the looks of the JHU setup, PAM >>> authentication will work. >>> 2. How do notebook server processes need to be started? In the JHU >>> setup, they use sshpass to localhost to start a session for each >>> user. >>> 3. What information needs to be passed to the notebook server and/or >>> kernel processes for a given user? Sometimes environment variables >>> and/or >>> certificate files need to be loaded. The Spawner can do this, as long as >>> you tell it what it needs. >>> >>> With a bit more details, we should be able to have you up and running. >>> >>> -MinRK >>> >>> >>> >>> On Thu, Jun 16, 2016 at 2:31 PM, Gerg <[email protected]> wrote: >>> >>>> Carol- >>>> >>>> I really appreciate that Carol. >>>> Our data scientists are really waiting on getting there favorite >>>> notebook work with our new kerborised setup. Thanks Carol >>>> >>>> Gerg >>>> >>>> >>>> On Wednesday, June 15, 2016 at 3:14:46 PM UTC-4, Carol Willing wrote: >>>>> >>>>> Hi Greg, >>>>> >>>>> Min, the JupyterHub lead dev, is traveling this week. I'm copying him >>>>> on this message since he may have more insights on JupyterHub/Jupyter >>>>> with >>>>> Kerberos. >>>>> >>>>> Carol >>>>> >>>>> --- >>>>> Carol Willing >>>>> >>>>> Research Software Engineer >>>>> Project Jupyter @ Cal Poly SLO >>>>> >>>>> Director, Python Software Foundation >>>>> >>>>> On Jun 15 2016, at 1:22 pm, Gerg <[email protected]> wrote: >>>>> >>>>>> Hi Carol- >>>>>> >>>>>> Thanks for your reply. >>>>>> It looks like there is no much information for jupyter to work with >>>>>> kerberos. >>>>>> >>>>>> Thanks >>>>>> Gerg >>>>>> >>>>>> On Monday, June 13, 2016 at 10:13:05 AM UTC-4, Carol Willing wrote: >>>>>> >>>>>> Hello Gerg, >>>>>> >>>>>> I'm hoping that others will jump in with information about using >>>>>> Kerberos. >>>>>> >>>>>> A thread from earlier this year on Kerberos: >>>>>> >>>>>> https://groups.google.com/forum/#!searchin/jupyter/kerberos/jupyter/Vfzpx0QstLk/g69c0BpXBwAJ >>>>>> >>>>>> <https://groups.google.com/forum/#!searchin/jupyter/kerberos/jupyter/Vfzpx0QstLk/g69c0BpXBwAJ&r=anVweXRlckBnb29nbGVncm91cHMuY29t> >>>>>> >>>>>> Within that thread (Apr 27 message from Mark Rosen), there is a >>>>>> configuration that is being used at JHU. >>>>>> >>>>>> Here's also a message from Min that talks about a custom >>>>>> authenticator that would use Authenticator.pre_spawn_start and >>>>>> Authenticator.post_spawn_stop that should be helpful as well: >>>>>> http://permalink.gmane.org/gmane.comp.programming.jupyter/2545 >>>>>> <http://permalink.gmane.org/gmane.comp.programming.jupyter/2545&r=anVweXRlckBnb29nbGVncm91cHMuY29t> >>>>>> >>>>>> Carol >>>>>> >>>>>> --- >>>>>> Carol Willing >>>>>> >>>>>> Research Software Engineer >>>>>> Project Jupyter @ Cal Poly SLO >>>>>> >>>>>> Director, Python Software Foundation >>>>>> >>>>>> On Jun 13 2016, at 5:33 am, Gerg <[email protected]> wrote: >>>>>> >>>>>> Hello Guys- >>>>>> >>>>>> We are really happy with jupyter for our data scientists. But >>>>>> recently we kerberized our cluster (HDP 2.4.0), and we couldn't find any >>>>>> article or threads in this group on how to setup jupyter for a >>>>>> kerberized >>>>>> cluster. >>>>>> Basically we will be running pyspark jobs(yarn mode) from our >>>>>> notebook. is this ever possible with Jupyter on a kerberized cluster? >>>>>> I would really appreciate if someone can help me with the steps in >>>>>> configuring jupyter for our kerberized cluster or direct me to any >>>>>> article >>>>>> which describes that. >>>>>> >>>>>> Thanks in advance for any help. >>>>>> >>>>>> Gerg >>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Project Jupyter" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> To post to this group, send email to [email protected]. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/jupyter/e641ffcb-36ed-4bfe-b694-a4ec3b044be8%40googlegroups.com >>>>>> >>>>>> <https://groups.google.com/d/msgid/jupyter/e641ffcb-36ed-4bfe-b694-a4ec3b044be8%40googlegroups.com?utm_medium=email&utm_source=footer&r=anVweXRlckBnb29nbGVncm91cHMuY29t> >>>>>> . >>>>>> For more options, visit https://groups.google.com/d/optout >>>>>> <https://groups.google.com/d/optout&r=anVweXRlckBnb29nbGVncm91cHMuY29t> >>>>>> . >>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups "Project Jupyter" group. >>>>>> To unsubscribe from this group and stop receiving emails from it, >>>>>> send an email to [email protected]. >>>>>> To post to this group, send email to [email protected]. >>>>>> To view this discussion on the web visit >>>>>> https://groups.google.com/d/msgid/jupyter/bbd5e7c8-c270-4191-9803-67a041434a4a%40googlegroups.com >>>>>> >>>>>> <https://groups.google.com/d/msgid/jupyter/bbd5e7c8-c270-4191-9803-67a041434a4a%40googlegroups.com?utm_medium=email&utm_source=footer&r=anVweXRlckBnb29nbGVncm91cHMuY29t> >>>>>> . >>>>>> For more options, visit https://groups.google.com/d/optout >>>>>> <https://groups.google.com/d/optout&r=anVweXRlckBnb29nbGVncm91cHMuY29t> >>>>>> . >>>>>> >>>>> >>> -- You received this message because you are subscribed to the Google Groups "Project Jupyter" group. To unsubscribe from this group and stop receiving emails from it, send an email to [email protected]. To post to this group, send email to [email protected]. To view this discussion on the web visit https://groups.google.com/d/msgid/jupyter/af5d38e1-1948-42ab-ab83-f99e617f8414%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
