Hi Nikita,
This question will get a better response as an issue at the batchspawner
GitHub repo: https://github.com/jupyterhub/batchspawner/issues
If you create an issue report there with this information, the appropriate
developers (including myself) will see it and give you a response as soon
as they are able.
Thanks,
Michael
On Fri, Nov 9, 2018, 8:54 AM Nikita Balashov <balashov.nik...@gmail.com
wrote:
> Hi,
>
> I'm trying to make batchspawner work with HTCondor but I'm stuck with the
> following error:
>
> [I 2018-11-09 13:35:39.816 JupyterHub batchspawner:242] Spawner
> submitting job using sudo -i -u testuser condor_submit
> [I 2018-11-09 13:35:39.816 JupyterHub batchspawner:243] Spawner submitted
> script:
>
> Executable = /bin/sh
> RequestMemory = 4gb
> RequestCpus = 1
> Arguments = "-c 'exec batchspawner-singleuser --ip=""0.0.0.0""'"
> Remote_Initialdir = /home/testuser
> Output = /home/testuser/.jupyterhub.condor.out
> Error = /home/testuser/.jupyterhub.condor.err
> ShouldTransferFiles = False
> GetEnv = True
> Universe = vanilla
> Queue
>
> [I 2018-11-09 13:35:40.119 JupyterHub batchspawner:246] Job submitted. cmd
> : sudo -i -u testuser condor_submit output: Submitting job(s).
> 1 job(s) submitted to cluster 19.
> [D 2018-11-09 13:35:40.120 JupyterHub batchspawner:269] Spawner querying
> job: sudo -i -u testuser condor_q 19 -format "%s, " JobStatus -format "%s,
> " RemoteHost -format "
> " True
> [E 2018-11-09 13:35:40.356 JupyterHub batchspawner:215] Subprocess
> returned exitcode 1
> [E 2018-11-09 13:35:40.357 JupyterHub batchspawner:216] Stdout:
> [E 2018-11-09 13:35:40.357 JupyterHub batchspawner:217] b''
> [E 2018-11-09 13:35:40.357 JupyterHub batchspawner:218] Stderr:
> [E 2018-11-09 13:35:40.357 JupyterHub batchspawner:219] Error: -format
> requires format and attribute parameters
> [E 2018-11-09 13:35:40.357 JupyterHub batchspawner:274] Error querying
> job 19
> [W 2018-11-09 13:35:40.358 JupyterHub batchspawner:372] Job neither
> pending nor running.
>
> [E 2018-11-09 13:35:40.359 JupyterHub user:477] Unhandled error starting
> testuser's server: The Jupyter batch job has disappeared while pending in
> the queue or died immediately after starting.
> [D 2018-11-09 13:35:40.373 JupyterHub user:578] Deleting oauth client
> jupyterhub-user-testuser
> [E 2018-11-09 13:35:40.410 JupyterHub web:1670] Uncaught exception GET
> /hub/user/testuser/ (159.93.40.25)
> HTTPServerRequest(protocol='http', host='jupyterhub.jinr.ru', method='
> GET', uri='/hub/user/testuser/', version='HTTP/1.1', remote_ip='159.93.
> 40.25')
> Traceback (most recent call last):
> File
> "/usr/share/anaconda3/lib/python3.7/site-packages/tornado/web.py", line
> 1592, in _execute
> result = yield result
> File
> "/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/handlers/base.py",
> line 1052, in get
> await self.spawn_single_user(user)
> File
> "/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/handlers/base.py",
> line 705, in spawn_single_user
> timedelta(seconds=self.slow_spawn_timeout), finish_spawn_future
> File
> "/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/handlers/base.py",
> line 626, in finish_user_spawn
> await spawn_future
> File
> "/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/user.py", line
> 489, in spawn
> raise e
> File
> "/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/user.py", line
> 409, in spawn
> url = await
> gen.with_timeout(timedelta(seconds=spawner.start_timeout), f)
> File
> "/usr/share/anaconda3/lib/python3.7/site-packages/batchspawner/batchspawner.py",
> line 373, in start
> raise RuntimeError('The Jupyter batch job has disappeared'
> RuntimeError: The Jupyter batch job has disappeared while pending in
> the queue or died immediately after starting.
>
> The condor_q command succeeds if ran manually:
> # sudo -i -u testuser condor_q 19 -format "%s, " JobStatus -format "%s, "
> RemoteHost -format "\n" True
> 1,
>
> # echo $?
> 0
>
> I'm using the latest batchspawner (from the master):
> # pip list |grep batchspawner
> batchspawner 0.9.0.dev0
>
> And the spawner configuration:
> c.JupyterHub.spawner_class = 'batchspawner.CondorSpawner'
> c.Spawner.http_timeout = 120
>
> c.BatchSpawnerBase.req_nprocs = '1'
> c.BatchSpawnerBase.req_memory = '1gb'
> c.BatchSpawnerBase.req_runtime = '12:00:00'
>
> c.CondorSpawner.exec_prefix = 'sudo -i -u {username}'
>
> What can be the cause of this error?
>
> Thanks,
> Nikita Balashov
>
> --
> You received this message because you are subscribed to the Google Groups
> "Project Jupyter" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to jupyter+unsubscr...@googlegroups.com.
> To post to this group, send email to jupyter@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/jupyter/c7891051-3231-4cab-894e-9af3a9c129fa%40googlegroups.com
> <https://groups.google.com/d/msgid/jupyter/c7891051-3231-4cab-894e-9af3a9c129fa%40googlegroups.com?utm_medium=email&utm_source=footer>
> .
> For more options, visit https://groups.google.com/d/optout.
>
--
You received this message because you are subscribed to the Google Groups
"Project Jupyter" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to jupyter+unsubscr...@googlegroups.com.
To post to this group, send email to jupyter@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/jupyter/CAPuy8gpZZbytyoYSwHWo6LJckjAtd-0ghqX7fTuMs_a7Nk3xHg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
