Hi,
I'm trying to make batchspawner work with HTCondor but I'm stuck with the
following error:
[I 2018-11-09 13:35:39.816 JupyterHub batchspawner:242] Spawner submitting
job using sudo -i -u testuser condor_submit
[I 2018-11-09 13:35:39.816 JupyterHub batchspawner:243] Spawner submitted
script:
Executable = /bin/sh
RequestMemory = 4gb
RequestCpus = 1
Arguments = "-c 'exec batchspawner-singleuser --ip=""0.0.0.0""'"
Remote_Initialdir = /home/testuser
Output = /home/testuser/.jupyterhub.condor.out
Error = /home/testuser/.jupyterhub.condor.err
ShouldTransferFiles = False
GetEnv = True
Universe = vanilla
Queue
[I 2018-11-09 13:35:40.119 JupyterHub batchspawner:246] Job submitted. cmd:
sudo -i -u testuser condor_submit output: Submitting job(s).
1 job(s) submitted to cluster 19.
[D 2018-11-09 13:35:40.120 JupyterHub batchspawner:269] Spawner querying job
: sudo -i -u testuser condor_q 19 -format "%s, " JobStatus -format "%s, "
RemoteHost -format "
" True
[E 2018-11-09 13:35:40.356 JupyterHub batchspawner:215] Subprocess returned
exitcode 1
[E 2018-11-09 13:35:40.357 JupyterHub batchspawner:216] Stdout:
[E 2018-11-09 13:35:40.357 JupyterHub batchspawner:217] b''
[E 2018-11-09 13:35:40.357 JupyterHub batchspawner:218] Stderr:
[E 2018-11-09 13:35:40.357 JupyterHub batchspawner:219] Error: -format
requires format and attribute parameters
[E 2018-11-09 13:35:40.357 JupyterHub batchspawner:274] Error querying job
19
[W 2018-11-09 13:35:40.358 JupyterHub batchspawner:372] Job neither
pending nor running.
[E 2018-11-09 13:35:40.359 JupyterHub user:477] Unhandled error starting
testuser's server: The Jupyter batch job has disappeared while pending in
the queue or died immediately after starting.
[D 2018-11-09 13:35:40.373 JupyterHub user:578] Deleting oauth client
jupyterhub-user-testuser
[E 2018-11-09 13:35:40.410 JupyterHub web:1670] Uncaught exception GET
/hub/user/testuser/ (159.93.40.25)
HTTPServerRequest(protocol='http', host='jupyterhub.jinr.ru', method='
GET', uri='/hub/user/testuser/', version='HTTP/1.1', remote_ip='159.93.40.25
')
Traceback (most recent call last):
File
"/usr/share/anaconda3/lib/python3.7/site-packages/tornado/web.py", line
1592, in _execute
result = yield result
File
"/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/handlers/base.py",
line 1052, in get
await self.spawn_single_user(user)
File
"/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/handlers/base.py",
line 705, in spawn_single_user
timedelta(seconds=self.slow_spawn_timeout), finish_spawn_future
File
"/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/handlers/base.py",
line 626, in finish_user_spawn
await spawn_future
File
"/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/user.py", line
489, in spawn
raise e
File
"/usr/share/anaconda3/lib/python3.7/site-packages/jupyterhub/user.py", line
409, in spawn
url = await
gen.with_timeout(timedelta(seconds=spawner.start_timeout), f)
File
"/usr/share/anaconda3/lib/python3.7/site-packages/batchspawner/batchspawner.py",
line 373, in start
raise RuntimeError('The Jupyter batch job has disappeared'
RuntimeError: The Jupyter batch job has disappeared while pending in
the queue or died immediately after starting.
The condor_q command succeeds if ran manually:
# sudo -i -u testuser condor_q 19 -format "%s, " JobStatus -format "%s, "
RemoteHost -format "\n" True
1,
# echo $?
0
I'm using the latest batchspawner (from the master):
# pip list |grep batchspawner
batchspawner 0.9.0.dev0
And the spawner configuration:
c.JupyterHub.spawner_class = 'batchspawner.CondorSpawner'
c.Spawner.http_timeout = 120
c.BatchSpawnerBase.req_nprocs = '1'
c.BatchSpawnerBase.req_memory = '1gb'
c.BatchSpawnerBase.req_runtime = '12:00:00'
c.CondorSpawner.exec_prefix = 'sudo -i -u {username}'
What can be the cause of this error?
Thanks,
Nikita Balashov
--
You received this message because you are subscribed to the Google Groups
"Project Jupyter" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To post to this group, send email to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/jupyter/c7891051-3231-4cab-894e-9af3a9c129fa%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
