[X2Go-User] x2go: Unable to find free display port or insert new session into database (revisited)
I found some good information here https://unix.stackexchange.com/questions/467507/x2go-unable-to-find-free-display-port-or-insert-new-session-into-database but "x2godbadmin --recreate" is not working for me. I removed every package I could think of that might be interfering and purged them (x2go*, xorg*, nvidia, cuda, xvfb, ...) then reinstalled with no luck any time I try and connect I get Unable to find free display port or insert new session into database message. I am using ubuntu 16.04 I can not find what is preventing it on this one system. How can I enable more debugging so I can figure out what is going wrong? Jan 21 16:12:46 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 1). Jan 21 16:12:47 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 2). Jan 21 16:12:48 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 3). Jan 21 16:12:49 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 4). Jan 21 16:12:50 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 5). Jan 21 16:12:50 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 6). Jan 21 16:12:51 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 7). Jan 21 16:12:52 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 8). Jan 21 16:12:53 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 9). Jan 21 16:12:54 euler /usr/bin/x2gostartagent: unable to insert display port into database. Retrying (run 10). Jan 21 16:12:54 euler /usr/bin/x2gostartagent: Unable to find free display port or insert new session into database; parameters: port (51), hostname (euler) and session name (jsadowski-51-1579648373_stDXFCE_dp24). It seems I am missing a package or more and I can not figure out which ones. ___ x2go-user mailing list x2go-user@lists.x2go.org https://lists.x2go.org/listinfo/x2go-user
Re: [X2Go-User] x2gobroker with broker-session-autologin: client tries to login with local username instead of given one
Nervemind... I am just banging my head on the table right now! The option "user=" in the sessionprofile overrides the given username, of course. I didn't saw it for days. The credentials are fine without it. I still can't login, sshd saying "Allocating a pty not permitted for this connection", but this is another problem, I think with sshd/pam. Sorry for the inconveniences! Best regards Martin Lange ___ x2go-user mailing list x2go-user@lists.x2go.org https://lists.x2go.org/listinfo/x2go-user
Re: [X2Go-User] Long-running x2goagent, high memory usage
On Tue, Jan 21, 2020 at 11:24 AM Johannes Töger wrote: > > Great, I see in the blog that you did a lot of work on fixing memory leaks. > I'll try to install the .22 version. > > But isn't it strange that I can't find or have an nx-libs package installed? > What's going on there? Is the packaging for Ubuntu 18.04 LTS done in some > other way? No, this is a mistake from my side. The project is called nx-libs and produces a number of packages. You can replace the relevant x2go packages by the arctica ones. Uli ___ x2go-user mailing list x2go-user@lists.x2go.org https://lists.x2go.org/listinfo/x2go-user
Re: [X2Go-User] Long-running x2goagent, high memory usage
Great, I see in the blog that you did a lot of work on fixing memory leaks. I'll try to install the .22 version. But isn't it strange that I can't find or have an nx-libs package installed? What's going on there? Is the packaging for Ubuntu 18.04 LTS done in some other way? — Johannes Töger Associate Senior Lecturer Cardiac MR Group Department of Clinical Sciences Lund, Clinical Physiology Lund University, Sweden -Original Message- From: Ulrich Sibiller Sent: Tuesday, January 21, 2020 10:39 To: Johannes Töger Cc: x2go-user@lists.x2go.org Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage On Tue, Jan 21, 2020 at 9:39 AM Johannes Töger wrote: > > OK, thanks. > > Sending the answers again, maybe they were cut by the mailing list before. I have now found it, don't know how I managed to miss it. Sorry. > Question: What version of x2goagent resp. nxagent are you using? dpkg -l > nx-libs? > > Answer: > dpkg -l nx-libs: no packages found <--- this seems strange? > x2goserver-x2goagent 4.1.0.3-0~1708~ubuntu1 amd64 nxagent > 2:3.5.99.20-0~20190425 amd64 Ok, we are at 3.5.99.22 at the moment (see https://sunweavers.net/blog/node/97) and close to 3.5.99.23 although x2go is not having packages for that yet. So please try http://packages.arctica-project.org/ubuntu/pool/main/n/nx-libs/ (do not use the current nightlies, they miss a patch which fixes regular crashes) Uli > > > Question: Can you please run xrestop within such a session and check if there > are numbers that are far away from those of a fresh session? > Answer: Nothing out of the ordinary there I think. No processes with high > memory usage. > > > Question: You probably cannot answer that due to your usage scenario, but > anyway: does this also happen when you do not disconnect/reconnect? > Answer: I don't know. I started logging the memory usage over time, so when > the problem arises next time I can correlate with log events and ask the > users what they have been doing at certain times etc. > > > Question: What are you running inside the session?fdasfafad > Answer: No real pattern here for good and bad sessions. Matlab, > Python/machine learning stuff, NVIDIA CUDA-accelerated machine learning > programs etc. Maybe a browser here and there to look up stuff (Firefox). > > > — > Johannes Töger > > Associate Senior Lecturer > Cardiac MR Group > Department of Clinical Sciences Lund, Clinical Physiology Lund > University, Sweden > > > -Original Message- > From: Ulrich Sibiller > Sent: Monday, January 20, 2020 15:45 > To: Johannes Töger > Cc: x2go-user@lists.x2go.org > Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage > > Sorry, I forgot to check, but probably not today. But can you please answer > my questions in the meantime? > > Basically you must replace the x2go binary with a little wrapper that use > valgrind to start the original binary with the original arguments. > > Uli > > On Mon, Jan 20, 2020 at 2:26 PM Johannes Töger > wrote: > > > > I have now set up a logging of the memory use over time. I hope this will > > give some data so we can understand the error. Hopefully I can correlate > > the memory use increase with user actions. > > > > Ulrich, were you able to figure out if x2go can be run with valgrind? > > > > — > > Johannes Töger > > > > Associate Senior Lecturer > > Cardiac MR Group > > Department of Clinical Sciences Lund, Clinical Physiology Lund > > University, Sweden > > > > -Original Message- > > From: x2go-user On Behalf Of > > Johannes Töger > > Sent: Friday, January 17, 2020 16:28 > > To: Ulrich Sibiller > > Cc: x2go-user@lists.x2go.org > > Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage > > > > Thanks for quick reply. > > > > Answers to your questions below. I hope it gives some clue. Please let me > > know what else I can try. > > > > > > > > What version of x2goagent resp. nxagent are you using? dpkg -l nx-libs? > > > > dpkg -l nx-libs: no packages found <--- this seems strange? > > > > x2goserver-x2goagent 4.1.0.3-0~1708~ubuntu1 amd64 > > nxagent 2:3.5.99.20-0~20190425 amd64 > > > > Can you please run xrestop within such a session and check if there are > > numbers that are far away from those of a fresh session? > > > > Nothing out of the ordinary there I think. No processes with high > > memory usage. > > > > You probably cannot answer that due to your usage scenario, but > > anyway: does this also happen when you do not disconnect/reconnect? > > > > I'll try to think of a way to test this. > > > > What are you running inside the session? > > > > No real pattern here for good and bad sessions. Matlab, > > Python/machine learning stuff, NVIDIA CUDA-accelerated machine learning > > programs etc. > > > > — > > Johannes Töger > > > > Associate Senior Lecturer > > Cardiac MR Group > > Department of Clinical Sciences Lund, Clinical Physiology Lund > > University,
Re: [X2Go-User] Long-running x2goagent, high memory usage
On Tue, Jan 21, 2020 at 9:39 AM Johannes Töger wrote: > > OK, thanks. > > Sending the answers again, maybe they were cut by the mailing list before. I have now found it, don't know how I managed to miss it. Sorry. > Question: What version of x2goagent resp. nxagent are you using? dpkg -l > nx-libs? > > Answer: > dpkg -l nx-libs: no packages found <--- this seems strange? > x2goserver-x2goagent 4.1.0.3-0~1708~ubuntu1 amd64 > nxagent 2:3.5.99.20-0~20190425 amd64 Ok, we are at 3.5.99.22 at the moment (see https://sunweavers.net/blog/node/97) and close to 3.5.99.23 although x2go is not having packages for that yet. So please try http://packages.arctica-project.org/ubuntu/pool/main/n/nx-libs/ (do not use the current nightlies, they miss a patch which fixes regular crashes) Uli > > > Question: Can you please run xrestop within such a session and check if there > are numbers that are far away from those of a fresh session? > Answer: Nothing out of the ordinary there I think. No processes with high > memory usage. > > > Question: You probably cannot answer that due to your usage scenario, but > anyway: does this also happen when you do not disconnect/reconnect? > Answer: I don't know. I started logging the memory usage over time, so when > the problem arises next time I can correlate with log events and ask the > users what they have been doing at certain times etc. > > > Question: What are you running inside the session?fdasfafad > Answer: No real pattern here for good and bad sessions. Matlab, > Python/machine learning stuff, NVIDIA CUDA-accelerated machine learning > programs etc. Maybe a browser here and there to look up stuff (Firefox). > > > — > Johannes Töger > > Associate Senior Lecturer > Cardiac MR Group > Department of Clinical Sciences Lund, Clinical Physiology > Lund University, Sweden > > > -Original Message- > From: Ulrich Sibiller > Sent: Monday, January 20, 2020 15:45 > To: Johannes Töger > Cc: x2go-user@lists.x2go.org > Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage > > Sorry, I forgot to check, but probably not today. But can you please answer > my questions in the meantime? > > Basically you must replace the x2go binary with a little wrapper that use > valgrind to start the original binary with the original arguments. > > Uli > > On Mon, Jan 20, 2020 at 2:26 PM Johannes Töger > wrote: > > > > I have now set up a logging of the memory use over time. I hope this will > > give some data so we can understand the error. Hopefully I can correlate > > the memory use increase with user actions. > > > > Ulrich, were you able to figure out if x2go can be run with valgrind? > > > > — > > Johannes Töger > > > > Associate Senior Lecturer > > Cardiac MR Group > > Department of Clinical Sciences Lund, Clinical Physiology Lund > > University, Sweden > > > > -Original Message- > > From: x2go-user On Behalf Of > > Johannes Töger > > Sent: Friday, January 17, 2020 16:28 > > To: Ulrich Sibiller > > Cc: x2go-user@lists.x2go.org > > Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage > > > > Thanks for quick reply. > > > > Answers to your questions below. I hope it gives some clue. Please let me > > know what else I can try. > > > > > > > > What version of x2goagent resp. nxagent are you using? dpkg -l nx-libs? > > > > dpkg -l nx-libs: no packages found <--- this seems strange? > > > > x2goserver-x2goagent 4.1.0.3-0~1708~ubuntu1 amd64 > > nxagent 2:3.5.99.20-0~20190425 amd64 > > > > Can you please run xrestop within such a session and check if there are > > numbers that are far away from those of a fresh session? > > > > Nothing out of the ordinary there I think. No processes with high > > memory usage. > > > > You probably cannot answer that due to your usage scenario, but > > anyway: does this also happen when you do not disconnect/reconnect? > > > > I'll try to think of a way to test this. > > > > What are you running inside the session? > > > > No real pattern here for good and bad sessions. Matlab, > > Python/machine learning stuff, NVIDIA CUDA-accelerated machine learning > > programs etc. > > > > — > > Johannes Töger > > > > Associate Senior Lecturer > > Cardiac MR Group > > Department of Clinical Sciences Lund, Clinical Physiology Lund > > University, Sweden > > > > -Original Message- > > From: Ulrich Sibiller > > Sent: Friday, January 17, 2020 13:25 > > To: Johannes Töger > > Cc: x2go-user@lists.x2go.org > > Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage > > > > On Fri, Jan 17, 2020 at 11:56 AM Johannes Töger > > wrote: > > > We are using x2go for a common compute server at our department. We have > > > users both on the local LAN and connections to the other side of Europe > > > that work really well. Being able to close the client and have > > > computations still running in a GUI environment is great. > > > > > > However, I think we have
Re: [X2Go-User] Long-running x2goagent, high memory usage
OK, thanks. Sending the answers again, maybe they were cut by the mailing list before. Question: What version of x2goagent resp. nxagent are you using? dpkg -l nx-libs? Answer: dpkg -l nx-libs: no packages found <--- this seems strange? x2goserver-x2goagent 4.1.0.3-0~1708~ubuntu1 amd64 nxagent 2:3.5.99.20-0~20190425 amd64 Question: Can you please run xrestop within such a session and check if there are numbers that are far away from those of a fresh session? Answer: Nothing out of the ordinary there I think. No processes with high memory usage. Question: You probably cannot answer that due to your usage scenario, but anyway: does this also happen when you do not disconnect/reconnect? Answer: I don't know. I started logging the memory usage over time, so when the problem arises next time I can correlate with log events and ask the users what they have been doing at certain times etc. Question: What are you running inside the session?fdasfafad Answer: No real pattern here for good and bad sessions. Matlab, Python/machine learning stuff, NVIDIA CUDA-accelerated machine learning programs etc. Maybe a browser here and there to look up stuff (Firefox). — Johannes Töger Associate Senior Lecturer Cardiac MR Group Department of Clinical Sciences Lund, Clinical Physiology Lund University, Sweden -Original Message- From: Ulrich Sibiller Sent: Monday, January 20, 2020 15:45 To: Johannes Töger Cc: x2go-user@lists.x2go.org Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage Sorry, I forgot to check, but probably not today. But can you please answer my questions in the meantime? Basically you must replace the x2go binary with a little wrapper that use valgrind to start the original binary with the original arguments. Uli On Mon, Jan 20, 2020 at 2:26 PM Johannes Töger wrote: > > I have now set up a logging of the memory use over time. I hope this will > give some data so we can understand the error. Hopefully I can correlate the > memory use increase with user actions. > > Ulrich, were you able to figure out if x2go can be run with valgrind? > > — > Johannes Töger > > Associate Senior Lecturer > Cardiac MR Group > Department of Clinical Sciences Lund, Clinical Physiology Lund > University, Sweden > > -Original Message- > From: x2go-user On Behalf Of > Johannes Töger > Sent: Friday, January 17, 2020 16:28 > To: Ulrich Sibiller > Cc: x2go-user@lists.x2go.org > Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage > > Thanks for quick reply. > > Answers to your questions below. I hope it gives some clue. Please let me > know what else I can try. > > > > What version of x2goagent resp. nxagent are you using? dpkg -l nx-libs? > > dpkg -l nx-libs: no packages found <--- this seems strange? > > x2goserver-x2goagent 4.1.0.3-0~1708~ubuntu1 amd64 > nxagent 2:3.5.99.20-0~20190425 amd64 > > Can you please run xrestop within such a session and check if there are > numbers that are far away from those of a fresh session? > > Nothing out of the ordinary there I think. No processes with high > memory usage. > > You probably cannot answer that due to your usage scenario, but > anyway: does this also happen when you do not disconnect/reconnect? > > I'll try to think of a way to test this. > > What are you running inside the session? > > No real pattern here for good and bad sessions. Matlab, > Python/machine learning stuff, NVIDIA CUDA-accelerated machine learning > programs etc. > > — > Johannes Töger > > Associate Senior Lecturer > Cardiac MR Group > Department of Clinical Sciences Lund, Clinical Physiology Lund > University, Sweden > > -Original Message- > From: Ulrich Sibiller > Sent: Friday, January 17, 2020 13:25 > To: Johannes Töger > Cc: x2go-user@lists.x2go.org > Subject: Re: [X2Go-User] Long-running x2goagent, high memory usage > > On Fri, Jan 17, 2020 at 11:56 AM Johannes Töger > wrote: > > We are using x2go for a common compute server at our department. We have > > users both on the local LAN and connections to the other side of Europe > > that work really well. Being able to close the client and have computations > > still running in a GUI environment is great. > > > > However, I think we have encountered a bug. Some (but not all) of the > > long-running x2goagent processes start taking a lot of memory, ~30 GB. This > > adds up quickly so that the other users can’t do their work. Below you can > > see how user3 and user7 have x2goagent processes with large memory use (RSS > > column). > > > > How can I go about debugging this? I have quite a bit of Linux experience, > > but I don’t know where to start on this one since I don’t know much about > > how x2go works internally. > > > > Server is on Ubuntu Server 18.04.1 LTS, (x2goserver > > 4.1.0.3-0~1708~ubuntu18.04.1). Clients are on Windows 10, version. 4.1.2.0. > > > > johannes@compute-server:~$ ps -o
