[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing) when LibreOffice is running
** Summary changed: - Xorg server uses unacceptably large amounts of memory (and keep growing) + Xorg server uses unacceptably large amounts of memory (and keep growing) when LibreOffice is running ** No longer affects: xorg-server (Ubuntu) -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) when LibreOffice is running To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/libreoffice/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
** Also affects: libreoffice (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/libreoffice/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Update 20200922 I have tested LibreOffice for a while. It did cause Xorg memory explosion again as explained below. I am excerpting my own personal notes here, please bear with the rough form of it. The graph that I will attach next will show the point. I started using a LibreOFfice program at 2020-09-06; this was a relaunch after the last comment. At timestamp = 20200921T2330, I checked Xorg memory usage tonight after leaving LibreOffice open for over 11 days: Xorg RSS became swollen to over 1 GB! xorg RSS ... 1182768 kiB The "free" status was terrible: totalusedfree shared buff/cache available Mem: 12144888 9761024 596696 710552 1787168 1353420 Swap: 1808384 1477752 330632 Three major users of Xorg memory: LibreOffice Writer ( PID:1760594 ): pixmap bytes : 334753205 1 - xfwm4 ( PID:1477670 ): pixmap bytes : 141633828 Mozilla Firefox ( PID:1816946 ): pixmap bytes : 44090522 The total of all three is ~520 MB. LibreOffice alone is eating up over 334 MB of RAM! NOTE: I did not use LibreOffice every day on this machine. But I left that program open since it was opened on Sept 6. I used the LO Writer occasionally to make notes now and then. Now I am closing the LibreOffice program, see what happened. Before LibreOffice doc was closed, the mem usage status was: LibreOffice pixmap bytes usage dropped to 286360981 (pixmap bytes) xfwm4 131834529 (pixmap bytes) firefox 44090522 (pixmap bytes) xorg RSS 1203568 kiB => misleading, too much dumped to swap! Let's close LibreOffice; after closing (time marker = 20200922T0006) the usage: xfwm4 98517409 firefox 44090522 xorg RSS 1192256 kiB A few observations: * As you can see above, xorg RSS was NOT significantly reduced even after I closed the LibreOffice. That was not the case with Firefox or with Xpra; the memory usage dropped as soon as I closed those programs. * I also remember from my past observations that *when this Xorg memory explosion occurred*, the RSS of the xorg server is way higher than the (rough) sum total of the pixmap memory consumption reported by xrestop. My fuzzy memory has it at about a factor of 4: RSS(Xorg) ~ 4x sum(pixmap bytes reported by xrestop) The example above did not quite support that though, but still, it is a factor of more than two! * I also looked at smaps: (ref: smaps-1600747980-20200922T001300.txt). That file indicates the largest memory occupied is in the heap: $ grep -e '^[0-9a-f]' -e 'Dirty' smaps-1600747980-20200922T001300.txt ... 55aa90005000-55aad31ae000 rw-p 00:00 0 [heap] Shared_Dirty: 0 kB Private_Dirty: 1078916 kB ... Now I closed Firefox as well: (after closure, timestamp: 20200922T0034) xfwm4 61755763 xorg RSS 1149028 kiB Again, it looks like firefox X pixmap memory was freed ok (xorg RSS dropped by ~50 MB), but not much lower. -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
** Attachment added: "Plot of RSS over time, produced using Jupyter notebook" https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+attachment/5413081/+files/rss-vs-time.png -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Based on my experience above, I can say with good degree of certainty that the LibreOffice was the culprit. I will restart the entire machine and try this again one more time. Wirawan -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
I have tested two applications so far... 1) firefox + MATE terminal 2) xpra + MATE terminal I'm sorry I can't not use MATE terminal because I still have to use part of the laptop for work. In either case I did not notice too significant a memory growth. Again, the memory usage numbers mentioned below are the "RSS" reported by "ps". In the case of Firefox: memory usage is approximately ~130MB (I belive this was right after Firefox was started and fully running) to over ~150 MB after 7-8 days of use. But I tried this: I closed Firefox, the memory usage dropped to below 90 MB. So at least I know that Firefox X memory seems to be released. In the case of running xpra: before xpra is running (right after X server restart), X server memory usage is about 80 MB, and it goes up to ~120-130 MB after 3 days. It dropped back to 96MB. I don't fully know why this yet. Maybe there is some leak, but I also want to note that xfwm4 is uses significant amount of X memory. In this case and previous case, I also note that the xrestop reports increasing memory usage of "xfwm4" over time. Initially when the Xserver just restarted, xfwm4 uses ~30 MB of X memory. It goes up and down, seemingly dependent on how many windows are opened. So, no conclusion yet on that end. Note: I am running gnucash (or gnucash and firefox) on the XPRA server. I tend to think that the stuff I run under XPRA will to a good degree not affect the xserver being diagnosed except by the number of windows it displays. I have currently been running libreoffice on the existing session (xpra+MateTerm) just to find out how things are. I have personally suspected libreoffice and/or vlc. So far, libreoffice seems to exhibit this apparent behavior: when I am actively using it, the X server RSS goes up. But when I leave that libreoffice window alone, the RSS does not increase. I'll have to re-test this by itself and report back. -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
** Changed in: xorg-server (Ubuntu) Status: Incomplete => New -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
While the data collection above is going on... here is a recap of the previous X session (2020-07-05 thru 2020-08-10) * Restarted X server with XFCE. * Apps used almost all the time: mostly Firefox, MATE terminal * Apps used sometimes: VLC, "xpra attach", geeqie * Apps used rarely: libreoffice I have collected a number of "ps fuxa" outputs which I distilled below only to show the VSIZE and RSS for that Xorg xserver process: ~~~ 2020-07-05 22:39:08 907048 88500 2020-07-05 22:42:24 950740129288libreoffice 2020-07-08 15:13:301199296250108libreoffice 2020-07-11 21:55:101227060277484libreoffice (vlc started after this) 2020-07-13 12:16:531217636271656vlc 2020-07-15 12:40:251234728293524vlc 2020-07-17 23:24:011906196940544vlc(163655) (2GB mem usage, terminated) 2020-07-19 20:19:162217016 1046988vlc(357305) 2020-07-20 13:09:062235980 1071448vlc 2020-07-22 13:18:052296896819008vlc 2020-07-22 13:36:042292208862640 2020-07-22 13:36:472259436860288 2020-07-22 14:07:132201380923184 2020-07-30 00:53:512257172 1153128 2020-08-02 20:57:492213628 1178836 2020-08-03 11:54:582250960 1182832vlc(793990) 2020-08-08 10:35:372493120 1526196 ~~~ Note: I also filed another bug originally against VLC--because where you saw the large memory usage above, VLC also showed memory explosion. https://bugs.launchpad.net/ubuntu/+source/mesa/+bug/1888558 Since that time it was re-attributed to MESA driver. Looking at the pattern above, there is a strong likelihood that VLC/MESA is one of the culprits for large X memory consumption. -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Brief comment. Have restarted X server 3 days ago to run pretty much just Firefox + MATE terminal. Will let you know later how this goes. So far the X server memory usage (RSS) is about 125-130MB. Which is high, but not super terrible. Usually it takes a few more days before the usage swells. Another comment, xfwm4 is using quite a bit of X pixmap memory (50-54 MB as reported by xrestop). I have 4 desktops, and the laptop display ix FHD 1920x1080. I wonder if window image caching is what causing this. When it started it measured already at 30MB. -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Will do shortly. -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Reopened because there's probably still a bug somewhere. Although this bug is now assigned to xorg-server I don't actually think Xorg is to blame. Xorg just owns the memory that applications have requested resources within. The Bug Description shows Xorg's RSS creeping over 700MB which does sound like a bug. However xrestop does not seem to explain it, as that only shows 110MB of usage. The next step here is for you to figure out exactly which app is causing the leakage. To test each app, please log out and in again, then leave just one app running overnight and nothing else. ** Changed in: xorg-server (Ubuntu) Status: Invalid => New ** No longer affects: libreoffice (Ubuntu) ** No longer affects: marco (Ubuntu) ** Changed in: xorg-server (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/xorg-server/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
** Changed in: libreoffice (Ubuntu) Status: New => Invalid -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/libreoffice/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Please ignore #6. I clicked "Post" too soon. I will complete it and re- post. ** Also affects: libreoffice (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/libreoffice/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Hi Daniel, responding to your comment: In my years of using Linux desktop (in particular, XFCE), I have never experienced memory explosion caused by Xorg server like what I described in this bug report. Please allow me to be a bit candid here. It seems like the newer versions of desktop software (which could mean one or more of these: Xorg, firefox, Libre Office, XFCE and/or MATE, ...) leads to significant bloat in memory usage. This is to the point that a very capable laptop (with >= 8 GB of RAM) would perform poorly because of memory thrashing today even when our usage pattern is not changed over the years (at least I feel so). I'll back this up below. I still have a desktop computer running Debian 8 and XFCE. Here are some stats on that running system: * up time = 31 * -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/marco/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
After such a long period of time you are likely experiencing multiple leaks from multiple apps. You would need to do exhaustive testing with a single app over a long period to narrow down which is to blame. It's probably not worth it, but maybe you can identify the most problematic apps given more time... Regardless, it sounds like the source of your leaks is not marco or Xorg. So I will mark those tasks as Invalid. But that doesn't mean this issue is closed. Feel free to add any apps you suspect to the top of this bug. ** Changed in: marco (Ubuntu) Status: Incomplete => Invalid ** Changed in: xorg-server (Ubuntu) Status: Incomplete => Invalid -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/marco/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Thanks. I am testing XFCE desktop for now. A brief comment on XFCE experience. The starting size of Xorg process under XFCE is ~100-130 MB, but after 10 days of usage with mostly Firefox & terminal windows (multiple windows for each app, and sometimes pdf viewer [atril]) it grew to 270-300 MB. I have some data collected by xrestop, ps, if you want it. Let me know what kind of data would help. In a prior session where I was still using LibreOFfice (again, with multiple windows, but nothing is a huge document or complicated doc with lots of graphics), the memory usage grew to over 800 MB usage. And xrestop indicated libreoffice was consuming nearly 200 MB of pixmap memory just before I closed it! Any direction to help narrow down the source of large memory consumption would be appreciated. Wirawan -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/marco/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
** Changed in: marco (Ubuntu) Status: New => Incomplete ** Changed in: xorg-server (Ubuntu) Status: New => Incomplete -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/marco/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
Thanks. I am testing XFCE desktop for now. Will report to you again once I can gather the stats better. -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/marco/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
[Ubuntu-x-swat] [Bug 1884850] Re: Xorg server uses unacceptably large amounts of memory (and keep growing)
I suggest trying a different desktop environment with the same apps for a while, so we can see if MATE/Marco is the main factor. ** Also affects: marco (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu-X, which is subscribed to xorg-server in Ubuntu. https://bugs.launchpad.net/bugs/1884850 Title: Xorg server uses unacceptably large amounts of memory (and keep growing) To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/marco/+bug/1884850/+subscriptions ___ Mailing list: https://launchpad.net/~ubuntu-x-swat Post to : ubuntu-x-swat@lists.launchpad.net Unsubscribe : https://launchpad.net/~ubuntu-x-swat More help : https://help.launchpad.net/ListHelp
