[Bug 1833281]

2022-03-27 Thread hi-angel
Modern kernels handle SWAPPING situations much better.

Also, these days the Multi-LRU patchset should pretty much resolve the
problem. It is not yet upstream, but is used in downstream kernels such
as linux-zen and liquorix-kernel. There is hope it will be merged by
5.19¹

1: https://www.phoronix.com/scan.php?page=news_item=MGLRU-Not-
For-5.18

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2022-01-20 Thread egorfedorovichletov
Are there any changes?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions


-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2020-12-24 Thread Kevin Wortman
I am experiencing this bug on a stock Dell Inspiron 5000 (5482) with 8
GB RAM and the factory SSD. It is completely debilitating. Having 1-2
completely unpredictable, 30-minute-plus, hard freezes per day is a
showstopper. I can't trust this environment for professional work, or
even to take notes in gedit during a phone call.

I've been an Ubuntu user and advocate at work and home for 10+ years,
but I guess I have to quit :(

I tried different flavors, and the bug manifested under all of them:
Ubuntu LTS 20.04, Ubuntu 20.10, Ubuntu MATE 20.10, and Debian 10.

Fedora 33 does not suffer from this bug, so I'm using that. I get
frequent "Gah! Your tab just crashed" errors in Firefox any time I have
more than about 5 tabs open. I conjecture there is some difference
between the Redhat-based and Debian-based kernels, that causes the
Redhat-based ones to kill a tab process in the circumstance that causes
the Debian-based ones to lock up. The Fedora experience is acceptable,
though it's still disappointing that Linux performance is has regressed
to be inadequate for basic web browsing.

Takeaway: Fedora seems to be an acceptable workaround for people
experiencing this bug.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2020-09-23 Thread admin
@lou +1

Sorry for my Google translate.


This bug is very many years old. This is *Bug 12309* !!! Why didn't anyone 
remember?


I'm tired of him. Was in the early 2010s for 512 MB of RAM. Was in the early 
2010s for 512 MB of RAM. and 2 GB of RAM. Mid 2010s with 4GB of RAM. And for 
the past five years, 16 GB of RAM has not gone anywhere.


There is a funny article in Russian about this bug lurkmore.to/12309 with links 
to the original bug reports and "problem solutions" in each new kernel. 
"According to the anonymous author, this useful feature is LOVE AND CAREFULLY 
into a fresh kernel."


Earlier I tried to rebuild kernels according to the advice on the Internet 
(BFQ). Sometimes it helped a little. Some assemblies gave time to urgently 
close programs. But the most effective was vm.swappiness = 90 and a script with 
a notification when approaching this value to clean up memory (conky + dialog).

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2020-03-31 Thread Kai-Heng Feng
Possible duplicate of LP: #1861359.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2020-03-30 Thread russianneuromancer
On HP Stream 7 Tablet (1GB RAM) there was similar regression, but it
started since Linux 4.12 instead of 4.10. Last year I tried bisect and
several workarounds such as autostart cleanup, sysctl tweaks, zram, etc.
But in the end it's seems like Linux 5.5.8 solved issue, at least in
this particular use-case (device with 1GB RAM) 5.5.8 makes swapping
perform like it was with 4.11.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2020-03-30 Thread bugzilla
Another resource, quite long but has a tl;dr, and reviewed by some of the 
cgroups/resource control folks:
https://chrisdown.name/2018/01/02/in-defence-of-swap.html

I'll use somewhat technically sloppy language, but hopefully a useful
metaphor: there's incidental swap and heavy swap. Incidental swap is
when some file or anonymous page really isn't needed, and it's good to
evict it to free up memory. But in the case of heavy swap (or even
reclaim), not at all incidental, it becomes a serious performance
impediment. The reality is that there are some tasks that just take gobs
of memory and swap isn't a good substitute. But some swap is useful for
freeing up memory for things that need to stay in memory.

I'm finding for the incidental swap need, swap-on-ZRAM is quite useful.
You are exchanging an IO bound task for a memory+CPU task; also it
forces such pages to be pinned into memory. So there's no free lunch.
Conservative use would be a ZRAM device around 1/4 of RAM up to a max of
50% RAM. It's not bad or wrong to use more, it's just that some
workloads, like the webkitgtk example, have such significant need that
it'll actually turn 1/2 of memory into swap, which in effect means you
have 50% less RAM for that task. It actually makes the problem worse.
Really, the near term is a) build with flags that cause fewer resources
to be used in the firist place, or b) build in a systemd user session
and limit resources that way, or c) buy more RAM, or d) use conventional
swap partition, possibly with zswap to leave the most frequent pages in
a small RAM cache pool, that's big enough for the task to eventually
complete and just suffer with the ensuing lack of GUI responsiveness.

Anyway, it's a bit complicated. And lots of moving parts. And probably
needs more sophisticate use of perf and maybe even bpf could be useful
in figuring where the various bottlenecks are.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2020-03-30 Thread bugzilla
I primarily test by building webkitgtk [1], and I experience the same loss of 
system responsiveness whether / is ext4 or Btrfs. But I do see a difference in 
top and iotop.
https://drive.google.com/open?id=12jpQeskPsvHmfvDjWSPOwIWSz09JIUlk

This is an extreme case of refaulting, it's out of memory and swap, and
since kswapd and btrfs threads are using a lot of CPU I'm guessing the
faults are a mix of anonymous pages and file pages. At this point the
system is really lost which is why the UX is the same with ext4 and
btrfs; but behind the scenes it does seem more is going on. There might
be other workloads which aren't as extreme, thereby exposing the
difference. Two possible sources of the heavy CPU for btrfs threads:
decompression, and checksumming. If it's true there is near constant
reclaim happening, it's not just a simple minimum 4K read but rather a
128K minimum because all Btrfs compressed files use 128K extent size; is
then decompressed, and then requires reading csum tree and computing
csum on the read to compare. Ordinarily this is cheap but in this
situation possibly it's resulting in a lot of extra congestion, but this
is the limit of my knowledge so it's just speculation.

Btrfs write amplification is a known issue (wandering trees problem).
But that appears to not be the issue in this example.

It might be this problem is better dealt with by cgroupsv2 to protect certain 
tasks from reclaim, and thus reduce the problem on any file system. But Btrfs 
alone (for now) does have more sophisticated cgroupvs2 IO isolation control as 
well.
https://www.spinics.net/lists/cgroups/msg24743.html

The upstream GNOME and KDE developers are aware of the loss of responsiveness 
problem and have done quite a lot of preliminary work in GNOME 3.34 with more 
work on the way.
https://blogs.gnome.org/benzea/2019/10/01/gnome-3-34-is-now-managed-using-systemd/

You can today take advantage of this cgroupsv2 work by running resource hungry 
tasks as a systemd user unit in Fedora 31.
https://blogs.gnome.org/benzea/2019/10/01/gnome-3-34-is-now-managed-using-systemd/#comment-14833

I expect in the next 6-12 months (it's a guesstimate) there will be
additional work in GNOME to protect the user session or what I vaguely
call the "GUI stack" from reclaim, and thus improve its responsiveness
at the expense of the resource hungry process.


[1] first two lines; set -j to RAM in GiB +2 GiB; i.e. if you have 8G RAM, use 
-j 10; more jobs makes the problem happen faster.
https://trac.webkit.org/wiki/BuildingGtk

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2020-03-30 Thread russianneuromancer
Christoph, your issue is different. Please fill separate bugreport.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2020-03-26 Thread Corben
It seems that zram mitigates the problem for me during a work day. As long as 
the system doesn't have to write swap to the disk, it seems fine. The longer I 
use the system, the sooner it is running out of (z)ram and swapping also to 
disk. As soon as this happens, I get these freezes again. I have the feeling, 
that the amount of swapped out data that is swapped at once is causing this. 
Seems like I/O is blocking to me.
I have the impression with a previous kernel, the blocks have been smaller so 
the system didn't block too long so it didn't really interrupt work.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2020-02-12 Thread Nico R
Can confirm this on Kubuntu 19.10 on a Core i5-4310U. My RAM is fairly
big enough for what I'm doing everyday, but as soon as the tiniest
swapping occurs, it renders the machine quite unusable - stuttering
window animations, stuttering/hanging mouse cursor, often for 1-2
minutes. As I can see, the bug is already marked as confirmed, so I just
want to put this for the record.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2020-02-05 Thread Corben
I'm experiencing the same issue since I upgraded to Kernel 5.3.0 on Ubuntu 
18.04 LTS via HWE stack.
This still does not happen with kernel 4.15 and iirc didn't happen with Kernel 
5.0.0 (which got replaced with 5.3.0 through the HWE stack).
I see a heavy increase in the swap file usage after a freeze, the swap file is 
located on the internal drive of my surface pro 3. If the swapping starts, it 
uses up to 500 MB at once, while with kernel 4.15 swapping happens later and 
even then uses only some few MB.

I got 8 GB of RAM, I've set vm.swappiness to 40 instead of 60.

The freezes got a bit mitigated after I've reset the gnome settings via 
gnome-tweaks, and enabled trim on the swap partition, but still happen and tend 
to increase after a while.
I'll try to enable zram and see if that helps mitigating it even more, so it's 
not interrupting the workflow on this device.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2020-01-07 Thread m.novosyolov
(In reply to ValdikSS from comment #60)
> I'm not sure, but people on Rosa forum blamed BTRFS for this bug. I'm pretty
> sure it's not directly tight with BTRFS, but write and read amplification
> may explain why lags are more severe with this FS.

People here and on ROSA forum blamed BTRFS for the problem that swap is
being not used, but not for microfreezes...

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2020-01-07 Thread cfeck
I don't use btrfs, but only ext4 on an SSD. Since updating my system
from kernel 5.1.7 to kernel 5.3.12 in Tumbleweed, I get regular ~1-2
second freezes (e.g. mouse pointer hangs in X11, or characters don't
appear while typing in Konsole) while Blender renders and swaps out
finished tiles. This didn't happen with the previous kernel.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-12-27 Thread iam
(In reply to Mikhail Novosyolov from comment #59)
> You mean that when e.g. Chromium browser writes its cache, it loads IO "up
> to 10x higher than EXT4"

Yes. This is also true for read operations, not only for write.

> and, when IO is also loaded by swapping, it causes
> microfreezes?

Yes, probably

> Are you sure that operations that cause write amplifications
> are not done in background?

I'm not sure, but people on Rosa forum blamed BTRFS for this bug. I'm
pretty sure it's not directly tight with BTRFS, but write and read
amplification may explain why lags are more severe with this FS.

Check https://arxiv.org/pdf/1707.08514.pdf and
https://habr.com/ru/post/476414/

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-12-27 Thread m.novosyolov
(In reply to ValdikSS from comment #58)
> I have an idea why this bug is much worse with BTRFS than with EXT4: BTRFS
> has much bigger read/write amplification, up to 10x higher than EXT4.

You mean that when e.g. Chromium browser writes its cache, it loads IO
"up to 10x higher than EXT4", and, when IO is also loaded by swapping,
it causes microfreezes? Are you sure that operations that cause write
amplifications are not done in background?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-12-27 Thread iam
I have an idea why this bug is much worse with BTRFS than with EXT4:
BTRFS has much bigger read/write amplification, up to 10x higher than
EXT4.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2019-11-15 Thread Pål Bergström
I have similar problem but more short freezes and lags. Is an update of
the graphic drives a solution? For some it seems that way. If so why?

https://askubuntu.com/questions/1185491/ubuntu-19-10-freezes-and-lags-
reguarly

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2019-10-09 Thread GoodMirek via ubuntu-bugs
Same issue here, although I run Fedora 31 with KDE Plasma DE.
Swapping with 5.2.17 works fine, even when using 4GB of swap for several days. 
Swapping with 5.3.2 causes a complete freeze, i.e. screen freezes up, no mouse 
movement, no TTY access. I did not try SYSRQ keys.

System under test:
HP Elitebook 850 G4
CPU: Intel i5-7200U with embedded GPU
RAM: 4GB unbuffered, memtest OK
Disk: SSD Samsung PM961 (256GB), LVM+LUKS
Swap: swapping to file of size 20GB at path /swapfile

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-13 Thread m.novosyolov
(In reply to Mikhail Novosyolov from comment #54)
> 
> So, something was fixed in upstream, backported to LTS kernel 4.19 and to
> Ubuntu kernel. I don't know what. And that issue is 100% not in BTRFS but is
> another problem or another aspect of the problem.
> 
I can suspect commit 2c012a4ad1a2cd3fb5a0f9307b9d219f84eda1fa "mm: vmscan: scan 
anonymous pages on file refaults"

https://github.com/torvalds/linux/commit/2c012a4ad1a2cd3fb5a0f9307b9d219f84eda1fa

It appeared in kernel 5.3 and was backported to 4.19.62 and Ubuntu
kernel 4.15.0-59

(In reply to ValdikSS from comment #53)
> Recently, about since kernel 5.2.7, the issue is either gone or present to
> much less extent.
> Right now I'm running kernel 5.2.11 and finally I can keel Firefox and
> VirtualBox running at the same time, with 3G+ in swap, and the system does
> not freeze.
... and to 5.2.3

But that commit "fixes" commits from the era of kernels 3.8 and 3.9, so
probably it is not the one I'm looking for.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-13 Thread m.novosyolov
(In reply to howaboutsynergy from comment #55)
> On an unrelated note(but since btrfs was thought to be a problem at some
> point), I've discovered that btrfs with zstd:5 (or worse zstd:15) can cause
> (at least) mouse cursor stuttering(like it was skipping frames), while
> zstd:1 doesn't(likely because of the low CPU usage during compression),
> regardless of how fast/many writes are happening on the SSD(2-6M/s with
> zstd:15, 38-50+M/s with zstd:1), apparently due to high CPU usage during the
> compression. (zstd unspecified means zstd:3 aka default)

I tried to move Chromium cache from btrfs to tmpfs, nothing became
better, seems that Load Average became even a bit bigger in peacks
(regrading what is described in comment#51).

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-13 Thread howaboutsynergy
On an unrelated note(but since btrfs was thought to be a problem at some
point), I've discovered that btrfs with zstd:5 (or worse zstd:15) can
cause (at least) mouse cursor stuttering(like it was skipping frames),
while zstd:1 doesn't(likely because of the low CPU usage during
compression), regardless of how fast/many writes are happening on the
SSD(2-6M/s with zstd:15, 38-50+M/s with zstd:1), apparently due to high
CPU usage during the compression. (zstd unspecified means zstd:3 aka
default)

Normal CPU usage by itself(eg. during compiling) doesn't cause such
stuttering though. I've tested this on a Lenovo Ideapad Z575, 16G RAM,
Kingston SSD SA400S37240G firmware SBFK71F1, and I've personally
switched to zstd:1

ie.
```
diff --git a/fs/btrfs/zstd.c b/fs/btrfs/zstd.c
index 6b9e29d050f3..02ffdb27c360 100644
--- a/fs/btrfs/zstd.c
+++ b/fs/btrfs/zstd.c
@@ -22,7 +22,7 @@
 
 #define ZSTD_BTRFS_MAX_WINDOWLOG 17
 #define ZSTD_BTRFS_MAX_INPUT (1 << ZSTD_BTRFS_MAX_WINDOWLOG)
-#define ZSTD_BTRFS_DEFAULT_LEVEL 3
+#define ZSTD_BTRFS_DEFAULT_LEVEL 1
 #define ZSTD_BTRFS_MAX_LEVEL 15
 /* 307s to avoid pathologically clashing with transaction commit */
 #define ZSTD_BTRFS_RECLAIM_JIFFIES (307 * HZ)
```

but zstd:1 in /etc/fstab should also work, unless using too old kernel
that doesn't know about it (hence why I prefer using the patch anyway)

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-13 Thread iam
Recently, about since kernel 5.2.7, the issue is either gone or present to much 
less extent.
Right now I'm running kernel 5.2.11 and finally I can keel Firefox and 
VirtualBox running at the same time, with 3G+ in swap, and the system does not 
freeze.

Could anyone affected by this issue try newer kernels?

Mikhail, I have a spare laptop which I can setup for you for tests. Do
you have time and wish to investigate this issue?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-13 Thread m.novosyolov
(In reply to ValdikSS from comment #53)
> Recently, about since kernel 5.2.7, the issue is either gone or present to
> much less extent.
> Right now I'm running kernel 5.2.11 and finally I can keel Firefox and
> VirtualBox running at the same time, with 3G+ in swap, and the system does
> not freeze.
> 
> Could anyone affected by this issue try newer kernels?

First of all, did you reset all your custom sysctls to default values?

1) One user (ilfat@) reported that:
1.1) on kernels 4.19.57 and Ubuntu kernel 4.15.0-54 his system did not swap 
correctly: all memory was full but only a small part of the swap was used, that 
lead to freezes
1.2) on kernels 4.19.67 and Ubuntu kernels 4.15.0-60, 4.15.0-62 systemd swaps 
in general normally, but he tweaked vm.watermark_scale_factor to make it swap 
better
1.3) Ilfat had exactly the same problem on both ext4 and btrfs

So, something was fixed in upstream, backported to LTS kernel 4.19 and
to Ubuntu kernel. I don't know what. And that issue is 100% not in BTRFS
but is another problem or another aspect of the problem.

2) I did not see much difference between Ubuntu kernels 54 and 60, 62 in
what is described in comment#51. So, that mystereous fix did not help.

3) another user (anreas@) reports the same as in (2):
https://forum.rosalinux.ru/viewtopic.php?p=101903=621857320f4d1a566e0cfa6e80ff4a8c#p101903

4) trying to overcome issues from comment#51, I built Ubuntu kernel
4.15.0 with 2 pathes:

* https://abf.io/mikhailnov/kernel-desktop-4.15/blob/master/le9-rosa.patch
* 
https://abf.io/mikhailnov/kernel-desktop-4.15/blob/master/Chromium-OS-low-memory-patchset.patch

and set kernel options:
# https://bugzilla.kernel.org/show_bug.cgi?id=196729#c36
vm.watermark_scale_factor=100
vm.unevictable_activefile_kbytes=10
#vm.swappiness=80
# https://bugs.chromium.org/p/chromium/issues/detail?id=263561#c16
# Disable swap read-ahead
vm.page-cluster=0

After that, I _thank_ it became a bit better (I cannot prove it by
numbers, just was unbale to make the system become inresponsive, but LA
remained the same), but unfortunately the main user of that notebook did
not use it for some days and so right now I can't say that according to
her feedback the situation has improved and the system does not
microfreeze from time to time anymore. Let's wait a bit more. And still
that may be a coincidence, not the result of patches and/or tweaked
sysctls.

I was able to dead lock that system by openning too many tabs in
Chromium, but that is not what those patches should have solved.
nohang/earlymoon would have probably helped if it was used.

> 
> Mikhail, I have a spare laptop which I can setup for you for tests. Do you
> have time and wish to investigate this issue?

I don't have ideas how to investigate it. And how to measure the result.
Maybe PSI can tell something, I did not try to look at them. And even
more, I don't understand what the problem is ;)

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread m.novosyolov
Forgot to write, that if I ran
$ stress --vm 2 --vm-bytes 1000M --vm-keep
swap is eventually used normally

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread m.novosyolov
Created attachment 284677
log of read_vmstat when filling RAM with new tabs in Chromium

(In reply to Michal Hocko from comment #8)
> Created attachment 258067 [details]
> read_vmstat.c
> 
> On Tue 22-08-17 15:55:30, Andrew Morton wrote:
> > 
> > (switched to email.  Please respond via emailed reply-to-all, not via the
> > bugzilla web interface).
> > 
> > On Tue, 22 Aug 2017 11:17:08 + bugzilla-dae...@bugzilla.kernel.org
> wrote:
> [...]
> > Sadly I haven't been able to capture this information 
> > > fully yet due to said unresponsiveness.
> 
> Please try to collect /proc/vmstat in the bacground and provide the
> collected data. Something like
> 
> while true
> do
>   cp /proc/vmstat > vmstat.$(date +%s)
>   sleep 1s
> done
> 
> If the system turns out so busy that it won't be able to fork a process
> or write the output (which you will see by checking timestamps of files
> and looking for holes) then you can try the attached proggy
> ./read_vmstat output_file timeout output_size
> 
> Note you might need to increase the mlock rlimit to lock everything into
> memory.

I am facing the following issue on this [1] hardware:
- when new tabs are openned in Chromium, swap (on SSD) is not used, 0K of swap 
is used. After about 2.5 GB out of total 4 GB RAM becomes used, about 15-50 MB 
of swap can be used, sometimes up to ~570 MB, but not more;
- this leads to that Load Everage bumps from normal ~0.9 to 9-15 when loading a 
new tab in Chromium;
- so the system in general freezes from time to time when working in the web 
browser and switching between tabs and/or openning new ones

I have run your program read_vmstat (./read_vmstat vmstat.log 5s) and
then ran a script that openned many tabs in Chromium, a new tab each 5s;
after all tabs were openned, about ~3.5 GB of RAM became used, but only
about 15 MB were swapped; then I ctrl+c'ed ./read_vmstat. Collected log
is attached.

Kernel was 4.15.0-58-generic in Ubuntu.

[1] https://linux-hardware.org/?probe=414558f152

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread m.novosyolov
(In reply to ValdikSS from comment #36)
> Those who experience the issue, try to set the following sysctl settings:
> 
> vm.swappiness=100
> vm.watermark_scale_factor=200
> 
> It greatly helps on my PC.

It did not change anything. Still only around ~15 MB are swapped while
3.5 out of 4 GB of RAM is used. This results to high load average (9-15)
when loading new tabs in Chromium.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread howaboutsynergy
Just an idea, try reproducing with kernel patch `le9g.patch`:

```
diff --git a/mm/vmscan.c b/mm/vmscan.c
index dbdc46a84f63..7a0b7e32ff45 100644
--- a/mm/vmscan.c
+++ b/mm/vmscan.c
@@ -2445,6 +2445,13 @@ static void get_scan_count(struct lruvec *lruvec, struct 
mem_cgroup *memcg,
BUG();
}
 
+if (NR_ACTIVE_FILE == lru) {
+  long long kib_active_file_now=global_node_page_state(NR_ACTIVE_FILE) * 
MAX_NR_ZONES;
+  if (kib_active_file_now <= 256*1024) {
+nr[lru] = 0; //don't reclaim any Active(file) (see /proc/meminfo) if 
they are under 256MiB
+continue;
+  }
+}
*lru_pages += size;
nr[lru] = scan;
}
```


see: 
https://gist.github.com/constantoverride/84eba764f487049ed642eb2111a20830#gistcomment-2997481
(^ scroll a bit up for some details of what the patch does)

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread m.novosyolov
(In reply to Jim Rees from comment #47)
> This bug is being discussed on lkml:
> https://lkml.org/lkml/2019/8/4/15
> 
> I'm not going to participate there, but someone should point them to this
> bug and point out that everything worked fine until 4.10. Sometimes things
> that used to work and then got broken rate a higher priority.

I believe it is not relevant. They are discussing problem of memory
allocation in general, that behaviour did not change much in recent
kernels. But what we are discussing is a regression of using swap in
kernels >= 4.10 (or >= 4.11?). In that thread topic starter suggests to
swapoff, but what we are discussing is wise a versa not using an enabled
swap.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread m.novosyolov
I encountered the same or a similar bug on BTRFS + HDD 5400 RPM + swap
on a separate partition. Unfortunately, that notebook is not mine and is
far away from me, what makes it hard to make experiments, kernels 4.15
and 4.18 both did have this problem, which can be reliably reproduced by
running

# stress --vm 2 --vm-bytes 2000M --vm-keep

on that notebook with 4 GB RAM.
After running stress Load Average bumps above 11.0 and the whole system freezes.
Information about its hardware: 
https://linux-hardware.org/index.php?probe=af73180d0c
(HDD is in bad condition as you may see in smartctl by the URL above, but I 
still believe it's not the reason why swap is not being used properly).

Some other users complain about similar problems here:
https://forum.rosalinux.ru/viewtopic.php?t=9387 (in Russian). Andreas17
there also uses BTRFS. I see that here, in my case, in bug#199763 and
also in another case of similar problem that I know there are too many
people with BTRFS, but this may be a coincidence.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread lukycrociato
its(In reply to Mikhail Novosyolov from comment #43)
> I encountered the same or a similar bug on BTRFS + HDD 5400 RPM + swap on a
> separate partition. Unfortunately, that notebook is not mine and is far away
> from me, what makes it hard to make experiments, kernels 4.15 and 4.18 both
> did have this problem, which can be reliably reproduced by running
> 
> # stress --vm 2 --vm-bytes 2000M --vm-keep
> 
> on that notebook with 4 GB RAM.
> After running stress Load Average bumps above 11.0 and the whole system
> freezes.
> Information about its hardware:
> https://linux-hardware.org/index.php?probe=af73180d0c
> (HDD is in bad condition as you may see in smartctl by the URL above, but I
> still believe it's not the reason why swap is not being used properly).
> 
> Some other users complain about similar problems here:
> https://forum.rosalinux.ru/viewtopic.php?t=9387 (in Russian). Andreas17
> there also uses BTRFS. I see that here, in my case, in bug#199763 and also
> in another case of similar problem that I know there are too many people
> with BTRFS, but this may be a coincidence.

it's not a coincidence, I did a lot of tests and they were only
happening on ALL my machines using a btrfs as root partition

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread jim
This bug is being discussed on lkml:
https://lkml.org/lkml/2019/8/4/15

I'm not going to participate there, but someone should point them to
this bug and point out that everything worked fine until 4.10. Sometimes
things that used to work and then got broken rate a higher priority.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread m.novosyolov
Did anybody try to reproduce it in a virtual environment? It would allow
to bibisect the kernel automatically.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-09-02 Thread m.novosyolov
Did anyone try to reproduce it on (open)SUSE, especially with their LTS kernel 
4.12?
SUSE uses BTRFS by default and develops it, there is a chance that they might 
have caught and fixed or worked around this problem or maybe their default 
sheduler/kernel options/etc prevent this.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-07-03 Thread lukycrociato
(In reply to ValdikSS from comment #41)
> (In reply to Luca from comment #40)
> > I switched from BTRFS to EXT4 and this did seem to solve the problem, at
> > least for me.
> 
> Do you use swap file or swap partition? I use swap partition, so it
> shouldn't matter, but I indeed have btrfs for /.

I always used a swap partition. 
That's why I was surprised when I switched back to ext4 this wasn't happening 
anymore.

That was also even happening when using zram only

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-07-03 Thread iam
(In reply to Luca from comment #40)
> I switched from BTRFS to EXT4 and this did seem to solve the problem, at
> least for me.

Do you use swap file or swap partition? I use swap partition, so it
shouldn't matter, but I indeed have btrfs for /.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-07-02 Thread lukycrociato
I switched from BTRFS to EXT4 and this did seem to solve the problem, at
least for me.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2019-07-01 Thread Luca Mastromatteo
As insane as it seems... Reverting back to EXT4 from BTRFS fixed the
problem...

So for me, it is an issue when BTRFS is used as root partition.

I wasn't even using swap files

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-06-30 Thread lukycrociato
(In reply to ValdikSS from comment #36)
> Those who experience the issue, try to set the following sysctl settings:
> 
> vm.swappiness=100
> vm.watermark_scale_factor=200
> 
> It greatly helps on my PC.

I confirm this also works very nicely for me.

Thanks. Not it doesn't slow down at all.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281]

2019-06-30 Thread lukycrociato
Actually, it did not solved the problem on my AMD desktop, but so far on
my Intel laptop it seems fine

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: System freeze when memory is put on SWAP in Linux >4.10.x

2019-06-29 Thread Bug Watch Updater
Launchpad has imported 38 comments from the remote bug at
https://bugzilla.kernel.org/show_bug.cgi?id=196729.

If you reply to an imported comment from within Launchpad, your comment
will be sent to the remote bug automatically. Read more about
Launchpad's inter-bugtracker facilities at
https://help.launchpad.net/InterBugTracking.


On 2017-08-22T11:17:08+00:00 netwiz wrote:

I have 10Gb of RAM in this system and run Fedora 26. If I launch Cities: 
Skylines with no swap space, things run well performance wise until I get an 
OOM - and it all dies - which is expected.

When I turn on swap to /dev/sda2 which resides on an SSD, I get complete 
system freezes while swap is being accessed.

The first swap was after loading a saved game, then launching kmail in the 
background. This caused ~500Mb to be swapped to /dev/sda2 on an SSD. The 
system froze for about 8 minutes - barely being able to move the mouse. The 
HDD LED was on constantly during the entire time.

To hopefully rule out the above glibc issue, I started the game via jemalloc - 
but experienced even more severe freezes while swapping. I gave up waiting 
after 13 minutes of non-responsiveness - not even being able to move the mouse 
properly.

During these hangs, I could typed into a Konsole window, and some of the 
typing took 3+ minutes to display on the screen (yay for buffers?).

I have tested this with both the default vm.swappiness values, as well as the 
following:
vm.swappiness = 1
vm.min_free_kbytes = 32768
vm.vfs_cache_pressure = 60

I noticed that when I do eventually get screen updates, all 8 cpus (4 cores / 
2 threads) show 100% CPU usage - and kswapd is right up there in the process 
list for CPU usage. Sadly I haven't been able to capture this information 
fully yet due to said unresponsiveness.

(more to come in comments & attachments)

Reply at:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/comments/0


On 2017-08-22T11:18:57+00:00 netwiz wrote:

First - using kernel 4.10.17 - which does not show any issues in
swapping:

I tried doing: swapoff /dev/sda2

Attached output as vmstat-4.10.17-10Gb-noswap.log

18:27:00 - Launched Cities: Skylines
18:27:30 - Started loading the saved game
18:28:25 - About this time the game started doing its thing. Started scrolling 
around.
18:28:47 - System stopped responding and then the C:S was killed by the OOM 
handler

Reply at:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/comments/1


On 2017-08-22T11:19:41+00:00 netwiz wrote:

Created attachment 258045
vmstat-4.10.17-10Gb-noswap.log (OK - OOM running)

Reply at:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/comments/2


On 2017-08-22T11:21:32+00:00 netwiz wrote:

Created attachment 258047
vmstat-4.10.17-10Gb.log (OK with swapping)

Second test, same kernel with swap turned on:

I have attached the vmstat output that goes with the following timestamps for 
system utilisation:

15:32:30 - Launch Skylines
15:33:00 - Load the saved game
15:34:11 - Saved game loaded ok.
15:35:00 - Launch Chrome.
15:35:36 - Chrome launched - System responding ok.
15:36:00 - Browsing a few web sites
15:36:50 - Exit Chrome
15:37:30 - Exit Cities: Skylines.

You'll note that there are very few missing vmstat lines - however I did 
notice the following missing:
15:35:10
15:35:12
15:35:15
15:35:20
15:35:26
15:35:29
15:35:30

Attachment is vmstat-4.10.17-10Gb.log

Reply at:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/comments/3


On 2017-08-22T11:24:02+00:00 netwiz wrote:

Created attachment 258049
vmstat-20Gb.log (OK - all in RAM)

Now using kernel 4.11.x (same happens with 4.12.x) - and testing with
20Gb of RAM in the system - meaning no swapping.

Attached as: vmstat-20Gb.log

Timestamps of events:
21:57 - launch the game from within Steam.
21:58:00 - Load the saved game.
21:58:48 - Saved game is loaded and I'm scrolling around in the map.
22:00:00 - Hit the quit to desktop button.
22:00:31 - Am back to desktop with all RAM free again.

Reply at:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/comments/4


On 2017-08-22T11:25:59+00:00 netwiz wrote:

Created attachment 258051
vmstat-10Gb.log (NOT OK - System Unresponsive)

I now drop back to 10Gb of RAM to test the swapping under 4.11.x kernel.

Log attached as vmstat-10Gb.log

Timestamps:
22:10:00 - Launched of the game from within Steam
22:11:00 - Load the same saved game from the previous log
22:12:01 - Saved game is loaded and I can scroll around. Noted a sl

[Bug 1833281] Re: Complete system freeze even when swapping small amounts of memory

2019-06-29 Thread Luca Mastromatteo
Update on this. Looks like it's an old upstream bug.

https://bugzilla.kernel.org/show_bug.cgi?id=196729


But now I noticed this also happens on my laptop, but it's more "recoverable" 
after something like 25/30 minutes.

Still, this problem is NOT present in older kernels than 4.10

** Bug watch added: Linux Kernel Bug Tracker #196729
   https://bugzilla.kernel.org/show_bug.cgi?id=196729

** Also affects: linux via
   https://bugzilla.kernel.org/show_bug.cgi?id=196729
   Importance: Unknown
   Status: Unknown

** Summary changed:

- Complete system freeze even when swapping small amounts of memory
+ System freeze when memory is put on SWAP in Linux >4.10.x

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  System freeze when memory is put on SWAP in Linux >4.10.x

To manage notifications about this bug go to:
https://bugs.launchpad.net/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: Complete system freeze even when swapping small amounts of memory

2019-06-28 Thread Luca Mastromatteo
I tried on FreeBSD today, and this behavior is not present

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: Complete system freeze even when swapping small amounts of memory

2019-06-26 Thread Luca Mastromatteo
Not necessarly, I can reproduce this sometimes with other stress tests

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: Complete system freeze even when swapping small amounts of memory

2019-06-26 Thread Luca Mastromatteo
Are you on a Ryzen platform too?

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: Complete system freeze even when swapping small amounts of memory

2019-06-22 Thread Kevin Remisoski
Does this happen to you while using a web browser?  This is my issue and
it doesn't matter which browser or which kernel.  Absolute garbage.  Not
sure what's happened with Ubuntu or why this is happening, but I'll try
to figure out why since clearly I'm not the only person this is
happening to and therefore it has nothing to do with my kernel updates.

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: Complete system freeze even when swapping small amounts of memory

2019-06-18 Thread Luca Mastromatteo
A small update on this.

I tried another distribution with the same kernel version, and this does
not happen... I don't really know why. 0 times out of 10 this does not
happen.

Also, when this occurs, triggering the OOM with SYSRQ+F also fixes the
issues, but shows that no swap memory was being used, like it couldn't
swap properly...? To be correct, it swapped only 64MB in the last try I
made, instead of 200MB

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: Complete system freeze even when swapping small amounts of memory

2019-06-18 Thread Luca Mastromatteo
** Changed in: linux (Ubuntu)
   Status: Incomplete => Confirmed

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] ProcCpuinfoMinimal.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "ProcCpuinfoMinimal.txt"
   
https://bugs.launchpad.net/bugs/1833281/+attachment/5271429/+files/ProcCpuinfoMinimal.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] CurrentDmesg.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "CurrentDmesg.txt"
   
https://bugs.launchpad.net/bugs/1833281/+attachment/5271425/+files/CurrentDmesg.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] ProcEnviron.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "ProcEnviron.txt"
   
https://bugs.launchpad.net/bugs/1833281/+attachment/5271430/+files/ProcEnviron.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] UdevDb.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "UdevDb.txt"
   https://bugs.launchpad.net/bugs/1833281/+attachment/5271434/+files/UdevDb.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] ProcModules.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "ProcModules.txt"
   
https://bugs.launchpad.net/bugs/1833281/+attachment/5271432/+files/ProcModules.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Lsusb.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "Lsusb.txt"
   https://bugs.launchpad.net/bugs/1833281/+attachment/5271427/+files/Lsusb.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] CRDA.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "CRDA.txt"
   https://bugs.launchpad.net/bugs/1833281/+attachment/5271424/+files/CRDA.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] PulseList.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "PulseList.txt"
   
https://bugs.launchpad.net/bugs/1833281/+attachment/5271433/+files/PulseList.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Re: Complete system freeze even when swapping small amounts of memory

2019-06-18 Thread Luca Mastromatteo
AlsaInfo.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] ProcCpuinfo.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "ProcCpuinfo.txt"
   
https://bugs.launchpad.net/bugs/1833281/+attachment/5271428/+files/ProcCpuinfo.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] ProcInterrupts.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "ProcInterrupts.txt"
   
https://bugs.launchpad.net/bugs/1833281/+attachment/5271431/+files/ProcInterrupts.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Lspci.txt

2019-06-18 Thread Luca Mastromatteo
apport information

** Attachment added: "Lspci.txt"
   https://bugs.launchpad.net/bugs/1833281/+attachment/5271426/+files/Lspci.txt

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] Missing required logs.

2019-06-18 Thread Ubuntu Kernel Bot
This bug is missing log files that will aid in diagnosing the problem.
While running an Ubuntu kernel (not a mainline or third-party kernel)
please enter the following command in a terminal window:

apport-collect 1833281

and then change the status of the bug to 'Confirmed'.

If, due to the nature of the issue you have encountered, you are unable
to run this command, please add a comment stating that fact and change
the bug status to 'Confirmed'.

This change has been made by an automated script, maintained by the
Ubuntu Kernel Team.

** Changed in: linux (Ubuntu)
   Status: New => Incomplete

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs

[Bug 1833281] [NEW] Complete system freeze even when swapping small amounts of memory

2019-06-18 Thread Luca Mastromatteo
no TTY access or SSH access
  can be made, only SYSRQ keys seem to do something (only reboot, so
  REISUB worked so far though, OOM is useless since the memory/swap is not
  even full)
  
  The I/O Disk led is stuck to 100% in ALL the following cases when this
  happens.
  
  So far:
  - This happens even when only ZRAM is enabled, and no swap partition is used.
  - Happens when ZSWAP is used with a swap partition
  - Happens also when a partition without zram or zswap is used
+ - Maybe it's AMD specific? 
  
  However, I'm not experiencing this on my laptop using the same tests.
  
  My laptop is an Intel one, while my desktop is an AMD Ryzen platform.
  
  Here are the specs:
  CPU: AMD Ryzen 5 1600 no OC
  GPU: AMD RX 580 8GB
  SSD: Crucial MX500 500GB
  MOBO: MSI B350M Grenade
  RAM: 8GB HyperX Kingston 2667Mhz
  
  Ubuntu version: 18.04 LTS, backports repo enabled
  Kernel version: 4.18.0-18, official ubuntu repo
  Bios settings: Default
  
  Additional info: Maybe I'm not 100% sure, but I noticed when using the
  5.0.0-17 generic kernel, the lockups seem to still happen, but they
  recover eventually. Happened only a few times though...
  
  But will always be frozen for at least 30 seconds, differently from my
  intel laptop where those do occur.
  
  The SSD make is the same. I bought two of these, they got also the same
  amount of RAM.
  
  In my laptop those do not occur at all. Swapping memory even huge
  quantities like 1GB or more, do not produce any issues.
  
- Tests made: 
+ Tests made:
  For testing this behaviour I tried:
  
  - Compiling the chromium-browser source code (takes up a lot of system
  RAM)
  
  - Used the "stress" command, using a specific amount of memory to decide
  how many it will be swapped, and here I noticed that even small
  quantities like a couple of megabytes will cause the system to freeze
  the 70% of the times
  
  Example: "stress --vm 1 --vm-bytes=7G"
  
- What should happen: 
+ What should happen:
  I expect system slowdowns when swapping out memory since I do not have enough 
RAM, but unlikely when using Windows or my laptop with the same Linux version, 
not a completely unusuable environment. The swap partition is in both cases on 
an SSD.
  
  Reproduceability: 70% of the times
  
- Additional info again: 
+ Additional info again:
  I'm not sure this is due to any hardware failure, my SSD health is fine, as 
my CPU and RAM. As I said swapping in Windows works fine...

-- 
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1833281

Title:
  Complete system freeze even when swapping small amounts of memory

To manage notifications about this bug go to:
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1833281/+subscriptions

-- 
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs