[Bug 1806115] Re: cannot set hmcdrv cachesize to 1GB
Yes, since hmcdrv and hmcdrvfs was designed for a different purpose and thus not offers whats needed (regarding latency and bandwidth) this can be closed. Alternatives are under investigation. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1806115 Title: cannot set hmcdrv cachesize to 1GB To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1806115/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1806115] Re: cannot set hmcdrv cachesize to 1GB
Well, we discussed the performance. It seems like this interface is not meant to be used as a backing storage for rootfs. Will try other options instead. ** Changed in: linux (Ubuntu) Status: Confirmed => Won't Fix ** Changed in: ubuntu-z-systems Status: New => Won't Fix -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1806115 Title: cannot set hmcdrv cachesize to 1GB To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1806115/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1806115] Re: cannot set hmcdrv cachesize to 1GB
So. I'm working on the new server installer for s390x, and it already works quite good on qemu/kvm. (whilst most of the UX improvements are not visible in the daily images, it does boot and completes the install in qemu/kvm. We have colors support, and partitioning changes/improvements staged in git master.) http://cdimage.ubuntu.com/ubuntu-server/daily-live/current/disco-live- server-s390x.iso Performing ISO/USB load, and giving access to the LPAR (it needs it), also results in the ability to boot the new installer. But it is painfully slow, and often hits OOM. I was hoping that hmcdrvfs is performant enough for read-only access as the underlay of the overlayfs, for live ubuntu server experience, and the source of installation. At the moment, it is painfully slow. And I'm not sure if we can tune vfs or hmcdrv to make this installation type viable. I almost feel like starting to make boot-in-place images, and requesting HMC to have ability to accept an upload of a qcow2 image, blast it onto a zfcp LUN disk, and IPL that as a read-only disk, for extremely fast booting of the new installer, with extremely fast install speeds. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1806115 Title: cannot set hmcdrv cachesize to 1GB To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1806115/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1806115] Re: cannot set hmcdrv cachesize to 1GB
** Tags added: kernel-da-key -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1806115 Title: cannot set hmcdrv cachesize to 1GB To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1806115/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1806115] Re: cannot set hmcdrv cachesize to 1GB
** Tags added: architecture-s39064 bugnameltc-173729 severity-high targetmilestone-inin1804 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1806115 Title: cannot set hmcdrv cachesize to 1GB To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1806115/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1806115] Re: cannot set hmcdrv cachesize to 1GB
according to the device drivers guide 'Linux on Z and LinuxONE - Device Drivers, Features, and Commands - Development stream (Kernel 4.18)' (page 482) http://public.dhe.ibm.com/software/dw/linux390/docu/l418dd35.pdf there is no limitation mentioned and it should just work - even with GBs of cachesize. Hence looping in IBM and reverse mirroring this bug. ** Tags added: reverse-proxy-bugzilla s390x ** Also affects: ubuntu-z-systems Importance: Undecided Status: New ** Changed in: ubuntu-z-systems Assignee: (unassigned) => bugproxy (bugproxy) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1806115 Title: cannot set hmcdrv cachesize to 1GB To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu-z-systems/+bug/1806115/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1806115] Re: cannot set hmcdrv cachesize to 1GB
Looking at the source code, it seems like the __get_free_pages call is failing. But I don't know what is the significance of said call, and why it fails beyond the 1MiB limit. /** * hmcdrv_cache_startup() - startup of HMC drive cache * @cachesize: cache size * * Return: 0 on success, else a (negative) error code */ int hmcdrv_cache_startup(size_t cachesize) { if (cachesize > 0) { /* perform caching ? */ hmcdrv_cache_order = get_order(cachesize); hmcdrv_cache_file.content = (void *) __get_free_pages(GFP_KERNEL | GFP_DMA, hmcdrv_cache_order); if (!hmcdrv_cache_file.content) { pr_err("Allocating the requested cache size of %zu bytes failed\n", cachesize); return -ENOMEM; } pr_debug("content cache enabled, size is %zu bytes\n", cachesize); } hmcdrv_cache_file.len = cachesize; return 0; } -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1806115 Title: cannot set hmcdrv cachesize to 1GB To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1806115/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1806115] Re: cannot set hmcdrv cachesize to 1GB
dmesg output: [ 61.741644] Hardware name: IBM 2964 N63 400 (LPAR) [ 61.741645] Krnl PSW : d4fd3f9b 8aabe5b8 (__alloc_pages_nodemask+0xe96/0x1068) [ 61.741649]R:0 T:1 IO:1 EX:1 Key:0 M:1 W:0 P:0 AS:3 CC:0 PM:0 RI:0 EA:3 [ 61.741650] Krnl GPRS: 006000c1 006000c1 [ 61.741651] 6fff3700 03ff8117c800 [ 61.741652]00b39000 03ff8117ca50 03ff8117f000 [ 61.741653] 00901b00 002e56e8 5c18f9b8 [ 61.741661] Krnl Code: 002e645a: a7110200tmll%r1,512 002e645e: a774f94abrc 7,2e56f2 #002e6462: a7f40001brc 15,2e6464 >002e6466: a7f4f946brc 15,2e56f2 002e646a: e31003380004lg %r1,824 002e6470: d503f15819c0clc 344(4,%r15),2496(%r1) 002e6476: a784febcbrc 8,2e61ee 002e647a: a7f4fa73brc 15,2e5960 [ 61.741674] Call Trace: [ 61.741676] ([<002e56e8>] __alloc_pages_nodemask+0x118/0x1068) [ 61.741677] [<002e0bca>] __get_free_pages+0x2a/0x60 [ 61.741680] [<03ff8117a2e0>] hmcdrv_cache_startup+0x68/0xd0 [hmcdrv] [ 61.741682] [<03ff8117f03e>] hmcdrv_mod_init+0x3e/0x1000 [hmcdrv] [ 61.741684] [<00100878>] do_one_initcall+0x48/0x1d0 [ 61.741687] [<00216f52>] do_init_module+0x7a/0x260 [ 61.741688] [<002196e6>] load_module+0x16ee/0x1968 [ 61.741689] [<00219bce>] sys_finit_module+0xb6/0xf8 [ 61.741693] [<008f0dc0>] system_call+0xdc/0x2c8 [ 61.741693] Last Breaking-Event-Address: [ 61.741695] [<002e6462>] __alloc_pages_nodemask+0xe92/0x1068 [ 61.741696] ---[ end trace 3870bf3953e53424 ]--- [ 61.741697] hmcdrv.a3150c: Allocating the requested cache size of 134217728 bytes failed [ 108.285532] hmcdrv.a3150c: Allocating the requested cache size of 67108864 bytes failed [ 120.229043] hmcdrv.a3150c: Allocating the requested cache size of 33554432 bytes failed [ 130.020224] hmcdrv.a3150c: Allocating the requested cache size of 16777216 bytes failed [ 143.255667] hmcdrv.a3150c: Allocating the requested cache size of 8388608 bytes failed [ 155.345222] hmcdrv.a3150c: Allocating the requested cache size of 4194304 bytes failed [ 165.291445] hmcdrv.a3150c: Allocating the requested cache size of 2097152 bytes failed [ 173.740144] hmcdrv.a3150c: Allocating the requested cache size of 2097152 bytes failed [ 279.595926] hmcdrv: `1G' invalid for parameter `cachesize' [ 285.847067] hmcdrv: `512M' invalid for parameter `cachesize' [ 708.461429] hmcdrv.a3150c: Allocating the requested cache size of 1050624 bytes failed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1806115 Title: cannot set hmcdrv cachesize to 1GB To manage notifications about this bug go to: https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1806115/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs