Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-25 Thread Wang Xiaoguang
hi, On 10/24/2016 01:47 AM, Stefan Priebe - Profihost AG wrote: Hello list, just wanted to report that my ENOSPC errors are gone. Thanks to wang for his great patches. but the space_info corruption still occours. On every umount i see: [93022.166222] BTRFS: space_info 4 has 208952672256

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-23 Thread Stefan Priebe - Profihost AG
Hello list, just wanted to report that my ENOSPC errors are gone. Thanks to wang for his great patches. but the space_info corruption still occours. On every umount i see: [93022.166222] BTRFS: space_info 4 has 208952672256 free, is not full [93022.166224] BTRFS: space_info total=363998478336,

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-10 Thread Wang Xiaoguang
hi, On 10/11/2016 04:06 AM, Stefan Priebe - Profihost AG wrote: Dear Wang, Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang: Hi, On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote: Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang: I found that compress sometime report ENOSPC error even

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-10 Thread Stefan Priebe - Profihost AG
Dear Wang, Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang: > Hi, > > On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote: >> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang: > I found that compress sometime report ENOSPC error even in 4.8-rc8, > currently I cannot confirm that

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-08 Thread Stefan Priebe - Profihost AG
main difference between the system where oom happens is: - Single Xeon => no OOM - Dual Xeon / NUMA => OOM both 64GB mem. Am 07.10.2016 um 11:33 schrieb Holger Hoffstätte: > On 10/07/16 09:17, Wang Xiaoguang wrote: >> Hi, >> >> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote: >>> Dear

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-08 Thread Stefan Priebe - Profihost AG
Hi Wang, currently on the system where it's working fine - no ENOSPC error. But it will take a week to be sure they don't come back. Thanks! Greets, Stefan Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang: > Hi, > > On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote: >> Am 29.09.2016 um

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Stefan Priebe - Profihost AG
Hi Holger, Am 07.10.2016 um 11:33 schrieb Holger Hoffstätte: > On 10/07/16 09:17, Wang Xiaoguang wrote: >> Hi, >> >> On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote: >>> Dear Wang, >>> >>> can't use v4.8.0 as i always get OOMs and total machine crashes. >>> >>> Complete traces with

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Holger Hoffstätte
On 10/07/16 09:17, Wang Xiaoguang wrote: > Hi, > > On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote: >> Dear Wang, >> >> can't use v4.8.0 as i always get OOMs and total machine crashes. >> >> Complete traces with your patch and some more btrfs patches applied (in >> the hope in fixes

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Wang Xiaoguang
hello, On 10/07/2016 04:16 PM, Stefan Priebe - Profihost AG wrote: Am 07.10.2016 um 10:07 schrieb Wang Xiaoguang: hello, On 10/07/2016 04:06 PM, Stefan Priebe - Profihost AG wrote: and it shows: PAG | scan 33829e5 | steal 1968e3 | stall 0 | | |

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Stefan Priebe - Profihost AG
Am 07.10.2016 um 10:07 schrieb Wang Xiaoguang: > hello, > > On 10/07/2016 04:06 PM, Stefan Priebe - Profihost AG wrote: >> and it shows: >> >> PAG | scan 33829e5 | steal 1968e3 | stall 0 | | >>| | swin 257071 | swout 346960 | >> >> but the highest

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Wang Xiaoguang
hello, On 10/07/2016 04:06 PM, Stefan Priebe - Profihost AG wrote: and it shows: PAG | scan 33829e5 | steal 1968e3 | stall 0 | | | | swin 257071 | swout 346960 | but the highest user space prog uses only 190MB. If you don't apply my patches,

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Stefan Priebe - Profihost AG
and it shows: PAG | scan 33829e5 | steal 1968e3 | stall 0 | | | | swin 257071 | swout 346960 | but the highest user space prog uses only 190MB. greets, Stefan Am 07.10.2016 um 09:17 schrieb Wang Xiaoguang: > Hi, > > On 10/07/2016 03:03 PM,

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Stefan Priebe - Profihost AG
this is what atop shows at mem usage 5 minutes before the crash: MEM | tot62.8G | free 198.2M | cache 56.8G | buff1.4M | slab3.5G | shmem 1.1M | vmbal 0.0M | hptot 0.0M | SWP | tot 3.7G | free3.2G | | | | |

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Stefan Priebe - Profihost AG
Am 07.10.2016 um 09:17 schrieb Wang Xiaoguang: > Hi, > > On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote: >> Dear Wang, >> >> can't use v4.8.0 as i always get OOMs and total machine crashes. >> >> Complete traces with your patch and some more btrfs patches applied (in >> the hope in

RE: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Paul Jones
@profihost.ag>; linux-btrfs@vger.kernel.org > Subject: RE: BTRFS: space_info 4 has 18446742286429913088 free, is not full > > > > -Original Message- > > From: linux-btrfs-ow...@vger.kernel.org [mailto:linux-btrfs- > > ow...@vger.kernel.org] On Behalf O

RE: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Paul Jones
org > Subject: Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full > > Hi, > > On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote: > > Dear Wang, > > > > can't use v4.8.0 as i always get OOMs and total machine crashes. > > > >

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Wang Xiaoguang
Hi, On 10/07/2016 03:03 PM, Stefan Priebe - Profihost AG wrote: Dear Wang, can't use v4.8.0 as i always get OOMs and total machine crashes. Complete traces with your patch and some more btrfs patches applied (in the hope in fixes the OOM but it did not): http://pastebin.com/raw/6vmRSDm1 I

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-07 Thread Stefan Priebe - Profihost AG
Dear Wang, can't use v4.8.0 as i always get OOMs and total machine crashes. Complete traces with your patch and some more btrfs patches applied (in the hope in fixes the OOM but it did not): http://pastebin.com/raw/6vmRSDm1 Greets, Stefan Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang: > Hi, >

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-06 Thread Stefan Priebe - Profihost AG
Thanks Wang, i applied them both on top of vanilla v4.8 - i hope this is OK. Will report back what happens. Greets, Stefan Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang: > Hi, > > On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote: >> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-06 Thread Stefan Priebe - Profihost AG
Thanks Wang, i applied them both on top of vanilla v4.8 - i hope this is OK. Will report back what happens. Greets, Stefan Am 06.10.2016 um 05:04 schrieb Wang Xiaoguang: > Hi, > > On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote: >> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang:

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-10-05 Thread Wang Xiaoguang
Hi, On 09/29/2016 03:27 PM, Stefan Priebe - Profihost AG wrote: Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang: I found that compress sometime report ENOSPC error even in 4.8-rc8, currently I cannot confirm that as i do not have anough space to test this without compression ;-( But yes i've

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-29 Thread Stefan Priebe - Profihost AG
Hi, Am 29.09.2016 um 12:03 schrieb Adam Borowski: > On Thu, Sep 29, 2016 at 09:27:01AM +0200, Stefan Priebe - Profihost AG wrote: >> Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang: > I found that compress sometime report ENOSPC error even in 4.8-rc8, > currently I cannot confirm that

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-29 Thread Adam Borowski
On Thu, Sep 29, 2016 at 09:27:01AM +0200, Stefan Priebe - Profihost AG wrote: > Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang: > >>> I found that compress sometime report ENOSPC error even in 4.8-rc8, > >>> currently > >> I cannot confirm that as i do not have anough space to test this without >

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-29 Thread Stefan Priebe - Profihost AG
Am 29.09.2016 um 09:13 schrieb Wang Xiaoguang: >>> I found that compress sometime report ENOSPC error even in 4.8-rc8, >>> currently >> I cannot confirm that as i do not have anough space to test this without >> compression ;-( But yes i've compression enabled. > I might not get you, my poor

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-29 Thread Wang Xiaoguang
Hi, On 09/29/2016 03:09 PM, Stefan Priebe - Profihost AG wrote: Am 29.09.2016 um 08:55 schrieb Wang Xiaoguang: Hi, On 09/29/2016 02:49 PM, Stefan Priebe - Profihost AG wrote: Hi, Am 28.09.2016 um 14:10 schrieb Wang Xiaoguang: OK, I see. But given that you often run into enospc errors, can

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-29 Thread Stefan Priebe - Profihost AG
Am 29.09.2016 um 08:55 schrieb Wang Xiaoguang: > Hi, > > On 09/29/2016 02:49 PM, Stefan Priebe - Profihost AG wrote: >> Hi, >> >> Am 28.09.2016 um 14:10 schrieb Wang Xiaoguang: >>> OK, I see. >>> But given that you often run into enospc errors, can you work out a >>> reproduce >>> script

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-29 Thread Wang Xiaoguang
Hi, On 09/29/2016 02:49 PM, Stefan Priebe - Profihost AG wrote: Hi, Am 28.09.2016 um 14:10 schrieb Wang Xiaoguang: OK, I see. But given that you often run into enospc errors, can you work out a reproduce script according to you work load. That will give us great help. You got ENOSPC errors

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-29 Thread Stefan Priebe - Profihost AG
Hi, Am 28.09.2016 um 14:10 schrieb Wang Xiaoguang: > OK, I see. > But given that you often run into enospc errors, can you work out a > reproduce > script according to you work load. That will give us great help. I tried hard to reproduce it but i can't get it to reproduce with a test script.

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-28 Thread Stefan Priebe - Profihost AG
Am 28.09.2016 um 15:44 schrieb Holger Hoffstätte: >> Good idea but it does not. I hope i can reproduce this with my already >> existing testscript which i've now bumped to use a 37TB partition and >> big files rather than a 15GB part and small files. If i can reproduce it >> i can also check

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-28 Thread Holger Hoffstätte
On 09/28/16 15:06, Stefan Priebe - Profihost AG wrote: > > Yes this is 4.4.22 and no i don't have qgroups enabled so it can't help. > > # btrfs qgroup show /path/ > ERROR: can't perform the search - No such file or directory > ERROR: can't list qgroups: No such file or director > > This is the

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-28 Thread Stefan Priebe - Profihost AG
Dear Holger, first thanks for your long e-mail. Am 28.09.2016 um 14:47 schrieb Holger Hoffstätte: > On 09/28/16 13:35, Wang Xiaoguang wrote: >> hello, >> >> On 09/28/2016 07:15 PM, Stefan Priebe - Profihost AG wrote: >>> Dear list, >>> >>> is there any chance anybody wants to work with me on the

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-28 Thread Holger Hoffstätte
On 09/28/16 13:35, Wang Xiaoguang wrote: > hello, > > On 09/28/2016 07:15 PM, Stefan Priebe - Profihost AG wrote: >> Dear list, >> >> is there any chance anybody wants to work with me on the following issue? > Though I'm also somewhat new to btrfs, but I'd like to. > >> >> BTRFS: space_info 4

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-28 Thread Stefan Priebe - Profihost AG
Am 28.09.2016 um 14:10 schrieb Wang Xiaoguang: > hello, > > On 09/28/2016 08:02 PM, Stefan Priebe - Profihost AG wrote: >> Hi Xiaoguang Wang, >> >> Am 28.09.2016 um 13:35 schrieb Wang Xiaoguang: >>> hello, >>> >>> On 09/28/2016 07:15 PM, Stefan Priebe - Profihost AG wrote: Dear list,

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-28 Thread Wang Xiaoguang
hello, On 09/28/2016 08:02 PM, Stefan Priebe - Profihost AG wrote: Hi Xiaoguang Wang, Am 28.09.2016 um 13:35 schrieb Wang Xiaoguang: hello, On 09/28/2016 07:15 PM, Stefan Priebe - Profihost AG wrote: Dear list, is there any chance anybody wants to work with me on the following issue?

Re: BTRFS: space_info 4 has 18446742286429913088 free, is not full

2016-09-28 Thread Stefan Priebe - Profihost AG
Hi Xiaoguang Wang, Am 28.09.2016 um 13:35 schrieb Wang Xiaoguang: > hello, > > On 09/28/2016 07:15 PM, Stefan Priebe - Profihost AG wrote: >> Dear list, >> >> is there any chance anybody wants to work with me on the following issue? > Though I'm also somewhat new to btrfs, but I'd like to. > >>