On Tue, Sep 30, 2014 at 1:30 PM, Micha Krause wrote:
> Hi,
>
>> > > That's strange. 3.13 is way before any changes that could have had
>> any
such effect. Can you by any chance try with older kernels to see where
it starts misbehaving for you? 3.12? 3.10? 3.8?
>>>
>>>
>> If I
Hi,
> > > That's strange. 3.13 is way before any changes that could have had any
such effect. Can you by any chance try with older kernels to see where
it starts misbehaving for you? 3.12? 3.10? 3.8?
If I have to compile Kernels anyway I will test 3.16.3 as well :-/.
Debian has relea
On Thu, Sep 25, 2014 at 7:06 PM, Andrei Mikhailovsky wrote:
> Ilya,
>
> I've not used rbd map on older kernels. Just experimenting with rbd map to
> have an iscsi and nfs gateway service for hypervisors such as xenserver and
> vmware. I've tried it with the latest ubuntu LTS kernel 3.13 I believe
> Sent: Thursday, 25 September, 2014 12:04:37 PM
> Subject: Re: [ceph-users] Frequent Crashes on rbd to nfs gateway
> Server
> On Thu, Sep 25, 2014 at 1:58 PM, Andrei Mikhailovsky
> wrote:
> > Guys,
> >
> > Have done some testing with 3.16.3-031603-generic downloaded
On Thu, Sep 25, 2014 at 1:58 PM, Andrei Mikhailovsky wrote:
> Guys,
>
> Have done some testing with 3.16.3-031603-generic downloaded from Ubuntu
> utopic branch. The hang task problem is gone when using large block size
> (tested with 1M and 4M) and I could no longer preproduce the hang tasks
> wh
ers@lists.ceph.com
> Sent: Thursday, 25 September, 2014 10:58:07 AM
> Subject: Re: [ceph-users] Frequent Crashes on rbd to nfs gateway
> Server
> Guys,
> Have done some testing with 3.16.3-031603-generic downloaded from
> Ubuntu utopic branch. The hang task problem is gone when using
To: "Ilya Dryomov"
> Cc: ceph-users@lists.ceph.com
> Sent: Thursday, 25 September, 2014 9:57:19 AM
> Subject: Re: [ceph-users] Frequent Crashes on rbd to nfs gateway
> Server
> Hi,
> > > That's strange. 3.13 is way before any changes that could have
> > >
Hi,
> > That's strange. 3.13 is way before any changes that could have had any
such effect. Can you by any chance try with older kernels to see where
it starts misbehaving for you? 3.12? 3.10? 3.8?
my crush tunables are set to bobtail, so I can't go bellow 3.9, I will try 3.12
tomorrow
Hi,
> That's strange. 3.13 is way before any changes that could have had any
such effect. Can you by any chance try with older kernels to see where
it starts misbehaving for you? 3.12? 3.10? 3.8?
my crush tunables are set to bobtail, so I can't go bellow 3.9, I will try 3.12
tomorrow and
On Wed, Sep 24, 2014 at 7:51 PM, Micha Krause wrote:
> Hi,
>
>> 3.13.0-35 -generic? really? I found my self in a similar situation like
>> yours and making a downgrade to that version works fine,
>> also you could try 3.14.9-031, it work fine for me also.
That is exactly the problem with this sor
And on 3.14.9-031?
German Anders
--- Original message ---
Asunto: Re: [ceph-users] Frequent Crashes on rbd to nfs gateway Server
De: Andrei Mikhailovsky
Para: German Anders
Cc: , Micha Krause
Fecha: Wednesday, 24/09/2014 12:43
I also had the hang tasks issues with 3.13.0
Hi,
> 3.13.0-35 -generic? really? I found my self in a similar situation like yours
and making a downgrade to that version works fine,
> also you could try 3.14.9-031, it work fine for me also.
yes, it's an Ubuntu Machine, I was not able to reproduce the problem here, but
the workload is quite
I also had the hang tasks issues with 3.13.0-35 -generic - Original Message
-
> From: "German Anders"
> To: "Micha Krause"
> Cc: ceph-users@lists.ceph.com
> Sent: Wednesday, 24 September, 2014 4:35:15 PM
> Subject: Re: [ceph-users] Frequent Cra
On Wed, Sep 24, 2014 at 6:59 PM, Andrei Mikhailovsky wrote:
> Ilya,
>
> Was wondering if you've had a chance to look into performance issues with
> rbd and the patched kernel? I've downloaded 3.16.3 and running some dd
> tests, which were producing hang tasks in the past. I've noticed that i
> can
3.13.0-35 -generic? really? I found my self in a similar situation
like yours and making a downgrade to that version works fine, also you
could try 3.14.9-031, it work fine for me also.
German Anders
--- Original message ---
Asunto: Re: [ceph-users] Frequent Crashes on rbd
Hi,
things work fine on kernel 3.13.0-35
I can reproduce this on 3.13.10, and I had in once on 3.13.0-35 as well.
Micha Krause
___
ceph-users mailing list
ceph-users@lists.ceph.com
http://lists.ceph.com/listinfo.cgi/ceph-users-ceph.com
Hi,
Well, these don't point at rbd at all. Are you seeing *any* progress
when this happens? Could it be that things just get very slow and
don't actually hang?
Can you try watching sysfs osdc file for a while to see if requests are
going through or not? (/sys/kernel/debug/ceph/./osdc)
at l
things work fine on kernel 3.13.0-35
German Anders
--- Original message ---
Asunto: Re: [ceph-users] Frequent Crashes on rbd to nfs gateway Server
De: Ilya Dryomov
Para: Micha Krause
Cc: ceph-users@lists.ceph.com
Fecha: Wednesday, 24/09/2014 11:33
On Wed, Sep 24, 2014 at
ume. I am sure I was hitting over 60MB/s before.
Cheers
andrei
- Original Message -
> From: "Ilya Dryomov"
> To: "Micha Krause"
> Cc: ceph-users@lists.ceph.com
> Sent: Wednesday, 24 September, 2014 3:33:20 PM
> Subject: Re: [ceph-users] Frequent Crashes
On Wed, Sep 24, 2014 at 4:52 PM, Micha Krause wrote:
> Hi,
>
>> Like I mentioned in my other reply, I'd be very interested in any
>>
>> similar messages on kernel other than 3.15.*, 3.16.1 and 3.16.2. One
>> hung task stack trace is usually not enough to diagnose this sort of
>> problems.
>
>
> O
On Wed, Sep 24, 2014 at 12:20 PM, Micha Krause wrote:
> Hi,
>
>> So does it actually crash or it's just the blocked I/Os? If it doesn't
>>
>> crash, you should be able to get everything off dmesg.
>
>
> it's blocked I/Os, I just wrote another mail to the list, with more dmesg
> Output
> from a Ce
On Wed, Sep 24, 2014 at 12:12 PM, Micha Krause wrote:
> Hi,
>
> I was able to get a dmesg output from the centos Machine with kernel 3.16:
>
> kworker/3:2:9521 blocked for more than 120 seconds.
>Not tainted 3.16.2-1.el6.elrepo.x86_64 #1
> "echo 0 > /proc/sys/kernel/hung_task_timeout_sec
Hi,
I was able to get a dmesg output from the centos Machine with kernel 3.16:
kworker/3:2:9521 blocked for more than 120 seconds.
Not tainted 3.16.2-1.el6.elrepo.x86_64 #1
"echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
kworker/3:2 D 0003
On Fri, Sep 19, 2014 at 11:22 AM, Micha Krause wrote:
> Hi,
>
>> I have build an NFS Server based on Sebastiens Blog Post here:
>>
>> http://www.sebastien-han.fr/blog/2012/07/06/nfs-over-rbd/
>>
>> Im using Kernel 3.14-0.bpo.1-amd64 on Debian wheezy, the host is a VM on
>> Vmware.
>>
>> Using rsyn
bump
I have observed this crash on ubuntu with kernel 3.13 and centos with 3.16 as
well now.
rbd hangs, and iostat shows something similar to the Output below.
Micha Krause
Am 19.09.2014 um 09:22 schrieb Micha Krause:
Hi,
> I have build an NFS Server based on Sebastiens Blog Post here:
ht
Hi,
> I have build an NFS Server based on Sebastiens Blog Post here:
http://www.sebastien-han.fr/blog/2012/07/06/nfs-over-rbd/
Im using Kernel 3.14-0.bpo.1-amd64 on Debian wheezy, the host is a VM on Vmware.
Using rsync im writing data via nfs from one client to this Server.
The NFS Server cr
Hi,
I have build an NFS Server based on Sebastiens Blog Post here:
http://www.sebastien-han.fr/blog/2012/07/06/nfs-over-rbd/
Im using Kernel 3.14-0.bpo.1-amd64 on Debian wheezy, the host is a VM on Vmware.
Using rsync im writing data via nfs from one client to this Server.
The NFS Server crash
27 matches
Mail list logo
