Re: [Gluster-devel] Maintainership

On 16-05-11 11:55:10, Aravinda wrote: > I would like to propose Kotresh. +2 from my side. Thanks Aravinda. Noted. It would be great to also have a backup maintainer. Anyone for that? > > regards > Aravinda > > On 05/11/2016 10:25 AM, Venky Shankar wrote: > >H

[Gluster-devel] Maintainership

Hello, I'm wanting to relinquish maintainership for changelog[1] translator. For the uninformed, changelog xlator is the supporting infrastructure for features such as Geo-replication, Bitrot and glusterfind. However, this would eventually be replaced by FDL[2] when it's ready and the

Re: [Gluster-devel] Bitrot/Tering : Bad files get migrated and hence corruption goes undetected.

On Wed, Mar 02, 2016 at 02:13:59PM +0530, Venky Shankar wrote: > On Wed, Mar 02, 2016 at 11:43:50AM +0530, Venky Shankar wrote: > > On Sat, Feb 27, 2016 at 06:32:38AM -0500, Joseph Fernandes wrote: > > > Yep Agree! :) > > > > > > Lets hear from the bit

Re: [Gluster-devel] Patches for Gluster 3.7.9

On Wed, Mar 9, 2016 at 9:00 PM, Kaushal M wrote: > Hey Vijay, > Has the tagging happened yet? If not, it's good to have this patch[1] in. [1]: http://review.gluster.org/#/c/13630/ > > On Mon, Mar 7, 2016 at 8:49 AM, Vijay Bellur wrote: >> Hey All, >>

[Gluster-devel] [ANNOUNCE] Maintainer Update

Hey folks, As of yesterday, Aravinda has taken over the maintainership of Geo-replication. Over the past year or so, he has been actively involved in it's development - introducing new features, fixing bugs, reviewing patches and helping out the community. Needless to say, he's the go-to guy

Re: [Gluster-devel] Handling locks in NSR

On Wed, Mar 02, 2016 at 02:29:26PM +0530, Avra Sengupta wrote: > On 03/02/2016 02:02 PM, Venky Shankar wrote: > >On Wed, Mar 02, 2016 at 01:40:08PM +0530, Avra Sengupta wrote: > >>Hi, > >> > >>All fops in NSR, follow a specific workflow as described in t

Re: [Gluster-devel] Community Meeting - March changes proposed

On Wed, Mar 02, 2016 at 10:47:03AM +0530, Kaushal M wrote: > Couldn't reply earlier as I was asleep at the time. > > The time change should have announced during last weeks meeting, but > no one around remembered this (I'd forgotten as well). > > I propose that we do this weeks meeting at 12UTC,

Re: [Gluster-devel] Bitrot stub forget()

repository. > > Please make sure you have the correct access rights > and the repository exists." > > > Regards, > Raghavendra > > > On Tue, Feb 16, 2016 at 10:53 AM, Venky Shankar <vshan...@redhat.com> wrote: > > > Hey Raghu, > > > >

[Gluster-devel] Bitrot stub forget()

Hey Raghu, Bitrot stub inode forget implementation (br_stub_forget()) deletes the bad object marker (under quarantine directory) if present. This looks incorrect as ->forget() can be trigerred when inode table LRU size exceeeds configured limit - check bug #1308961 which tracks this issue. I

Re: [Gluster-devel] regarding GF_CONTENT_KEY and dht2 - perf with small files

On Thu, Feb 04, 2016 at 11:34:04AM +0530, Shyam wrote: > On 02/04/2016 09:38 AM, Vijay Bellur wrote: > >On 02/03/2016 11:34 AM, Venky Shankar wrote: > >>On Wed, Feb 03, 2016 at 09:24:06AM -0500, Jeff Darcy wrote: > >>>>Problem is with workloads which kn

Re: [Gluster-devel] regarding GF_CONTENT_KEY and dht2 - perf with small files

On Wed, Feb 03, 2016 at 09:24:06AM -0500, Jeff Darcy wrote: > > Problem is with workloads which know the files that need to be read > > without readdir, like hyperlinks (webserver), swift objects etc. These > > are two I know of which will have this problem, which can't be improved > > because we

Re: [Gluster-devel] Possible spurious test tests/bitrot/br-stub.t

On Tue, Feb 02, 2016 at 01:51:56AM -0500, Sakshi Bansal wrote: > Hi Venky, > > Patch #13262 is failing for the above tests. The patch is just calling > STACK_DESTROY at appropriate place to avoid rebalance crashing. The test is > not rebalance related so the failure looks spurious to me.

[Gluster-devel] 3.7 pending patches

Hey folks, I just merged patch #13302 (and it's 3.7 equivalent) which fixes a scrubber crash. This was causing other patches to fail regression. Requesting a rebase of patches (especially 3.7 pending) that were blocked due to this. Thanks, Venky

Re: [Gluster-devel] patch #10954

On Wed, Jan 27, 2016 at 11:27:26PM -0500, Sakshi Bansal wrote: > > > If anything is going in mainline I'd encourage the same to be backported > > irrespective of the severity of the fix, so that's out of the equation. > Will keep this is mind in future. > > > > I'd like to stick to remove

Re: [Gluster-devel] Simple way to re-trigger jenkins jobs

On Wed, Jan 27, 2016 at 12:02:52PM +0530, Raghavendra Talur wrote: > Hi, > > Prashanth informed about a simple way to let every contributor retrigger > the regression runs that openstack uses. > > We have implemented same for gluster. Trigger comments are: > > recheck netbsd > recheck smoke >

Re: [Gluster-devel] distributed files/directories and [cm]time updates

On Tue, Jan 26, 2016 at 08:51:37AM +0100, Xavier Hernandez wrote: > Hi Pranith, > > On 26/01/16 03:47, Pranith Kumar Karampuri wrote: > >hi, > > Traditionally gluster has been using ctime/mtime of the > >files/dirs on the bricks as stat output. Problem we are seeing with this > >approach is

[Gluster-devel] patch #10954

Hey Sakshi, patch #10954 was not backported to 3.7 (for whatever reason) but introduced a helper routine brick_up_status() in tests/volume.rc. This routine was used in writing test cases for couple of patches http://review.gluster.org/#/c/13120/

Re: [Gluster-devel] Throttling xlator on the bricks

On Tue, Jan 26, 2016 at 03:11:50AM +, Richard Wareing wrote: > > If there is one bucket per client and one thread per bucket, it would be > > difficult to scale as the number of clients increase. How can we do this > > better? > > On this note... consider that 10's of thousands of clients are

Re: [Gluster-devel] Throttling xlator on the bricks

On Mon, Jan 25, 2016 at 01:08:38PM +0530, Ravishankar N wrote: > On 01/25/2016 12:56 PM, Venky Shankar wrote: > >Also, it would be beneficial to have the core TBF implementation as part of > >libglusterfs so as to be consumable by the server side xlator component to > >thr

Re: [Gluster-devel] Throttling xlator on the bricks

On Mon, Jan 25, 2016 at 11:06:26AM +0530, Ravishankar N wrote: > Hi, > > We are planning to introduce a throttling xlator on the server (brick) > process to regulate FOPS. The main motivation is to solve complaints about > AFR selfheal taking too much of CPU resources. (due to too many fops for >

Re: [Gluster-devel] 3.7.7 update

Pranith Kumar Karampuri wrote: https://public.pad.fsfe.org/p/glusterfs-3.7.7 is the final list of patches I am waiting for before making 3.7.7 release. Please let me know if I need to wait for any other patches. It would be great if we make the tag tomorrow. Backport of

[Gluster-devel] [CANCELLED] Weekly meeting on #gluster-meeting

Due to less number of participants and noone to chair. Thanks. Venky ___ Gluster-devel mailing list Gluster-devel@gluster.org http://www.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] ./tests/bugs/changelog/bug-1208470.t failed NetBSD

/19/2016 12:08 PM, Ravishankar N wrote: On 01/19/2016 12:01 PM, Venky Shankar wrote: Saravanakumar Arumugam wrote: Hi Ravi, I can run this locally, seems like spurious. Works fine on Linux for me too.Maybe its observed easily on BSD. Let me know if you see again. To be safe, it would

Re: [Gluster-devel] ./tests/bugs/changelog/bug-1208470.t failed NetBSD

Ravishankar N wrote: Hi Saravna, ./tests/bugs/changelog/bug-1208470.t seems to have failed a NetBSD run: https://build.gluster.org/job/rackspace-regression-2GB-triggered/17651/consoleFull Not sure if it is spurious as it passed in the subsequent run. Please have a look. Might be too soon to

Re: [Gluster-devel] ./tests/bugs/changelog/bug-1208470.t failed NetBSD

, Venky Shankar wrote: Ravishankar N wrote: Hi Saravna, ./tests/bugs/changelog/bug-1208470.t seems to have failed a NetBSD run: https://build.gluster.org/job/rackspace-regression-2GB-triggered/17651/consoleFull Not sure if it is spurious as it passed in the subsequent run. Please have a look

Re: [Gluster-devel] GFID to Path Conversion

Shyam wrote: On 12/09/2015 12:47 AM, Aravinda wrote: Hi, Sharing draft design for GFID to Path Conversion.(Directory GFID to Path is very easy in DHT v.1, this design may not work in case of DHT 2.0) (current thought) DHT2 would extend the manner in which name,pGFID is stored for files,

Re: [Gluster-devel] Quota-2

Venky Shankar wrote: Shyam wrote: On 12/19/2015 01:13 AM, Venky Shankar wrote: Shyam wrote: On 12/18/2015 04:00 AM, Vijaikumar Mallikarjuna wrote: Hi All, Here is the summary of discussion we had today on Quota-v2 Project, user and group quotas will use the same logic of accounting

Re: [Gluster-devel] Quota-2

Shyam wrote: On 12/19/2015 01:13 AM, Venky Shankar wrote: Shyam wrote: On 12/18/2015 04:00 AM, Vijaikumar Mallikarjuna wrote: Hi All, Here is the summary of discussion we had today on Quota-v2 Project, user and group quotas will use the same logic of accounting the usage Quota-v2

Re: [Gluster-devel] Quota-2

Shyam wrote: On 12/18/2015 04:00 AM, Vijaikumar Mallikarjuna wrote: Hi All, Here is the summary of discussion we had today on Quota-v2 Project, user and group quotas will use the same logic of accounting the usage Quota-v2 should be compatible with both DHT-v1 and DHT-v2 Project quotas

Re: [Gluster-devel] Recognizing contributors and displaying other useful bits?

Ravishankar N wrote: On 12/16/2015 07:36 PM, Niels de Vos wrote: Hi, Many GUI tools provide an "About" box that displays some information about the project. Some applications (Wireshark for example) go an extra step by including a list of all people that contributed patches. That is quite a

Re: [Gluster-devel] GlusterFS User and Group Quotas

On Fri, Dec 11, 2015 at 2:03 AM, Shyam wrote: > On 12/08/2015 04:32 AM, Vijaikumar Mallikarjuna wrote: >> >> Hi All, >> >> Below is the design for '*GlusterFS User and Group Quotas', *please >> provide your feedback on the same. >> >> >> *_Developers:_* >> Vijaikumar.M and

Re: [Gluster-devel] pluggability of some aspects in afr/nsr/ec

On Thu, Oct 29, 2015 at 11:36 AM, Pranith Kumar Karampuri wrote: > hi, > I want to understand how are you guys planning to integrate NSR > volumes to the existing CLIs. Here are some thoughts I had, wanted to know > your thoughts: > At the heart of both the

Re: [Gluster-devel] Questions about Gnotify

On Sun, Oct 25, 2015 at 2:19 AM, Edward Ned Harvey (gluster) wrote: > If I'm not mistaken, it looks like Gnotify was released in glusterfs 3.7. > > > > http://www.gluster.org/community/documentation/index.php/Features/Gnotify > >

Re: [Gluster-devel] gerrit seems to be down, please cross check

Seems to be not responding -- browser session timed out. Venky On Mon, Sep 21, 2015 at 9:26 AM, Atin Mukherjee wrote: > > ___ > Gluster-devel mailing list > Gluster-devel@gluster.org >

Re: [Gluster-devel] FOP ratelimit?

On Thu, Sep 3, 2015 at 11:36 AM, Raghavendra Gowdappa wrote: > > > - Original Message - >> From: "Emmanuel Dreyfus" >> To: "Raghavendra Gowdappa" , "Pranith Kumar Karampuri" >> >> Cc:

Re: [Gluster-devel] Managing etcd (4.0)

On Thu, Sep 10, 2015 at 10:05 AM, Atin Mukherjee wrote: > > > On 09/10/2015 01:42 AM, Jeff Darcy wrote: >> Better get comfortable, everyone, because I might ramble on for a bit. >> >> Over the last few days, I've been looking into the issue of how to manage >> our own

Re: [Gluster-devel] Gluster Sharding and Geo-replication

> > Hi Venky, > > It is not apparent to me what issues you see with approach 2. If you could > lay them out here, it would be helpful in taking the discussions further. > > -Krutika > It's unclean (to me at least). Replicating shard sizes looks like *stitching* a filesystem by hand. What do you

Re: [Gluster-devel] FOP ratelimit?

On Wed, Sep 2, 2015 at 2:05 PM, Venky Shankar <yknev.shan...@gmail.com> wrote: > On Wed, Sep 2, 2015 at 1:59 PM, Emmanuel Dreyfus <m...@netbsd.org> wrote: >> Hi >> >> Yesterday I experienced the problem of a single user bringing down >> a glusterfs cluste

Re: [Gluster-devel] FOP ratelimit?

On Wed, Sep 2, 2015 at 1:59 PM, Emmanuel Dreyfus wrote: > Hi > > Yesterday I experienced the problem of a single user bringing down > a glusterfs cluster to its knees because of a high amount of rename > operations. > > I understand rename on DHT can be very costly because data

Re: [Gluster-devel] Gluster Sharding and Geo-replication

] On Wed, Sep 2, 2015 at 8:50 PM, Aravinda <avish...@redhat.com> wrote: > > On 09/02/2015 08:22 PM, Venky Shankar wrote: >> >> On Wed, Sep 2, 2015 at 12:42 PM, Aravinda <avish...@redhat.com> wrote: >>> >>> Geo-replication and Sharding Team today d

Re: [Gluster-devel] Gluster Sharding and Geo-replication

On Wed, Sep 2, 2015 at 11:39 PM, Aravinda wrote: > > On 09/02/2015 11:13 PM, Shyam wrote: >> >> On 09/02/2015 10:47 AM, Krutika Dhananjay wrote: >>> >>> >>> >>> >>> >>> *From: *"Shyam"

Re: [Gluster-devel] Gluster Sharding and Geo-replication

On Wed, Sep 2, 2015 at 12:42 PM, Aravinda wrote: > Geo-replication and Sharding Team today discussed about the approach > to make Sharding aware Geo-replication. Details are as below > > Participants: Aravinda, Kotresh, Krutika, Rahul Hinduja, Vijay Bellur > > - Both Master

Re: [Gluster-devel] healing of bad objects (marked by scrubber)

On 07/08/2015 12:06 PM, Ravishankar N wrote: On 07/08/2015 11:42 AM, Raghavendra Bhat wrote: Adding the correct gluster-devel id. Regards, Raghavendra Bhat On 07/08/2015 11:38 AM, Raghavendra Bhat wrote: Hi, In bit-rot feature, the scrubber marks the corrupted (objects whose data has

Re: [Gluster-devel] Unable to send patches to review.gluster.org

Me too. Earlier (past week or so) this error used to last for about 15-20 minutes, but today seems to be it's day. Venky On Thu, Jul 2, 2015 at 9:53 AM, Anuradha Talur ata...@redhat.com wrote: Hi, I'm unable to send patches to r.g.o, also not able to login. I'm getting the following

Re: [Gluster-devel] bad file access (bit-rot + AFR)

On Tue, Jun 30, 2015 at 10:21 AM, Raghavendra Bhat rab...@redhat.com wrote: On 06/27/2015 03:28 PM, Venky Shankar wrote: On 06/27/2015 02:32 PM, Raghavendra Bhat wrote: Hi, There is a patch that is submitted for review to deny access to objects which are marked as bad by scrubber (i.e

Re: [Gluster-devel] spurious failure with test-case ./tests/basic/tier/tier.t

Even I had faced failure in tier.t couple of times. Dan/Joseph, mind having a look at this? Regards, Raghavendra Bhat http://build.gluster.org/job/rackspace-regression-2GB-triggered/11396/consoleFull http://build.gluster.org/job/rackspace-regression-2GB-triggered/11456/consoleFull

Re: [Gluster-devel] Valgrind + glusterfs

On Thu, Jun 25, 2015 at 9:57 AM, Pranith Kumar Karampuri pkara...@redhat.com wrote: hi, Does anyone know why glusterfs hangs with valgrind? /proc/pid/stack ? Pranith ___ Gluster-devel mailing list Gluster-devel@gluster.org

[Gluster-devel] REMINDER: Weekly Gluster Community meeting today at 12:00 UTC

Hi All, I'll be chairing this meeting today. In about 45 minutes from now we will have the regular weekly Gluster Community meeting. Meeting details: - location: #gluster-meeting on Freenode IRC - webchat: https://webchat.freenode.net/?channels=gluster-meeting - date: every Wednesday - time:

[Gluster-devel] Minutes of todays Gluster Community Meeting

As every week, we had our Gluster Community Meeting earlier today. The agenda for next week can be found here: https://public.pad.fsfe.org/p/gluster-community-meetings Please add topics to the Open Floor / BYOT item around line 66 of the etherpad and attend the meeting next week to discuss

Re: [Gluster-devel] /tests/bugs/quota/bug-1153964.t is consistently failing

Patch http://review.gluster.org/#/c/11311/ seems to have introduces this. Sachin can comment more on this. Johnny has reverted this patch:http://review.gluster.org/#/c/11354/ -Venky On Tue, Jun 23, 2015 at 12:44 PM, Xavier Hernandez xhernan...@datalab.es wrote: Hi, the quota test

Re: [Gluster-devel] /tests/bugs/quota/bug-1153964.t is consistently failing

OK. Two reverts of the same patch ;) Pick one. On Tue, Jun 23, 2015 at 12:51 PM, Raghavendra Gowdappa rgowd...@redhat.com wrote: Seems like its a memory corruption caused by: http://review.gluster.org/11311 I've reverted the patch at: http://review.gluster.org/11360 - Original Message

Re: [Gluster-devel] NetBSD regressions not being triggered for patches

On Wed, Jun 17, 2015 at 10:13 AM, Emmanuel Dreyfus m...@netbsd.org wrote: Atin Mukherjee amukh...@redhat.com wrote: That *might* result in lots of NetBSD regression failures later on and we may end up with another round of fixups. Agreed, that's the known risk but we don't have any other

Re: [Gluster-devel] NetBSD regressions not being triggered for patches

On Wed, Jun 17, 2015 at 9:50 AM, Atin Mukherjee amukh...@redhat.com wrote: On 06/11/2015 08:04 PM, Emmanuel Dreyfus wrote: On Thu, Jun 11, 2015 at 04:04:44PM +0200, Niels de Vos wrote: Michael installed and configured dnsmasq on build.gluster.org yesterday. If that does not help today, we

Re: [Gluster-devel] Proposal for addition of maintainers and more...

On Wed, Jun 10, 2015 at 3:32 PM, Vijay Bellur vbel...@redhat.com wrote: On 06/10/2015 03:24 PM, Venky Shankar wrote: I would like to propose Aravinda (avish...@redhat.com) as a maintainer for Geo-replication. I can act as a backup maintainer in his absence. Hope it's not too late

Re: [Gluster-devel] Proposal for addition of maintainers and more...

: Overall Maintainer across various components. Bitrot - Venky Shankar Raghavendra Bhat Erasure Coding - Xavier Hernandez Pranith Karampuri Fuse - Niels de Vos Raghavendra Bhat Glusterd - Atin Mukherjee libglusterfs - Pranith Karampuri Niels de Vos Snapshot - Rajesh Joseph Tiering

Re: [Gluster-devel] Will be pushing 3.7.1 tag shortly

Also, good to have this patch in: http://review.gluster.org/#/c/11030/ (waiting for regression to run). -Venky On Mon, Jun 1, 2015 at 4:23 PM, Avra Sengupta aseng...@redhat.com wrote: Aravinda has given it a +1 Regards, Avra On 06/01/2015 03:34 PM, Krishnan Parthasarathi wrote: Could

Re: [Gluster-devel] scrubber crash

On 06/01/2015 02:23 PM, Venky Shankar wrote: On 06/01/2015 01:09 PM, Anand Nekkunti wrote: Hi Venky one of regression test in my patch, I found core dump from scrubber . Please have a look. Link :http://build.gluster.org/job/rackspace-regression-2GB-triggered/9925/consoleFull bt

Re: [Gluster-devel] scrubber crash

On 06/01/2015 01:09 PM, Anand Nekkunti wrote: Hi Venky one of regression test in my patch, I found core dump from scrubber . Please have a look. Link :http://build.gluster.org/job/rackspace-regression-2GB-triggered/9925/consoleFull bt fir core ... (gdb) bt #0 0x7f89d6224731 in

[Gluster-devel] Regression failure: NFS segfault

Got this backtrace in gNFS in one of the regression run: (gdb) bt #0 0x7f170f0fc380 in pthread_spin_lock () from /lib64/libpthread.so.0 #1 0x7f170fb85993 in dict_get (this=0x5d292c282e392d30, key=0x7f16e8008330 \220\247) at

Re: [Gluster-devel] Regression failure: NFS segfault

On 04/14/2015 02:09 PM, Niels de Vos wrote: On Tue, Apr 14, 2015 at 11:30:30AM +0530, Venky Shankar wrote: Got this backtrace in gNFS in one of the regression run: (gdb) bt #0 0x7f170f0fc380 in pthread_spin_lock () from /lib64/libpthread.so.0 #1 0x7f170fb85993 in dict_get

Re: [Gluster-devel] Security hardening RELRO PIE flags

On 03/31/2015 12:45 PM, Niels de Vos wrote: On Tue, Mar 31, 2015 at 12:20:19PM +0530, Kaushal M wrote: IMHO, doing hardening and security should be left the individual distributions and the package maintainers. Generally, each distribution has it's own policies with regards to hardening and

Re: [Gluster-devel] Responsibilities and expectations of our maintainers

On Tue, Mar 31, 2015 at 12:14 PM, Vijay Bellur vbel...@redhat.com wrote: On 03/28/2015 02:08 PM, Emmanuel Dreyfus wrote: Pranith Kumar Karampuri pkara...@redhat.com wrote: Emmanuel, What can we do to make it vote -2 when it fails? Things will automatically fall in place if it

[Gluster-devel] Hangout: BitRot detection in GlusterFS

Hello folks, I've scheduled an Hangout[1] session tomorrow regarding upcoming BitRot Detection feature in GlusterFS. This session would include a preview of the feature, implementation details and quick demo. Please plan to join the Hangout session and spread the word around. [1]:

Re: [Gluster-devel] Hangouts for 3.7 features

On Mon, Mar 30, 2015 at 11:23 AM, Venky Shankar yknev.shan...@gmail.com wrote: On Fri, Mar 27, 2015 at 4:31 PM, Vijay Bellur vbel...@redhat.com wrote: Hi All, As we inch closer to 3.7.0, I think it might be a good idea to talk about new/improved features in 3.7 and do a demo of the features

Re: [Gluster-devel] NetBSD regression recovered (with patches)

On Mon, Mar 30, 2015 at 12:36 PM, Emmanuel Dreyfus m...@netbsd.org wrote: On Mon, Mar 30, 2015 at 10:10:20AM +0530, Venky Shankar wrote: Review done, awaiting clarification on a minor question from Venky (changelog maintainer). Have a minor comment. Rest is all good. I addressed

Re: [Gluster-devel] Hangouts for 3.7 features

I did reserve 04/02 for you and striked out 04/02 in the etherpad :). You can still go ahead with 04/02. works for me. thanks! Thanks, Vijay ___ Gluster-devel mailing list Gluster-devel@gluster.org

Re: [Gluster-devel] Hangouts for 3.7 features

On Fri, Mar 27, 2015 at 4:31 PM, Vijay Bellur vbel...@redhat.com wrote: Hi All, As we inch closer to 3.7.0, I think it might be a good idea to talk about new/improved features in 3.7 and do a demo of the features to our users over Google hangout sessions. With that in mind, I have created an

Re: [Gluster-devel] NetBSD regression recovered (with patches)

On Mon, Mar 30, 2015 at 8:27 AM, Krishnan Parthasarathi kpart...@redhat.com wrote: Thanks Emmanuel for posting fixes for all these issues! http://review.gluster.org/10030 Review done, awaiting clarification on a minor question from Venky (changelog maintainer). Have a minor comment. Rest

Re: [Gluster-devel] Here is why feature/changelog change broke NetBSD

On Fri, Mar 27, 2015 at 10:14 PM, Emmanuel Dreyfus m...@netbsd.org wrote: Hi I have not foound where corruption occurs, but now I have an explaantion: feature/chaneglog has been modified to run operation on an event_pool in a separate thread. NetBSD uses event-poll.c implementation where e

Re: [Gluster-devel] NetBSD regressions, memory corruption

On Wed, Mar 25, 2015 at 10:39 PM, Emmanuel Dreyfus m...@netbsd.org wrote: On Wed, Mar 25, 2015 at 10:32:08PM +0530, Venky Shankar wrote: Could I run some tests on nbslave70 Sure, I stopped doing tests since I assumed you were alredy doing some. (I plan to disable some translators). Just

Re: [Gluster-devel] NetBSD regressions, memory corruption

looks like the iobref (and the iobuf) was allocated in protocol/server.. (gdb) x/16x (ie-ie_iobref-iobrefs - 8) 0xbb11a438: 0xbb18ba80 0x0001 0x0068 0x0040 0xbb11a448: 0xbb1e2018 0xcafebabe 0x 0x 0xbb11a458: 0x0003

Re: [Gluster-devel] NetBSD regressions, memory corruption

On Wed, Mar 25, 2015 at 4:28 PM, Niels de Vos nde...@redhat.com wrote: Ai, top posting, this makes it really difficult to follow the email if you have not read the first parts :-/ Please remember to inline or bottom post when replying. On Wed, Mar 25, 2015 at 03:21:28PM +0530, Venky Shankar

Re: [Gluster-devel] NetBSD regressions, memory corruption

On Mar 24, 2015 10:48 PM, Emmanuel Dreyfus m...@netbsd.org wrote: Hi The merge of http://review.gluster.org/9953/ removed a few crashes from NetBSD regression tests, but the thing remains uterly broken since the merge of http://review.gluster.org/9708/ though I cannot tell if I have bugs

Re: [Gluster-devel] NetBSD AFR regression

There are other instances where iobuf_arena-page_size is used in iobuf.c and there are about a dozen callers for iobuf_size(). There needs to be something fishy about the call in the patch you mention to trigger the overrun. On Mon, Mar 23, 2015 at 10:59 PM, Emmanuel Dreyfus m...@netbsd.org

Re: [Gluster-devel] [Gluster-users] [PATCH ANNOUNCE] BitRot : Object signing

Oops, my bad. Thanks for the correction. February it is. Thanks, Venky On Feb 21, 2015 6:14 PM, Markus Ueberall markus.ueber...@gmail.com wrote: NB according to the link, it's *this* Tuesday, 24th February. Kind regards, Markus Am 19.02.2015 um 15:04 schrieb Venky Shankar

[Gluster-devel] [PATCH ANNOUNCE] BitRot : Object signing

Hi folks, Listed below is the initial patchset for the upcoming bitrot detection feature targeted for GlusterFS 3.7. As of now, these set of patches implement object signing. Myself and Raghavendra (rabhat@) are working on pending items (scrubber, etc..) and would be sending those patches

Re: [Gluster-devel] Discussion: Implications on geo-replication due to bitrot and tiering changes!!!!

. Anytime. ~Joe Venky ~ Joseph ( NOT Josef :) ) - Original Message - From: Venky Shankar yknev.shan...@gmail.com To: Kotresh Hiremath Ravishankar khire...@redhat.com Cc: Gluster Devel gluster-devel@gluster.org, dlamb...@redhat.com, josfe...@redhat.com, Vijay Bellur vbel

[Gluster-devel] Data classification infrastructure

With the upcoming data compliance features in GlusterFS, a common infrastructure[1] to support various mechanisms such as tiering, bitrot detection etc. would prove to be helpful. Such an infrastructure extends the current changelog design (keeping NSR in mind) and removes constraints that

Re: [Gluster-devel] BitRot notes

On Fri, Nov 28, 2014 at 10:00 PM, Vijay Bellur vbel...@redhat.com wrote: On 11/28/2014 08:30 AM, Venky Shankar wrote: [snip] 1. Can the bitd be one per node like self-heal-daemon and other global services? I worry about creating 2 * N processes for N bricks in a node. Maybe we can consider

Re: [Gluster-devel] Discussion: Implications on geo-replication due to bitrot and tiering changes!!!

[Adding Dan/Josef/Vijay] As of now, rollover-time is global to changelog translator, hence tuning that would effect all consumers subscribing to updates. It's 15 seconds by default and has proved to provide a good balance between replication performance (geo-rep) and IOPS rate. Tuning to a lower

Re: [Gluster-devel] glusterfs 3.6.0beta3 fills up inodes

to the same issue. After some further investigation I found that this is happening only on the secondary node, the primary one cleans up everything from the .processing as soon as the file gets synced. Thanks, Venky Shankar yknev.shan...@gmail.com 13 November 2014 02:28 It's safe

Re: [Gluster-devel] glusterfs 3.6.0beta3 fills up inodes

It's safe to purge everything under .processed. That what geo-rep had already replicated, so it's OK to delete it. Also, consider purging these entries periodically as geo-rep doesn't purge them on it's own (at least for now). Venky On Thu, Nov 13, 2014 at 3:27 AM, Andrea Tartaglia

Re: [Gluster-devel] HTIME API

- Original Message - From: Venky Shankar vshan...@redhat.com To: Ajeet Jha a...@redhat.com Cc: Kotresh Hiremath Ravishankar khire...@redhat.com, gluster-devel@gluster.org Sent: Wednesday, October 29, 2014 6:23:40 PM Subject: HTIME API Hey Ajeet, Since changelog translator maintains a meta file (HTIME

Re: [Gluster-devel] HTIME API

: Hi Venky, If I understand correctly, the idea is to provide RPC based history API? If yes, how can that solve the different clients/consumers having to maintain state of how much it has processed? Thanks and Regards, Kotresh H R - Original Message - From: Venky Shankar vshan

[Gluster-devel] BitRot notes

Hey folks, Myself and Raghavendra (@rabhat) have been discussing about BitRot[1] and came up with a list of high level tasks (breakup items) captured here[2]. The pad will be updated on an ongoing basis reflecting the current status/items that are being worked on. As always, contributions in

Re: [Gluster-devel] Hanging regression test causes delay in running smoke tests

Thanks a lot Niels. Normally I use the rackspace regression job link to schedule regression runs, but for some reason today I used the old one. Venky - Original Message - From: Niels de Vos nde...@redhat.com To: Venky Shankar vshan...@redhat.com Cc: gluster-devel@gluster.org

Re: [Gluster-devel] No plan found in TAP output

​possible to get verbose output? prove -v ? Venky ___ Gluster-devel mailing list Gluster-devel@gluster.org http://supercolony.gluster.org/mailman/listinfo/gluster-devel

Re: [Gluster-devel] BitRot

Here's the feature page: http://www.gluster.org/community/documentation/index.php/Features/BitRot I've linked the document (uploaded in google doc, open for comments) under Section #3. Thanks, venky - Original Message - From: Krishnan Parthasarathi kpart...@redhat.com To: Venky

[Gluster-devel] BitRot

Hi folks, Continuing the discussion on bitrot detection in GlusterFS[1], I've put up a document that explains the approach and details at a higher level. The same would be put up in the feature page (or expand the current page[2]). Once there is consensus on the approach and what's expected