[Gluster-Maintainers] Jenkins build is back to normal : netbsd-periodic #162

[jenkins]

See 


___
maintainers mailing list
maintainers@gluster.org
http://lists.gluster.org/mailman/listinfo/maintainers

[Gluster-Maintainers] Proposed Protocol changes for 4.0: Need feedback.

[Amar Tumballi]

Hi All,

Below are the proposed protocol changes (ie, XDR changes on the wire) we
are thinking for Gluster 4.0.


   - rchecksum/fsetattr: Add 'gfid' field on wire

Basic work already done at https://review.gluster.org/#/c/3956/ .
Considering its 5yrs old patch, I refreshed it at
https://review.gluster.org/17656 for experimental branch, and it is all
working fine.

This patch also helps in creating new RPC program etc, so for all other XDR
changes, we only need to handle the specific change in the patch.

STATUS: GREEN

   - statx() support

https://github.com/gluster/glusterfs/issues/273 talks more on it. We can
consider to make XDR changes for sure even if we don't implement the fops
in all other xlator IMO, so there won't be clients' compatibility issue.

STATUS: RED  (As no work has been started yet)

   - Changes to 'gf_flock' structure on wire

More on it @ https://review.gluster.org/#/c/15698. Can be handled without
this change by using xdata, but adding this field in the XDR will make it
faster, and less error prone.

STATUS: YELLOW

   - Changes in few of the 'fops' to get struct iatt in _cbk

This is needed for mainly handling the cases of fail over during rebalance,
self-heal etc. Today, because we don't have a protocol support, our cross
architecture compatibility is broken, mainly because we send iatt as binary
in xdata dict, which is not desirable.

STATUS: RED

(Red as we need to hear from team on what are the changes needed, and it
would be significant change as we may have to change the fops signature
itself).

   - fadvise()

As per the email thread
http://lists.gluster.org/pipermail/gluster-devel/2017-August/053457.html,
if we implement the fop, we would need a new XDR for it.

STATUS: RED

(It is red as it is still in discovery phase)

   - Misc

We don't have any other proposal for protocol change for now, other than a
suggestion from Jeff Darcy about taking out the common flags we use across
the board, inside xdata, and make them as 'flags' itself in XDR, for better
perf, and manageability.

STATUS: RED

(Mainly because the work is about discovery and changing the fops signature
itself).


This is the good time to highlight if you need any further changes in
protocol itself, and start towards getting it implemented and tested. I
volunteer to review all such patches, and happy to co-ordinate it on
experimental branch before sending them as a single patch (or multiple
dependent, granular patches) on master when we feel it is ready.


Regards,

Amar


-- 
Amar Tumballi (amarts)
___
maintainers mailing list
maintainers@gluster.org
http://lists.gluster.org/mailman/listinfo/maintainers

Re: [Gluster-Maintainers] Proposed Protocol changes for 4.0: Need feedback.

[Niels de Vos]

On Fri, Aug 11, 2017 at 06:04:36PM +0530, Amar Tumballi wrote:
> Hi All,
> 
> Below are the proposed protocol changes (ie, XDR changes on the wire) we
> are thinking for Gluster 4.0.

One of the things that is missing in this list, is to have dictionary
entries have a (key, type, value) format. This makes it possible to have
all the values XDR encoded/decoded correctly. When new values get
transported over the network, we can force the need for XDR encoding
functions for these types.

I thought there was a GitHub issue for this already (or maybe a bug?),
but I fail to find it.

Niels
___
maintainers mailing list
maintainers@gluster.org
http://lists.gluster.org/mailman/listinfo/maintainers

[Gluster-Maintainers] Build failed in Jenkins: netbsd-periodic #163

[jenkins]

See 


Changes:

[Kaleb S. KEITHLEY] packaging: /run and /var/run; prefer /run

--
[...truncated 363.26 KB...]
ok 12, LINENUM:44
ok 13, LINENUM:45
ok 14, LINENUM:49
ok 15, LINENUM:52
ok 16, LINENUM:53
ok 17, LINENUM:57
ok 18, LINENUM:58
ok 19, LINENUM:59
ok 20, LINENUM:60
ok 21, LINENUM:61
ok 22, LINENUM:62
ok 23, LINENUM:63
ok 24, LINENUM:65
ok 25, LINENUM:66
ok 26, LINENUM:67
ok 27, LINENUM:68
ok 28, LINENUM:69
ok 29, LINENUM:70
ok 30, LINENUM:71
ok 31, LINENUM:72
ok 32, LINENUM:73
ok 33, LINENUM:75
ok 34, LINENUM:76
ok 35, LINENUM:78
ok 36, LINENUM:82
ok 37, LINENUM:83
ok 38, LINENUM:88
ok 39, LINENUM:93
ok
All tests successful.
Files=1, Tests=39, 44 wallclock secs ( 0.04 usr  0.01 sys +  2.96 cusr  3.92 
csys =  6.93 CPU)
Result: PASS
End of test ./tests/bitrot/bug-1294786.t




[17:42:48] Running tests in file ./tests/bitrot/bug-1373520.t
getfattr: Removing leading '/' from absolute path names
./tests/bitrot/bug-1373520.t .. 
1..26
ok 1, LINENUM:8
ok 2, LINENUM:9
ok 3, LINENUM:12
ok 4, LINENUM:13
ok 5, LINENUM:14
ok 6, LINENUM:17
ok 7, LINENUM:20
ok 8, LINENUM:21
ok 9, LINENUM:24
ok 10, LINENUM:25
ok 11, LINENUM:28
ok 12, LINENUM:30
ok 13, LINENUM:33
ok 14, LINENUM:39
ok 15, LINENUM:40
ok 16, LINENUM:41
ok 17, LINENUM:42
ok 18, LINENUM:44
ok 19, LINENUM:45
ok 20, LINENUM:46
ok 21, LINENUM:47
ok 22, LINENUM:50
ok 23, LINENUM:53
not ok 24 Got "0" instead of "512", LINENUM:54
FAILED COMMAND: 512 path_size /d/backends/patchy5/FILE1
ok 25, LINENUM:55
not ok 26 Got "0" instead of "512", LINENUM:56
FAILED COMMAND: 512 path_size /d/backends/patchy5/HL_FILE1
Failed 2/26 subtests 

Test Summary Report
---
./tests/bitrot/bug-1373520.t (Wstat: 0 Tests: 26 Failed: 2)
  Failed tests:  24, 26
Files=1, Tests=26, 196 wallclock secs ( 0.04 usr  0.00 sys +  9.45 cusr 13.72 
csys = 23.21 CPU)
Result: FAIL
./tests/bitrot/bug-1373520.t: bad status 1

   *
   *   REGRESSION FAILED   *
   * Retrying failed tests in case *
   * we got some spurious failures *
   *

getfattr: Removing leading '/' from absolute path names
./tests/bitrot/bug-1373520.t .. 
1..26
ok 1, LINENUM:8
ok 2, LINENUM:9
ok 3, LINENUM:12
ok 4, LINENUM:13
ok 5, LINENUM:14
ok 6, LINENUM:17
ok 7, LINENUM:20
ok 8, LINENUM:21
ok 9, LINENUM:24
ok 10, LINENUM:25
ok 11, LINENUM:28
ok 12, LINENUM:30
ok 13, LINENUM:33
ok 14, LINENUM:39
ok 15, LINENUM:40
ok 16, LINENUM:41
ok 17, LINENUM:42
ok 18, LINENUM:44
ok 19, LINENUM:45
ok 20, LINENUM:46
ok 21, LINENUM:47
ok 22, LINENUM:50
ok 23, LINENUM:53
not ok 24 Got "0" instead of "512", LINENUM:54
FAILED COMMAND: 512 path_size /d/backends/patchy5/FILE1
ok 25, LINENUM:55
not ok 26 Got "0" instead of "512", LINENUM:56
FAILED COMMAND: 512 path_size /d/backends/patchy5/HL_FILE1
Failed 2/26 subtests 

Test Summary Report
---
./tests/bitrot/bug-1373520.t (Wstat: 0 Tests: 26 Failed: 2)
  Failed tests:  24, 26
Files=1, Tests=26, 195 wallclock secs ( 0.04 usr  0.00 sys +  9.37 cusr 13.80 
csys = 23.21 CPU)
Result: FAIL
End of test ./tests/bitrot/bug-1373520.t



Run complete

Number of tests found: 131
Number of tests selected for run based on pattern: 131
Number of tests skipped as they were marked bad:   16
Number of tests skipped because of known_issues:   16
Number of tests that were run: 99

Tests ordered by time taken, slowest to fastest: 

./tests/basic/distribute/rebal-all-nodes-migrate.t  -  330 second
./tests/basic/afr/lk-quorum.t  -  265 second
./tests/basic/afr/split-brain-favorite-child-policy.t  -  263 second
./tests/bitrot/bug-1373520.t  -  196 second
./tests/basic/afr/gfid-mismatch-resolution-with-fav-child-policy.t  -  172 
second
./tests/basic/afr/sparse-file-self-heal.t  -  154 second
./tests/basic/afr/self-heal.t  -  151 second
./tests/basic/afr/self-heald.t  -  132 second
./tests/basic/afr/gfid-mismatch-resolution-with-cli.t  -  123 second
./tests/basic/afr/entry-self-heal.t  -  107 second
./tests/basic/afr/split-brain-heal-info.t  -  91 second
./tests/basic/afr/inodelk.t  -  73 second
./tests/basic/stats-dump.t  -  72 second
./tests/basic/afr/metadata-self-heal.t  -  72 second
./tests/basic/afr/quorum.t  -  70 second
./tests/basic/mount-nfs-auth.t  -  61 second
./tests/basic/afr/gfid-self-heal.t  -  58 second
./tests/basic/afr/split-brain-healing.t  -  58 second
./tests/basic/afr/arbiter.t  -  54 second
./tests/basic/afr/arbiter-ad

[Gluster-Maintainers] Build failed in Jenkins: netbsd-periodic #164

[jenkins]

See 

--
[...truncated 332.15 KB...]
ok 20, LINENUM:62
ok 21, LINENUM:63
ok 22, LINENUM:64
ok 23, LINENUM:65
ok 24, LINENUM:66
ok 25, LINENUM:67
ok 26, LINENUM:68
ok 27, LINENUM:69
ok 28, LINENUM:72
ok 29, LINENUM:75
ok 30, LINENUM:76
ok 31, LINENUM:78
ok 32, LINENUM:79
ok
All tests successful.
Files=1, Tests=32, 34 wallclock secs ( 0.04 usr  0.00 sys +  2.41 cusr  2.95 
csys =  5.40 CPU)
Result: PASS
End of test ./tests/basic/mount.t




[01:34:00] Running tests in file ./tests/basic/mpx-compat.t
./tests/basic/mpx-compat.t .. 
1..11
ok 1, LINENUM:19
ok 2, LINENUM:20
ok 3, LINENUM:25
ok 4, LINENUM:26
ok 5, LINENUM:29
ok 6, LINENUM:30
ok 7, LINENUM:36
ok 8, LINENUM:39
ok 9, LINENUM:40
ok 10, LINENUM:41
ok 11, LINENUM:44
volume set: success
ok
All tests successful.
Files=1, Tests=11, 44 wallclock secs ( 0.03 usr  0.01 sys + 4036536.30 cusr 
4036537.24 csys = 8073073.58 CPU)
Result: PASS
End of test ./tests/basic/mpx-compat.t




[01:34:44] Running tests in file ./tests/basic/multiplex.t
ERROR: failed to create logfile "/dev/stderr" (Permission denied)
ERROR: failed to create logfile "/dev/stderr" (Permission denied)
./tests/basic/multiplex.t .. 
1..32
ok 1, LINENUM:22
ok 2, LINENUM:23
ok 3, LINENUM:27
ok 4, LINENUM:28
ok 5, LINENUM:30
ok 6, LINENUM:32
ok 7, LINENUM:33
ok 8, LINENUM:35
ok 9, LINENUM:37
ok 10, LINENUM:38
ok 11, LINENUM:39
ok 12, LINENUM:40
ok 13, LINENUM:41
ok 14, LINENUM:43
ok 15, LINENUM:44
ok 16, LINENUM:46
ok 17, LINENUM:48
ok 18, LINENUM:49
ok 19, LINENUM:50
ok 20, LINENUM:54
ok 21, LINENUM:55
ok 22, LINENUM:56
ok 23, LINENUM:57
ok 24, LINENUM:58
ok 25, LINENUM:59
ok 26, LINENUM:62
ok 27, LINENUM:66
ok 28, LINENUM:72
ok 29, LINENUM:73
ok 30, LINENUM:76
ok 31, LINENUM:77
not ok 32 Got "2" instead of "1", LINENUM:78
FAILED COMMAND: 1 count_brick_processes
volume set: success
Failed 1/32 subtests 

Test Summary Report
---
./tests/basic/multiplex.t (Wstat: 0 Tests: 32 Failed: 1)
  Failed test:  32
Files=1, Tests=32, 35 wallclock secs ( 0.02 usr  0.01 sys +  3.40 cusr  3.80 
csys =  7.23 CPU)
Result: FAIL
./tests/basic/multiplex.t: bad status 1

   *
   *   REGRESSION FAILED   *
   * Retrying failed tests in case *
   * we got some spurious failures *
   *

ERROR: failed to create logfile "/dev/stderr" (Permission denied)
ERROR: failed to create logfile "/dev/stderr" (Permission denied)
./tests/basic/multiplex.t .. 
1..32
ok 1, LINENUM:22
ok 2, LINENUM:23
ok 3, LINENUM:27
ok 4, LINENUM:28
ok 5, LINENUM:30
ok 6, LINENUM:32
ok 7, LINENUM:33
ok 8, LINENUM:35
ok 9, LINENUM:37
ok 10, LINENUM:38
ok 11, LINENUM:39
ok 12, LINENUM:40
ok 13, LINENUM:41
ok 14, LINENUM:43
ok 15, LINENUM:44
ok 16, LINENUM:46
ok 17, LINENUM:48
ok 18, LINENUM:49
ok 19, LINENUM:50
ok 20, LINENUM:54
ok 21, LINENUM:55
ok 22, LINENUM:56
ok 23, LINENUM:57
ok 24, LINENUM:58
ok 25, LINENUM:59
ok 26, LINENUM:62
ok 27, LINENUM:66
ok 28, LINENUM:72
ok 29, LINENUM:73
ok 30, LINENUM:76
ok 31, LINENUM:77
not ok 32 Got "2" instead of "1", LINENUM:78
FAILED COMMAND: 1 count_brick_processes
volume set: success
Failed 1/32 subtests 

Test Summary Report
---
./tests/basic/multiplex.t (Wstat: 0 Tests: 32 Failed: 1)
  Failed test:  32
Files=1, Tests=32, 36 wallclock secs ( 0.04 usr  0.00 sys +  3.27 cusr  4.12 
csys =  7.43 CPU)
Result: FAIL
End of test ./tests/basic/multiplex.t



Run complete

Number of tests found: 84
Number of tests selected for run based on pattern: 84
Number of tests skipped as they were marked bad:   5
Number of tests skipped because of known_issues:   3
Number of tests that were run: 76

Tests ordered by time taken, slowest to fastest: 

./tests/basic/distribute/rebal-all-nodes-migrate.t  -  372 second
./tests/basic/afr/lk-quorum.t  -  267 second
./tests/basic/afr/split-brain-favorite-child-policy.t  -  249 second
./tests/basic/afr/gfid-mismatch-resolution-with-fav-child-policy.t  -  168 
second
./tests/basic/afr/self-heal.t  -  150 second
./tests/basic/afr/sparse-file-self-heal.t  -  145 second
./tests/basic/afr/self-heald.t  -  132 second
./tests/basic/afr/gfid-mismatch-resolution-with-cli.t  -  123 second
./tests/basic/afr/entry-self-heal.t  -  101 second
./tests/basic/afr/split-brain-heal-inf