Ok, I will check if this is catching the data corruption or not after modifying the code in EC. Initially it was not doing so.
----- Original Message ----- From: "Atin Mukherjee" <amukh...@redhat.com> To: "Ashish Pandey" <aspan...@redhat.com> Cc: "Gluster Devel" <gluster-devel@gluster.org> Sent: Monday, June 12, 2017 3:21:29 PM Subject: Re: Build failed in Jenkins: regression-test-with-multiplex #60 On Mon, Jun 12, 2017 at 11:37 AM, Atin Mukherjee < amukh...@redhat.com > wrote: On Mon, Jun 12, 2017 at 11:15 AM, Ashish Pandey < aspan...@redhat.com > wrote: <blockquote> Test is failing because of ENOTCONN. -----------------------------------------------------------------------------+ [2017-06-11 21:26:04.650497] I [fuse-bridge.c:4210:fuse_init] 0-glusterfs-fuse: FUSE inited with protocol versions: glusterfs 7.24 kernel 7.14 [2017-06-11 21:26:04.650546] I [fuse-bridge.c:4840:fuse_graph_sync] 0-fuse: switched to graph 0 [2017-06-11 21:26:04.650890] E [fuse-bridge.c:4276:fuse_first_lookup] 0-fuse: first lookup on root failed (Transport endpoint is not connected) [2017-06-11 21:26:04.651204] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:04.651231] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 2: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed [2017-06-11 21:26:04.651379] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:04.651396] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 3: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed [2017-06-11 21:26:05.654880] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:05.654921] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 4: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed [2017-06-11 21:26:05.655105] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:05.655132] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 5: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed [2017-06-11 21:26:06.658233] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:06.658294] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 6: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed [2017-06-11 21:26:06.658445] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:06.658471] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 7: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed [2017-06-11 21:26:07.661446] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:07.661487] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 8: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed [2017-06-11 21:26:07.661625] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:07.661642] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 9: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed [2017-06-11 21:26:08.664545] W [fuse-resolve.c:132:fuse_resolve_gfid_cbk] 0-fuse: 00000000-0000-0000-0000-000000000001: failed to resolve (Transport endpoint is not connected) [2017-06-11 21:26:08.664598] E [fuse-bridge.c:881:fuse_getattr_resume] 0-glusterfs-fuse: 10: GETATTR 1 (00000000-0000-0000-0000-000000000001) resolution failed In this test, we are trying to kill a brick and starting it using command line. I think that is what actually failing. In multiplexing, can we do it? Or is there some other way of doing the same thing? What's the reason of starting the brick from cmdline? Why can't we start the volume with force? </blockquote> Posted a patch : https://review.gluster.org/#/c/17508 <blockquote> <blockquote> Ashish From: "Atin Mukherjee" < amukh...@redhat.com > To: "Ashish Pandey" < aspan...@redhat.com > Cc: "Gluster Devel" < gluster-devel@gluster.org > Sent: Monday, June 12, 2017 10:10:05 AM Subject: Fwd: Build failed in Jenkins: regression-test-with-multiplex #60 https://review.gluster.org/#/c/16985/ has introduced a new test ec-data-heal.t which is now constantly failing with brick multiplexing. Can this be looked at? ---------- Forwarded message ---------- From: < jenk...@build.gluster.org > Date: Mon, Jun 12, 2017 at 6:33 AM Subject: Build failed in Jenkins: regression-test-with-multiplex #60 To: maintain...@gluster.org , j...@pl.atyp.us , avish...@redhat.com , pkara...@redhat.com , amukh...@redhat.com , xhernan...@datalab.es , rgowd...@redhat.com , nde...@redhat.com See < https://build.gluster.org/job/regression-test-with-multiplex/60/display/redirect > ------------------------------------------ [...truncated 747.65 KB...] ./tests/basic/glusterd/arbiter-volume-probe.t - 14 second ./tests/basic/gfid-access.t - 14 second ./tests/basic/ec/ec-root-heal.t - 14 second ./tests/basic/afr/stale-file-lookup.t - 14 second ./tests/bugs/replicate/bug-986905.t - 13 second ./tests/bugs/replicate/bug-921231.t - 13 second ./tests/bugs/replicate/bug-1325792.t - 13 second ./tests/bugs/replicate/bug-1132102.t - 13 second ./tests/bugs/quota/bug-1250582-volume-reset-should-not-remove-quota-quota-deem-statfs.t - 13 second ./tests/bugs/quota/bug-1178130.t - 13 second ./tests/bugs/protocol/bug-762989.t - 13 second ./tests/bugs/posix/bug-1360679.t - 13 second ./tests/bugs/glusterd/bug-955588.t - 13 second ./tests/bugs/glusterd/bug-1242875-do-not-pass-volinfo-quota.t - 13 second ./tests/bugs/fuse/bug-985074.t - 13 second ./tests/bugs/bitrot/1207029-bitrot-daemon-should-start-on-valid-node.t - 13 second ./tests/bitrot/bug-1207627-bitrot-scrub-status.t - 13 second ./tests/basic/volume-status.t - 13 second ./tests/basic/stats-dump.t - 13 second ./tests/basic/inode-quota-enforcing.t - 13 second ./tests/bugs/replicate/bug-1448804-check-quorum-type-values.t - 12 second ./tests/bugs/nfs/bug-904065.t - 12 second ./tests/bugs/nfs/bug-1157223-symlink-mounting.t - 12 second ./tests/bugs/glusterfs/bug-902610.t - 12 second ./tests/bugs/glusterfs/bug-872923.t - 12 second ./tests/bugs/glusterd/bug-949930.t - 12 second ./tests/bugs/glusterd/bug-889630.t - 12 second ./tests/bugs/glusterd/bug-1121584-brick-existing-validation-for-remove-brick-status-stop.t - 12 second ./tests/bugs/distribute/bug-961615.t - 12 second ./tests/bugs/distribute/bug-1247563.t - 12 second ./tests/bugs/distribute/bug-1088231.t - 12 second ./tests/bugs/distribute/bug-1086228.t - 12 second ./tests/bugs/cli/bug-1087487.t - 12 second ./tests/bugs/cli/bug-1030580.t - 12 second ./tests/bugs/cli/bug-1022905.t - 12 second ./tests/bugs/bitrot/1209818-vol-info-show-scrub-process-properly.t - 12 second ./tests/basic/quota-nfs.t - 12 second ./tests/basic/pump.t - 12 second ./tests/basic/md-cache/bug-1317785.t - 12 second ./tests/basic/fop-sampling.t - 12 second ./tests/performance/open-behind.t - 11 second ./tests/features/ssl-authz.t - 11 second ./tests/bugs/upcall/bug-1458127.t - 11 second ./tests/bugs/upcall/bug-1227204.t - 11 second ./tests/bugs/transport/bug-873367.t - 11 second ./tests/bugs/snapshot/bug-1260848.t - 11 second ./tests/bugs/replicate/bug-1250170-fsync.t - 11 second ./tests/bugs/posix/bug-1122028.t - 11 second ./tests/bugs/md-cache/bug-1211863.t - 11 second ./tests/bugs/io-cache/bug-read-hang.t - 11 second ./tests/bugs/glusterd/bug-948729/bug-948729.t - 11 second ./tests/bugs/glusterd/bug-948729/bug-948729-mode-script.t - 11 second ./tests/bugs/glusterd/bug-948729/bug-948729-force.t - 11 second ./tests/bugs/glusterd/bug-1046308.t - 11 second ./tests/bugs/ec/bug-1179050.t - 11 second ./tests/bugs/distribute/bug-1122443.t - 11 second ./tests/bugs/changelog/bug-1208470.t - 11 second ./tests/bitrot/br-stub.t - 11 second ./tests/basic/gfapi/gfapi-dup.t - 11 second ./tests/basic/gfapi/bug-1241104.t - 11 second ./tests/basic/ec/ec-read-policy.t - 11 second ./tests/basic/ec/ec-anonymous-fd.t - 11 second ./tests/features/readdir-ahead.t - 10 second ./tests/bugs/tier/bug-1205545-CTR-and-trash-integration.t - 10 second ./tests/bugs/snapshot/bug-1064768.t - 10 second ./tests/bugs/replicate/bug-966018.t - 10 second ./tests/bugs/replicate/bug-1365455.t - 10 second ./tests/bugs/replicate/bug-1101647.t - 10 second ./tests/bugs/quota/bug-1287996.t - 10 second ./tests/bugs/quota/bug-1243798.t - 10 second ./tests/bugs/quota/bug-1104692.t - 10 second ./tests/bugs/posix/bug-990028.t - 10 second ./tests/bugs/md-cache/afr-stale-read.t - 10 second ./tests/bugs/glusterfs/bug-856455.t - 10 second ./tests/bugs/glusterd/bug-888752.t - 10 second ./tests/bugs/glusterd/bug-1179175-uss-option-validation.t - 10 second ./tests/bugs/glusterd/bug-1102656.t - 10 second ./tests/bugs/glusterd/bug-1091935-brick-order-check-from-cli-to-glusterd.t - 10 second ./tests/bugs/glusterd/bug-1022055.t - 10 second ./tests/bugs/ec/bug-1227869.t - 10 second ./tests/bugs/core/bug-834465.t - 10 second ./tests/bugs/bug-1258069.t - 10 second ./tests/bugs/bitrot/bug-1229134-bitd-not-support-vol-set.t - 10 second ./tests/basic/tier/ctr-rename-overwrite.t - 10 second ./tests/basic/gfapi/upcall-cache-invalidate.t - 10 second ./tests/basic/gfapi/libgfapi-fini-hang.t - 10 second ./tests/basic/gfapi/glfs_xreaddirplus_r.t - 10 second ./tests/basic/gfapi/anonymous_fd.t - 10 second ./tests/basic/afr/gfid-heal.t - 10 second ./tests/basic/afr/arbiter-remove-brick.t - 10 second ./tests/bugs/upcall/bug-1369430.t - 9 second ./tests/bugs/snapshot/bug-1178079.t - 9 second ./tests/bugs/shard/bug-1342298.t - 9 second ./tests/bugs/shard/bug-1260637.t - 9 second ./tests/bugs/shard/bug-1258334.t - 9 second ./tests/bugs/replicate/bug-767585-gfid.t - 9 second ./tests/bugs/readdir-ahead/bug-1439640.t - 9 second ./tests/bugs/posix/bug-1175711.t - 9 second ./tests/bugs/nfs/bug-915280.t - 9 second ./tests/bugs/nfs/bug-877885.t - 9 second ./tests/bugs/nfs/bug-1143880-fix-gNFSd-auth-crash.t - 9 second ./tests/bugs/nfs/bug-1116503.t - 9 second ./tests/bugs/io-cache/bug-858242.t - 9 second ./tests/bugs/glusterfs/bug-895235.t - 9 second ./tests/bugs/glusterfs/bug-848251.t - 9 second ./tests/bugs/glusterd/bug-1454418-seg-fault.t - 9 second ./tests/bugs/glusterd/bug-1446172-brick-mux-reset-brick.t - 9 second ./tests/bugs/glusterd/bug-1344407-volume-delete-on-node-down.t - 9 second ./tests/bugs/glusterd/bug-1266818-shared-storage-disable.t - 9 second ./tests/bugs/distribute/bug-884597.t - 9 second ./tests/bugs/core/bug-986429.t - 9 second ./tests/bugs/core/bug-908146.t - 9 second ./tests/bugs/core/bug-1119582.t - 9 second ./tests/bugs/bitrot/bug-1210684-scrub-pause-resume-error-handling.t - 9 second ./tests/bitrot/bug-1221914.t - 9 second ./tests/basic/ec/nfs.t - 9 second ./tests/basic/ec/ec-internal-xattrs.t - 9 second ./tests/basic/ec/ec-fallocate.t - 9 second ./tests/basic/ec/dht-rename.t - 9 second ./tests/basic/distribute/bug-1265677-use-readdirp.t - 9 second ./tests/bugs/upcall/bug-upcall-stat.t - 8 second ./tests/bugs/unclassified/bug-1034085.t - 8 second ./tests/bugs/snapshot/bug-1111041.t - 8 second ./tests/bugs/shard/bug-1259651.t - 8 second ./tests/bugs/shard/bug-1256580.t - 8 second ./tests/bugs/shard/bug-1245547.t - 8 second ./tests/bugs/replicate/bug-976800.t - 8 second ./tests/bugs/replicate/bug-880898.t - 8 second ./tests/bugs/nfs/zero-atime.t - 8 second ./tests/bugs/nfs/socket-as-fifo.t - 8 second ./tests/bugs/nfs/bug-1166862.t - 8 second ./tests/bugs/md-cache/bug-1211863_unlink.t - 8 second ./tests/bugs/glusterfs-server/bug-873549.t - 8 second ./tests/bugs/glusterfs-server/bug-864222.t - 8 second ./tests/bugs/glusterfs/bug-893378.t - 8 second ./tests/bugs/glusterd/bug-839595.t - 8 second ./tests/bugs/glusterd/bug-1163108-min-free-disk-option-validation.t - 8 second ./tests/bugs/distribute/bug-912564.t - 8 second ./tests/bugs/distribute/bug-1368012.t - 8 second ./tests/bugs/core/io-stats-1322825.t - 8 second ./tests/bugs/core/bug-913544.t - 8 second ./tests/bugs/cli/bug-961307.t - 8 second ./tests/bugs/access-control/bug-1051896.t - 8 second ./tests/basic/afr/heal-info.t - 8 second ./tests/performance/quick-read.t - 7 second ./tests/features/leases.t - 7 second ./tests/bugs/upcall/bug-1422776.t - 7 second ./tests/bugs/upcall/bug-1394131.t - 7 second ./tests/bugs/trace/bug-797171.t - 7 second ./tests/bugs/shard/bug-1272986.t - 7 second ./tests/bugs/shard/bug-1250855.t - 7 second ./tests/bugs/rpc/bug-954057.t - 7 second ./tests/bugs/replicate/bug-886998.t - 7 second ./tests/bugs/read-only/bug-1134822-read-only-default-in-graph.t - 7 second ./tests/bugs/quick-read/bug-846240.t - 7 second ./tests/bugs/posix/bug-765380.t - 7 second ./tests/bugs/nl-cache/bug-1451588.t - 7 second ./tests/bugs/nfs/subdir-trailing-slash.t - 7 second ./tests/bugs/nfs/showmount-many-clients.t - 7 second ./tests/bugs/nfs/bug-847622.t - 7 second ./tests/bugs/nfs/bug-1210338.t - 7 second ./tests/bugs/nfs/bug-1161092-nfs-acls.t - 7 second ./tests/bugs/glusterfs-server/bug-861542.t - 7 second ./tests/bugs/glusterd/bug-878004.t - 7 second ./tests/bugs/glusterd/bug-1095097.t - 7 second ./tests/bugs/glusterd/bug-1094119-remove-replace-brick-support-from-glusterd.t - 7 second ./tests/bugs/glusterd/bug-1092841.t - 7 second ./tests/bugs/glusterd/bug-1085330.t - 7 second ./tests/bugs/geo-replication/bug-1296496.t - 7 second ./tests/bugs/fuse/bug-1283103.t - 7 second ./tests/bugs/fuse/bug-1126048.t - 7 second ./tests/bugs/distribute/bug-907072.t - 7 second ./tests/bugs/core/bug-1168803-snapd-option-validation-fix.t - 7 second ./tests/bugs/core/949327.t - 7 second ./tests/bugs/cli/bug-983317-volume-get.t - 7 second ./tests/bugs/cli/bug-867252.t - 7 second ./tests/bugs/cli/bug-1004218.t - 7 second ./tests/bugs/access-control/bug-1387241.t - 7 second ./tests/bitrot/bug-internal-xattrs-check-1243391.t - 7 second ./tests/basic/nl-cache.t - 7 second ./tests/basic/gfapi/glfs_sysrq.t - 7 second ./tests/basic/gfapi/gfapi-trunc.t - 7 second ./tests/basic/gfapi/gfapi-async-calls-test.t - 7 second ./tests/features/ipc.t - 6 second ./tests/bugs/shard/bug-1261773.t - 6 second ./tests/bugs/readdir-ahead/bug-1446516.t - 6 second ./tests/bugs/nfs/bug-970070.t - 6 second ./tests/bugs/nfs/bug-1302948.t - 6 second ./tests/bugs/glusterfs-server/bug-889996.t - 6 second ./tests/bugs/glusterfs-server/bug-877992.t - 6 second ./tests/bugs/glusterfs/bug-869724.t - 6 second ./tests/bugs/glusterfs/bug-844688.t - 6 second ./tests/bugs/glusterd/bug-958790.t - 6 second ./tests/bugs/glusterd/bug-905307.t - 6 second ./tests/bugs/glusterd/bug-862834.t - 6 second ./tests/bugs/glusterd/bug-1314649-group-virt.t - 6 second ./tests/bugs/glusterd/bug-1199451-op-version-retrieving-fix.t - 6 second ./tests/bugs/fuse/bug-1336818.t - 6 second ./tests/bugs/fuse/bug-1309462.t - 6 second ./tests/bugs/distribute/bug-924265.t - 6 second ./tests/bugs/distribute/bug-1204140.t - 6 second ./tests/bugs/core/log-bug-1362520.t - 6 second ./tests/bugs/core/bug-903336.t - 6 second ./tests/bugs/core/bug-1421721-mpx-toggle.t - 6 second ./tests/bugs/core/bug-1135514-allow-setxattr-with-null-value.t - 6 second ./tests/bugs/cli/bug-1378842-volume-get-all.t - 6 second ./tests/basic/quota-rename.t - 6 second ./tests/basic/md-cache/bug-1418249.t - 6 second ./tests/basic/gfapi/gfapi-load-volfile.t - 6 second ./tests/basic/fops-sanity.t - 6 second ./tests/bugs/unclassified/bug-991622.t - 5 second ./tests/bugs/replicate/bug-884328.t - 5 second ./tests/bugs/logging/bug-823081.t - 5 second ./tests/bugs/glusterfs/bug-892730.t - 5 second ./tests/bugs/glusterfs/bug-860297.t - 5 second ./tests/bugs/glusterfs/bug-811493.t - 5 second ./tests/bugs/glusterd/bug-916549.t - 5 second ./tests/bugs/glusterd/bug-913487.t - 5 second ./tests/bugs/glusterd/bug-1433578-invalid-peer-glusterd-crash.t - 5 second ./tests/bugs/glusterd/bug-1321836-fix-opret-for-volume-info-xml-output.t - 5 second ./tests/bugs/glusterd/bug-1315186-reject-lowering-down-op-version.t - 5 second ./tests/bugs/glusterd/bug-1238135-lazy-daemon-initialization-on-demand.t - 5 second ./tests/bugs/glusterd/bug-000000.t - 5 second ./tests/bugs/core/bug-924075.t - 5 second ./tests/bugs/core/bug-845213.t - 5 second ./tests/bugs/core/bug-1117951.t - 5 second ./tests/bugs/core/bug-1111557.t - 5 second ./tests/bugs/cli/bug-977246.t - 5 second ./tests/bugs/cli/bug-969193.t - 5 second ./tests/bugs/cli/bug-949298.t - 5 second ./tests/bugs/cli/bug-764638.t - 5 second ./tests/bugs/cli/bug-1047378.t - 5 second ./tests/basic/afr/arbiter-cli.t - 5 second ./tests/bugs/glusterfs/bug-853690.t - 4 second ./tests/bugs/cli/bug-921215.t - 4 second ./tests/basic/gfapi/sink.t - 2 second ./tests/features/glupy.t - 1 second ./tests/bugs/shard/zero-flag.t - 1 second ./tests/basic/posixonly.t - 1 second ./tests/basic/netgroup_parsing.t - 1 second ./tests/basic/exports_parsing.t - 1 second ./tests/basic/first-test.t - 0 second Result is 1 tar: Removing leading `/' from member names Logs archived in http://slave26.cloud.gluster.org/logs/glusterfs-logs-regression-test-with-multiplex-60.tgz kernel.core_pattern = /%e-%p.core Build step 'Execute shell' marked build as failure </blockquote> </blockquote>
_______________________________________________ Gluster-devel mailing list Gluster-devel@gluster.org http://lists.gluster.org/mailman/listinfo/gluster-devel
