Re: [ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-05 Thread Vladimir Sokolovsky

Hi David,
Yes, you have to reboot or reload drivers as you tried to load the new 
rpcrdma kernel module over the old version (in-box or previous OFED 
build) of ib_core and not the one coming with the same OFED.


Regards,
Vladimir

On 09/05/2017 11:43 PM, David Z. Dai wrote:

Hi, Vlad:
   No, I didn't reboot the server after a successful OFED installation,
and I didn't restart the openibd either. I don't remember I did this
with OFED-3.18 release.

I follow your suggestion, did a reboot after the installation. Now it works 
fine!
[root@rhel73_host1_guest1_local_htx ~]# modprobe rpcrdma
[root@rhel73_host1_guest1_local_htx ~]#
[root@rhel73_host1_guest1_local_htx ~]# lsmod |grep rpcrdma
rpcrdma   106978  0

[root@rhel73_host1_guest1_local_htx ~]# modprobe -r rpcrdma
[root@rhel73_host1_guest1_local_htx ~]#

I haven't tested the functionality yet. At least module is loading fine now.

Thanks for the help! - David Dai

On Tue, 2017-09-05 at 23:18 +0300, Vladimir Sokolovsky wrote:

Hi David,
Did you reboot the server after OFED installation or reloaded drivers
with "/etc/init.d/openibd restart" command?

Regards,
Vladimir

On 09/05/2017 10:51 PM, David Z. Dai wrote:

Hi, Jeff:
It has the same error when loading "rpmcrdma" directly.
[root@rhel73_host1_guest1_local_htx modules]# modprobe rpcrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error

I also change the "rpcrdma.ko" mode from 644 to 744. It still has the
same issue.

Thanks! - David Dai

On Tue, 2017-09-05 at 12:33 -0700, Jeff Becker wrote:

Hi,

I responded to the bugzilla 2633. In short, please try "modprobe
rpcrdma" directly, and just once as it now contains both server and
client. Thanks.

-jeff

On 09/05/2017 12:25 PM, David Z. Dai wrote:

Hi, Vlad, Jeff:
Today I got the latest daily build from:
https://urldefense.proofpoint.com/v2/url?u=http-3A__downloads.openfabrics.org_OFED_ofed-2D4.8-2D1-2Ddaily_OFED-2D4.8-2D1-2D20170905-2D0757.tgz=DwICaQ=jf_iaSHvJObTbx-siA1ZOg=jE7tivF653Vygp552zF5nqagPKJAuy1x71Qnyf3szIw=g18gQ6E3E67ica6Ua-VcSfLqUhqoidoQ6p9JBZX16ZM=7P1W9rvFy-ZeD1z4hfqzovK40umK372kBX0EKXyeYfQ=
This latest daily build includes the NFSoRDMA functionality now.

I did a full install on RHEL 7.3 LE OS:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# uname -a
Linux rhel73_host1_guest1_local_htx 3.10.0-514.el7.ppc64le #1 SMP Wed Oct 19
11:27:06 EDT 2016 ppc64le ppc64le ppc64le GNU/Linux

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ./install.pl  
--all

The installation finished successfully.

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ofed_info -s
OFED-4.8-1-20170905-0757:

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo xprtrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo svcrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592n
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions

They are not in "nfsrdma" rpm any more. They are now in "compat-rdma" rpm:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko

However I see the error during module load time:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe xprtrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# 

Re: [ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-05 Thread David Z. Dai
Hi, Vlad:
  No, I didn't reboot the server after a successful OFED installation,
and I didn't restart the openibd either. I don't remember I did this
with OFED-3.18 release.

I follow your suggestion, did a reboot after the installation. Now it works 
fine!
[root@rhel73_host1_guest1_local_htx ~]# modprobe rpcrdma
[root@rhel73_host1_guest1_local_htx ~]# 
[root@rhel73_host1_guest1_local_htx ~]# lsmod |grep rpcrdma
rpcrdma   106978  0 

[root@rhel73_host1_guest1_local_htx ~]# modprobe -r rpcrdma
[root@rhel73_host1_guest1_local_htx ~]# 

I haven't tested the functionality yet. At least module is loading fine now.

Thanks for the help! - David Dai

On Tue, 2017-09-05 at 23:18 +0300, Vladimir Sokolovsky wrote:
> Hi David,
> Did you reboot the server after OFED installation or reloaded drivers 
> with "/etc/init.d/openibd restart" command?
> 
> Regards,
> Vladimir
> 
> On 09/05/2017 10:51 PM, David Z. Dai wrote:
> > Hi, Jeff:
> > It has the same error when loading "rpmcrdma" directly.
> > [root@rhel73_host1_guest1_local_htx modules]# modprobe rpcrdma
> > modprobe: ERROR: could not insert 'rpcrdma': Exec format error
> >
> > I also change the "rpcrdma.ko" mode from 644 to 744. It still has the
> > same issue.
> >
> > Thanks! - David Dai
> >
> > On Tue, 2017-09-05 at 12:33 -0700, Jeff Becker wrote:
> >> Hi,
> >>
> >> I responded to the bugzilla 2633. In short, please try "modprobe
> >> rpcrdma" directly, and just once as it now contains both server and
> >> client. Thanks.
> >>
> >> -jeff
> >>
> >> On 09/05/2017 12:25 PM, David Z. Dai wrote:
> >>> Hi, Vlad, Jeff:
> >>> Today I got the latest daily build from:
> >>> https://urldefense.proofpoint.com/v2/url?u=http-3A__downloads.openfabrics.org_OFED_ofed-2D4.8-2D1-2Ddaily_OFED-2D4.8-2D1-2D20170905-2D0757.tgz=DwICaQ=jf_iaSHvJObTbx-siA1ZOg=jE7tivF653Vygp552zF5nqagPKJAuy1x71Qnyf3szIw=g18gQ6E3E67ica6Ua-VcSfLqUhqoidoQ6p9JBZX16ZM=7P1W9rvFy-ZeD1z4hfqzovK40umK372kBX0EKXyeYfQ=
> >>> This latest daily build includes the NFSoRDMA functionality now.
> >>>
> >>> I did a full install on RHEL 7.3 LE OS:
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# uname -a
> >>> Linux rhel73_host1_guest1_local_htx 3.10.0-514.el7.ppc64le #1 SMP Wed Oct 
> >>> 19
> >>> 11:27:06 EDT 2016 ppc64le ppc64le ppc64le GNU/Linux
> >>>
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# 
> >>> ./install.pl  --all
> >>>
> >>> The installation finished successfully.
> >>>
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ofed_info 
> >>> -s
> >>> OFED-4.8-1-20170905-0757:
> >>>
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo 
> >>> xprtrdma
> >>> filename:  
> >>> /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >>> alias:  xprtrdma
> >>> alias:  svcrdma
> >>> license:Dual BSD/GPL
> >>> description:RPC/RDMA Transport
> >>> author: Open Grid Computing and Network Appliance, Inc.
> >>> rhelversion:7.3
> >>> srcversion: 9629610592FC8363A00B592
> >>> depends:sunrpc,compat,ib_core,rdma_cm
> >>> vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions
> >>>
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo 
> >>> svcrdma
> >>> filename:  
> >>> /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >>> alias:  xprtrdma
> >>> alias:  svcrdma
> >>> license:Dual BSD/GPL
> >>> description:RPC/RDMA Transport
> >>> author: Open Grid Computing and Network Appliance, Inc.
> >>> rhelversion:7.3
> >>> srcversion: 9629610592FC8363A00B592n
> >>> depends:sunrpc,compat,ib_core,rdma_cm
> >>> vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions
> >>>
> >>> They are not in "nfsrdma" rpm any more. They are now in "compat-rdma" rpm:
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
> >>> /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >>> compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le
> >>>
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
> >>> /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >>> compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le
> >>>
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
> >>> /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >>> -rw-r--r--. 1 root root 6031120 Sep  5 14:24 
> >>> /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >>> [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
> >>> /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >>> -rw-r--r--. 1 root root 6031120 Sep  5 14:24 
> >>> /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >>>
> >>> However I see the error during module 

Re: [ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-05 Thread Vladimir Sokolovsky

Hi David,
Did you reboot the server after OFED installation or reloaded drivers 
with "/etc/init.d/openibd restart" command?


Regards,
Vladimir

On 09/05/2017 10:51 PM, David Z. Dai wrote:

Hi, Jeff:
It has the same error when loading "rpmcrdma" directly.
[root@rhel73_host1_guest1_local_htx modules]# modprobe rpcrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error

I also change the "rpcrdma.ko" mode from 644 to 744. It still has the
same issue.

Thanks! - David Dai

On Tue, 2017-09-05 at 12:33 -0700, Jeff Becker wrote:

Hi,

I responded to the bugzilla 2633. In short, please try "modprobe
rpcrdma" directly, and just once as it now contains both server and
client. Thanks.

-jeff

On 09/05/2017 12:25 PM, David Z. Dai wrote:

Hi, Vlad, Jeff:
Today I got the latest daily build from:
https://urldefense.proofpoint.com/v2/url?u=http-3A__downloads.openfabrics.org_OFED_ofed-2D4.8-2D1-2Ddaily_OFED-2D4.8-2D1-2D20170905-2D0757.tgz=DwICaQ=jf_iaSHvJObTbx-siA1ZOg=jE7tivF653Vygp552zF5nqagPKJAuy1x71Qnyf3szIw=g18gQ6E3E67ica6Ua-VcSfLqUhqoidoQ6p9JBZX16ZM=7P1W9rvFy-ZeD1z4hfqzovK40umK372kBX0EKXyeYfQ=
This latest daily build includes the NFSoRDMA functionality now.

I did a full install on RHEL 7.3 LE OS:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# uname -a
Linux rhel73_host1_guest1_local_htx 3.10.0-514.el7.ppc64le #1 SMP Wed Oct 19
11:27:06 EDT 2016 ppc64le ppc64le ppc64le GNU/Linux

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ./install.pl  
--all

The installation finished successfully.

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ofed_info -s
OFED-4.8-1-20170905-0757:

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo xprtrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo svcrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592n
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions

They are not in "nfsrdma" rpm any more. They are now in "compat-rdma" rpm:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko

However I see the error during module load time:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe xprtrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe svcrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error


NOTE:
1) Both xprtrdma and svcrdma are using same "rpcrdma.ko"  (see modinfo output 
above)
2) The mode of "rpcrdma.ko" is 644. Should it be at least 744?

Could you please check on this?

Thanks! - David
On Sat, 2017-09-02 at 00:59 +0300, Vladimir Sokolovsky wrote:

Applied + build: OFED-4.8-1-20170901-1439

Regards,
Vladimir

On 09/02/2017 12:44 AM, Jeff Becker wrote:

Hi Vlad,

Please apply the attached patches to compat-rdma.git. Together with
the previous two patches, these have been tested with RHEL7.3 and
SLES12SP2. Thanks.

-jeff


___
ewg mailing list
ewg@lists.openfabrics.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.openfabrics.org_mailman_listinfo_ewg=DwIGaQ=jf_iaSHvJObTbx-siA1ZOg=jE7tivF653Vygp552zF5nqagPKJAuy1x71Qnyf3szIw=antYpg37AAv4LKbRqOFw77idqtt-Kxw8KtFSKz_3UJE=RNm5Hv7MRR_y-c_JC9pR1ZHCbLAkAtQh5HJCBEOEfj0=





Re: [ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-05 Thread Jeff Becker

On 09/05/2017 12:51 PM, David Z. Dai wrote:

Hi, Jeff:
It has the same error when loading "rpmcrdma" directly.
[root@rhel73_host1_guest1_local_htx modules]# modprobe rpcrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error

I also change the "rpcrdma.ko" mode from 644 to 744. It still has the
same issue.


Since you're on IBM Power architecture I suspect this may be a factor - 
I only have access to x86_64 for development and testing. Perhaps 
someone at UNHIOL could verify? Thanks.


-jeff


Thanks! - David Dai

On Tue, 2017-09-05 at 12:33 -0700, Jeff Becker wrote:

Hi,

I responded to the bugzilla 2633. In short, please try "modprobe
rpcrdma" directly, and just once as it now contains both server and
client. Thanks.

-jeff

On 09/05/2017 12:25 PM, David Z. Dai wrote:

Hi, Vlad, Jeff:
Today I got the latest daily build from:
https://urldefense.proofpoint.com/v2/url?u=http-3A__downloads.openfabrics.org_OFED_ofed-2D4.8-2D1-2Ddaily_OFED-2D4.8-2D1-2D20170905-2D0757.tgz=DwICaQ=jf_iaSHvJObTbx-siA1ZOg=jE7tivF653Vygp552zF5nqagPKJAuy1x71Qnyf3szIw=g18gQ6E3E67ica6Ua-VcSfLqUhqoidoQ6p9JBZX16ZM=7P1W9rvFy-ZeD1z4hfqzovK40umK372kBX0EKXyeYfQ=
This latest daily build includes the NFSoRDMA functionality now.

I did a full install on RHEL 7.3 LE OS:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# uname -a
Linux rhel73_host1_guest1_local_htx 3.10.0-514.el7.ppc64le #1 SMP Wed Oct 19
11:27:06 EDT 2016 ppc64le ppc64le ppc64le GNU/Linux

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ./install.pl  
--all

The installation finished successfully.

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ofed_info -s
OFED-4.8-1-20170905-0757:

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo xprtrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo svcrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592n
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions

They are not in "nfsrdma" rpm any more. They are now in "compat-rdma" rpm:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko

However I see the error during module load time:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe xprtrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe svcrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error


NOTE:
1) Both xprtrdma and svcrdma are using same "rpcrdma.ko"  (see modinfo output 
above)
2) The mode of "rpcrdma.ko" is 644. Should it be at least 744?

Could you please check on this?

Thanks! - David
On Sat, 2017-09-02 at 00:59 +0300, Vladimir Sokolovsky wrote:

Applied + build: OFED-4.8-1-20170901-1439

Regards,
Vladimir

On 09/02/2017 12:44 AM, Jeff Becker wrote:

Hi Vlad,

Please apply the attached patches to compat-rdma.git. Together with
the previous two patches, these have been tested with RHEL7.3 and
SLES12SP2. Thanks.

-jeff


___
ewg mailing list
ewg@lists.openfabrics.org

Re: [ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-05 Thread David Z. Dai
Hi, Jeff:
It has the same error when loading "rpmcrdma" directly.
[root@rhel73_host1_guest1_local_htx modules]# modprobe rpcrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error

I also change the "rpcrdma.ko" mode from 644 to 744. It still has the
same issue.

Thanks! - David Dai

On Tue, 2017-09-05 at 12:33 -0700, Jeff Becker wrote:
> Hi,
> 
> I responded to the bugzilla 2633. In short, please try "modprobe 
> rpcrdma" directly, and just once as it now contains both server and 
> client. Thanks.
> 
> -jeff
> 
> On 09/05/2017 12:25 PM, David Z. Dai wrote:
> > Hi, Vlad, Jeff:
> > Today I got the latest daily build from:
> > https://urldefense.proofpoint.com/v2/url?u=http-3A__downloads.openfabrics.org_OFED_ofed-2D4.8-2D1-2Ddaily_OFED-2D4.8-2D1-2D20170905-2D0757.tgz=DwICaQ=jf_iaSHvJObTbx-siA1ZOg=jE7tivF653Vygp552zF5nqagPKJAuy1x71Qnyf3szIw=g18gQ6E3E67ica6Ua-VcSfLqUhqoidoQ6p9JBZX16ZM=7P1W9rvFy-ZeD1z4hfqzovK40umK372kBX0EKXyeYfQ=
> >  
> > This latest daily build includes the NFSoRDMA functionality now.
> >
> > I did a full install on RHEL 7.3 LE OS:
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# uname -a
> > Linux rhel73_host1_guest1_local_htx 3.10.0-514.el7.ppc64le #1 SMP Wed Oct 19
> > 11:27:06 EDT 2016 ppc64le ppc64le ppc64le GNU/Linux
> >
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ./install.pl 
> >  --all
> >
> > The installation finished successfully.
> >
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ofed_info -s
> > OFED-4.8-1-20170905-0757:
> >
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo 
> > xprtrdma
> > filename:  
> > /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> > alias:  xprtrdma
> > alias:  svcrdma
> > license:Dual BSD/GPL
> > description:RPC/RDMA Transport
> > author: Open Grid Computing and Network Appliance, Inc.
> > rhelversion:7.3
> > srcversion: 9629610592FC8363A00B592
> > depends:sunrpc,compat,ib_core,rdma_cm
> > vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions
> >
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo 
> > svcrdma
> > filename:  
> > /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> > alias:  xprtrdma
> > alias:  svcrdma
> > license:Dual BSD/GPL
> > description:RPC/RDMA Transport
> > author: Open Grid Computing and Network Appliance, Inc.
> > rhelversion:7.3
> > srcversion: 9629610592FC8363A00B592n
> > depends:sunrpc,compat,ib_core,rdma_cm
> > vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions
> >
> > They are not in "nfsrdma" rpm any more. They are now in "compat-rdma" rpm:
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
> > /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> > compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le
> >
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
> > /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> > compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le
> >
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
> > /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> > -rw-r--r--. 1 root root 6031120 Sep  5 14:24 
> > /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
> > /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> > -rw-r--r--. 1 root root 6031120 Sep  5 14:24 
> > /lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
> >
> > However I see the error during module load time:
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe 
> > xprtrdma
> > modprobe: ERROR: could not insert 'rpcrdma': Exec format error
> > [root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe 
> > svcrdma
> > modprobe: ERROR: could not insert 'rpcrdma': Exec format error
> >
> >
> > NOTE:
> > 1) Both xprtrdma and svcrdma are using same "rpcrdma.ko"  (see modinfo 
> > output above)
> > 2) The mode of "rpcrdma.ko" is 644. Should it be at least 744?
> >
> > Could you please check on this?
> >
> > Thanks! - David
> > On Sat, 2017-09-02 at 00:59 +0300, Vladimir Sokolovsky wrote:
> >> Applied + build: OFED-4.8-1-20170901-1439
> >>
> >> Regards,
> >> Vladimir
> >>
> >> On 09/02/2017 12:44 AM, Jeff Becker wrote:
> >>> Hi Vlad,
> >>>
> >>> Please apply the attached patches to compat-rdma.git. Together with
> >>> the previous two patches, these have been tested with RHEL7.3 and
> >>> SLES12SP2. Thanks.
> >>>
> >>> -jeff
> >>>
> >> ___
> >> ewg mailing list
> >> ewg@lists.openfabrics.org
> >> 

Re: [ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-05 Thread Jeff Becker

Hi,

I responded to the bugzilla 2633. In short, please try "modprobe 
rpcrdma" directly, and just once as it now contains both server and 
client. Thanks.


-jeff

On 09/05/2017 12:25 PM, David Z. Dai wrote:

Hi, Vlad, Jeff:
Today I got the latest daily build from:
http://downloads.openfabrics.org/OFED/ofed-4.8-1-daily/OFED-4.8-1-20170905-0757.tgz
This latest daily build includes the NFSoRDMA functionality now.

I did a full install on RHEL 7.3 LE OS:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# uname -a
Linux rhel73_host1_guest1_local_htx 3.10.0-514.el7.ppc64le #1 SMP Wed Oct 19
11:27:06 EDT 2016 ppc64le ppc64le ppc64le GNU/Linux

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ./install.pl  
--all

The installation finished successfully.

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ofed_info -s
OFED-4.8-1-20170905-0757:

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo xprtrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo svcrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592n
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions

They are not in "nfsrdma" rpm any more. They are now in "compat-rdma" rpm:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko

However I see the error during module load time:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe xprtrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe svcrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error


NOTE:
1) Both xprtrdma and svcrdma are using same "rpcrdma.ko"  (see modinfo output 
above)
2) The mode of "rpcrdma.ko" is 644. Should it be at least 744?

Could you please check on this?

Thanks! - David
On Sat, 2017-09-02 at 00:59 +0300, Vladimir Sokolovsky wrote:

Applied + build: OFED-4.8-1-20170901-1439

Regards,
Vladimir

On 09/02/2017 12:44 AM, Jeff Becker wrote:

Hi Vlad,

Please apply the attached patches to compat-rdma.git. Together with
the previous two patches, these have been tested with RHEL7.3 and
SLES12SP2. Thanks.

-jeff


___
ewg mailing list
ewg@lists.openfabrics.org
https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.openfabrics.org_mailman_listinfo_ewg=DwIGaQ=jf_iaSHvJObTbx-siA1ZOg=jE7tivF653Vygp552zF5nqagPKJAuy1x71Qnyf3szIw=antYpg37AAv4LKbRqOFw77idqtt-Kxw8KtFSKz_3UJE=RNm5Hv7MRR_y-c_JC9pR1ZHCbLAkAtQh5HJCBEOEfj0=




___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/mailman/listinfo/ewg

Re: [ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-05 Thread David Z. Dai
Hi, Vlad, Jeff:
Today I got the latest daily build from:
http://downloads.openfabrics.org/OFED/ofed-4.8-1-daily/OFED-4.8-1-20170905-0757.tgz
 
This latest daily build includes the NFSoRDMA functionality now.

I did a full install on RHEL 7.3 LE OS:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# uname -a
Linux rhel73_host1_guest1_local_htx 3.10.0-514.el7.ppc64le #1 SMP Wed Oct 19
11:27:06 EDT 2016 ppc64le ppc64le ppc64le GNU/Linux

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ./install.pl  
--all

The installation finished successfully.

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ofed_info -s
OFED-4.8-1-20170905-0757:

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo xprtrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions 

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modinfo svcrdma
filename:  
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
alias:  xprtrdma
alias:  svcrdma
license:Dual BSD/GPL
description:RPC/RDMA Transport
author: Open Grid Computing and Network Appliance, Inc.
rhelversion:7.3
srcversion: 9629610592FC8363A00B592n
depends:sunrpc,compat,ib_core,rdma_cm
vermagic:   3.10.0-514.el7.ppc64le SMP mod_unload modversions 

They are not in "nfsrdma" rpm any more. They are now in "compat-rdma" rpm:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# rpm -qf
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
compat-rdma-4.8-0.20170905.0757.g63258b0.3.10.0_514.el7.ppc64le.ppc64le

[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# ls -al 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko
-rw-r--r--. 1 root root 6031120 Sep  5 14:24 
/lib/modules/3.10.0-514.el7.ppc64le/updates/net/sunrpc/xprtrdma/rpcrdma.ko

However I see the error during module load time:
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe xprtrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error
[root@rhel73_host1_guest1_local_htx OFED-4.8-1-20170905-0757]# modprobe svcrdma
modprobe: ERROR: could not insert 'rpcrdma': Exec format error


NOTE:
1) Both xprtrdma and svcrdma are using same "rpcrdma.ko"  (see modinfo output 
above)
2) The mode of "rpcrdma.ko" is 644. Should it be at least 744?

Could you please check on this?

Thanks! - David
On Sat, 2017-09-02 at 00:59 +0300, Vladimir Sokolovsky wrote:
> Applied + build: OFED-4.8-1-20170901-1439
> 
> Regards,
> Vladimir
> 
> On 09/02/2017 12:44 AM, Jeff Becker wrote:
> > Hi Vlad,
> >
> > Please apply the attached patches to compat-rdma.git. Together with 
> > the previous two patches, these have been tested with RHEL7.3 and 
> > SLES12SP2. Thanks.
> >
> > -jeff
> >
> 
> ___
> ewg mailing list
> ewg@lists.openfabrics.org
> https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.openfabrics.org_mailman_listinfo_ewg=DwIGaQ=jf_iaSHvJObTbx-siA1ZOg=jE7tivF653Vygp552zF5nqagPKJAuy1x71Qnyf3szIw=antYpg37AAv4LKbRqOFw77idqtt-Kxw8KtFSKz_3UJE=RNm5Hv7MRR_y-c_JC9pR1ZHCbLAkAtQh5HJCBEOEfj0=
>  


___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/mailman/listinfo/ewg

Re: [ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-01 Thread Vladimir Sokolovsky

Applied + build: OFED-4.8-1-20170901-1439

Regards,
Vladimir

On 09/02/2017 12:44 AM, Jeff Becker wrote:

Hi Vlad,

Please apply the attached patches to compat-rdma.git. Together with 
the previous two patches, these have been tested with RHEL7.3 and 
SLES12SP2. Thanks.


-jeff



___
ewg mailing list
ewg@lists.openfabrics.org
http://lists.openfabrics.org/mailman/listinfo/ewg

[ewg] NFS/RDMA backport for OFED 4.8-1 part 3

2017-09-01 Thread Jeff Becker

Hi Vlad,

Please apply the attached patches to compat-rdma.git. Together with the 
previous two patches, these have been tested with RHEL7.3 and SLES12SP2. 
Thanks.


-jeff

>From dcb076f7acbe1f2d34668d864a22dc780ae8a314 Mon Sep 17 00:00:00 2001
From: Jeff Becker 
Date: Fri, 1 Sep 2017 13:25:35 -0700
Subject: [PATCH 2/2] NFS/RDMA backport patch for SLES12SP2

Signed-off-by: Jeff Becker 
---
 patches/0017-BACKPORT-nfsrdma-sles12sp2.patch | 82 +++
 1 file changed, 82 insertions(+)
 create mode 100644 patches/0017-BACKPORT-nfsrdma-sles12sp2.patch

diff --git a/patches/0017-BACKPORT-nfsrdma-sles12sp2.patch b/patches/0017-BACKPORT-nfsrdma-sles12sp2.patch
new file mode 100644
index 000..ebc453f
--- /dev/null
+++ b/patches/0017-BACKPORT-nfsrdma-sles12sp2.patch
@@ -0,0 +1,82 @@
+diff --git a/net/sunrpc/xprtrdma/xprt_rdma.h b/net/sunrpc/xprtrdma/xprt_rdma.h
+index a71b0f5..4fd3708 100644
+--- a/net/sunrpc/xprtrdma/xprt_rdma.h
 b/net/sunrpc/xprtrdma/xprt_rdma.h
+@@ -52,6 +52,10 @@
+ #include  	/* RPC/RDMA protocol */
+ #include  	/* xprt parameters */
+ 
++#ifndef HAVE_XPRT_PUT_EXPORTED
++#include 
++#endif
++
+ #define RDMA_RESOLVE_TIMEOUT	(5000)	/* 5 seconds */
+ #define RDMA_CONNECT_RETRY_MAX	(2)	/* retries if no listener backlog */
+ 
+@@ -541,4 +541,30 @@ void xprt_rdma_bc_destroy(struct rpc_xprt *, unsigned int);
+ 
+ extern struct xprt_class xprt_rdma_bc;
+ 
++#ifndef HAVE_XPRT_PUT_EXPORTED
++static inline void backport_xprt_put(struct rpc_xprt *xprt)
++{
++	if (atomic_dec_and_test(>count)) {
++		printk("RPC:   destroying transport %p\n", xprt);
++
++		/* Exclude transport connect/disconnect handlers */
++		wait_on_bit_lock(>state, XPRT_LOCKED, TASK_UNINTERRUPTIBLE);
++
++		del_timer_sync(>timer);
++
++		debugfs_remove_recursive(xprt->debugfs);
++		xprt->debugfs = NULL;
++		rpc_destroy_wait_queue(>binding);
++		rpc_destroy_wait_queue(>pending);
++		rpc_destroy_wait_queue(>sending);
++		rpc_destroy_wait_queue(>backlog);
++		cancel_work_sync(>task_cleanup);
++		kfree(xprt->servername);
++		/*
++ 	 	 * Tear down transport state and free the rpc_xprt
++ 	 	 */
++		xprt->ops->destroy(xprt);
++	}
++}
++#endif
+ #endif/* _LINUX_SUNRPC_XPRT_RDMA_H */
+diff --git a/net/sunrpc/xprtrdma/svc_rdma_backchannel.c b/net/sunrpc/xprtrdma/svc_rdma_backchannel.c
+index a2a7519..1d2703c 100644
+--- a/net/sunrpc/xprtrdma/svc_rdma_backchannel.c
 b/net/sunrpc/xprtrdma/svc_rdma_backchannel.c
+@@ -350,7 +350,11 @@ xprt_setup_rdma_bc(struct xprt_create *args)
+ out_fail:
+ 	xprt_rdma_free_addresses(xprt);
+ 	args->bc_xprt->xpt_bc_xprt = NULL;
++#ifdef HAVE_XPRT_PUT_EXPORTED
+ 	xprt_put(xprt);
++#else
++	backport_xprt_put(xprt);
++#endif
+ 	xprt_free(xprt);
+ 	return ERR_PTR(-EINVAL);
+ }
+diff --git a/net/sunrpc/xprtrdma/svc_rdma_transport.c b/net/sunrpc/xprtrdma/svc_rdma_transport.c
+index dd94401..a9f812f 100644
+--- a/net/sunrpc/xprtrdma/svc_rdma_transport.c
 b/net/sunrpc/xprtrdma/svc_rdma_transport.c
+@@ -1223,7 +1223,11 @@ static void __svc_rdma_free(struct work_struct *work)
+ 
+ 	/* Final put of backchannel client transport */
+ 	if (xprt->xpt_bc_xprt) {
++#ifdef HAVE_XPRT_PUT_EXPORTED
+ 		xprt_put(xprt->xpt_bc_xprt);
++#else
++		backport_xprt_put(xprt->xpt_bc_xprt);
++#endif
+ 		xprt->xpt_bc_xprt = NULL;
+ 	}
+ 
+diff --git a/net/sunrpc/xprtrdma/xprt_rdma.h b/net/sunrpc/xprtrdma/xprt_rdma.h
+index a71b0f5..607c94c 100644
+--- a/net/sunrpc/xprtrdma/xprt_rdma.h
 b/net/sunrpc/xprtrdma/xprt_rdma.h
-- 
1.8.3.1

>From f33a8f4bfc55b57b45518ff00165f8d49fe58fc5 Mon Sep 17 00:00:00 2001
From: Jeff Becker 
Date: Thu, 24 Aug 2017 10:06:10 -0700
Subject: [PATCH 1/2] NFS/RDMA backport patch to revert source files to 4.6
 kernel in order to facilitate dependency on distro SUNRPC. Include fix to use
 correct ib_map_mr_sg signature from OFED4.8.

Signed-off-by: Jeff Becker 
---
 ofed_scripts/checkout_files|1 +
 patches/0016-BACKPORT-nfsrdma-to-4.6.patch | 3682 
 2 files changed, 3683 insertions(+)
 create mode 100644 patches/0016-BACKPORT-nfsrdma-to-4.6.patch

diff --git a/ofed_scripts/checkout_files b/ofed_scripts/checkout_files
index 21bc220..f1b6a76 100644
--- a/ofed_scripts/checkout_files
+++ b/ofed_scripts/checkout_files
@@ -25,3 +25,4 @@ drivers/nvme/
 include/linux/nvme.h
 include/linux/nvme-rdma.h
 include/uapi/linux/nvme_ioctl.h
+include/linux/sunrpc/
diff --git a/patches/0016-BACKPORT-nfsrdma-to-4.6.patch b/patches/0016-BACKPORT-nfsrdma-to-4.6.patch
new file mode 100644
index 000..e0846b2
--- /dev/null
+++ b/patches/0016-BACKPORT-nfsrdma-to-4.6.patch
@@ -0,0 +1,3682 @@
+diff --git a/net/sunrpc/xprtrdma/Makefile b/net/sunrpc/xprtrdma/Makefile
+index ef19fa4..dc9f3b5 100644
+--- a/net/sunrpc/xprtrdma/Makefile
 b/net/sunrpc/xprtrdma/Makefile
+@@ -1,7 +1,7 @@
+ obj-$(CONFIG_SUNRPC_XPRT_RDMA) += rpcrdma.o
+ 
+ rpcrdma-y :=