4.10 kernel support

[misamoylov]

During make kernel on 4.10 kernel-ml

https://pastebin.com/LqfD0GJc

[zhangguoqing]

How to fix https://pastebin.com/LqfD0GJc when use the latest stable kernel 4.10.9? or who can tell me which latest stable kernel version could be make successfully? Thanks all.

[misamoylov]

Hi, i think latest successfull kernel version was kernel-ml-devel-4.8.13-1.el7.elrepo.x86_64.rpm

[zhangguoqing]

Hi misamoylov,
Thank you, the kernel-ml-devel-4.8.13-1.el7.elrepo.x86_64.rpm is OK for me. I have compiled the soft-iwarp, but thers is not the ibv_devices.

uname -sr
Linux 4.8.13-1.el7.elrepo.x86_64

ibv_devices
device node GUID
------ ----------------
ls /dev/infiniband/
rdma_cm uverbs0 uverbs1

strace -f ibv_devices
....
.....
mprotect(0x7f78455dd000, 4096, PROT_READ) = 0
munmap(0x7f7846f9e000, 22390) = 0
open("/sys/class/infiniband_verbs/uverbs1/device/vendor", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
open("/sys/class/infiniband_verbs/uverbs1/device/vendor", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
open("/sys/class/infiniband_verbs/uverbs1/device/vendor", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
open("/sys/class/infiniband_verbs/uverbs1/device/vendor", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
open("/sys/class/infiniband_verbs/uverbs0/device/vendor", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
open("/sys/class/infiniband_verbs/uverbs0/device/vendor", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
open("/sys/class/infiniband_verbs/uverbs0/device/vendor", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
open("/sys/class/infiniband_verbs/uverbs0/device/vendor", O_RDONLY|O_CLOEXEC) = -1 ENOENT (No such file or directory)
futex(0x7f7846d85534, FUTEX_WAKE_PRIVATE, 2147483647) = 0
fstat(1, {st_mode=S_IFCHR|0620, st_rdev=makedev(136, 1), ...}) = 0
mmap(NULL, 4096, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7f7846fa3000
write(1, " device \t node GUI"..., 34 device node GUID
) = 34
write(1, " ------ \t-----------"..., 38 ------ ----------------
) = 38
exit_group(0) = ?
+++ exited with 0 +++

[misamoylov]

Yes, I know it, but it seems like another problem =)))

[zhangguoqing]

I maybe fix above problem. It seems that there are some wrong with libibverbs-utils install by yum.
The flow commands compile the libibverbs-utils from source code, and replace the native ibv_* utils.
wget https://www.openfabrics.org/downloads/verbs/libibverbs-1.2.1.tar.gz
tar zxvf libibverbs-1.2.1.tar.gz
cd libibverbs-1.2.1
yum install libnl libnl-devel
./configure
make
cp examples/ibv_* /usr/bin/

ibv_devices
device node GUID
------ ----------------
siw_eth0 fa163e2d37060000
siw_lo 7369775f6c6f0000

[misamoylov]

Great, it works for me too.

[BernardMetzler]

I opened a development branch 'dev-siw.mem_ext'. It implements some kernel API extensions (memory management) to support NVMeF (both initiator and target). Please treat that code as purely experimental - stability and performance will improve over time. It runs on kernels 4.8 and 4.10.