[Pkg-ofed-devel] lenny - openmpi problems

[Guy Coates]

Yann JOBIC wrote:
> Hello,
> 
> I pluged 2 opteron SMP, with infiniband cards ( CA type: MT25418 ).
> I've got a lenny distrib (5.0.2)
> I used the deb http://pkg-ofed.alioth.debian.org/apt/ofed repository. I 
> recompiled the modules for the kernel, just to be sur.
> I directly connected 2 infiniband cards, with opensm running on both 
> (one is master, the other slient)
> 
> The ping test is fine.
> 
> However, the bencharks included are not working :
> Lidia:~# ib_rdma_lat Lilou
> mlx4: There is a mismatch between the kernel and the userspace 
> libraries: Kernel does not support XRC. Exiting.
> 7312:pp_init_ctx: Couldn't get context for mlx4_0
>

Hi,

That message means that your system is not picking up the new ofa kernel modules 
you installed.

Stupid question; did you reboot the machine/rmmod the existing infiniband 
modules before running the tests?


You can check which modules you are using  by running:

modinfo mlx4_ib

It should pick up the module in


/lib/modules/<kernel-version>/updates/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko


Can you send me the output of

uname -r

dpkg -l | grep ofa-kernel

dpkg -s libibverbs1

Cheers,

Guy

-- 
Dr. Guy Coates,  Informatics System Group
The Wellcome Trust Sanger Institute, Hinxton, Cambridge, CB10 1HH, UK
Tel: +44 (0)1223 834244 x 6925
Fax: +44 (0)1223 496802


-- 
 The Wellcome Trust Sanger Institute is operated by Genome Research 
 Limited, a charity registered in England with number 1021457 and a 
 company registered in England with number 2742969, whose registered 
 office is 215 Euston Road, London, NW1 2BE.