[Pkg-lustre-maintainers] Lustre + XEN in Debian

[Ettore Enrico Delfino Ligorio]

Hi,

Please, i need help.

Anyone had success using Lustre (from debian package) with xen in  
debian (lenny or unstable)? What i must to make this work?

It didn't worked for me.

I have done the following steps:

puma2:~#  apt-get install  liblustre linux-patch-lustre lustre-dev  
lustre-source lustre-tests lustre-utils ldiskfsck lfsck

puma2:~#  module-assistant build lustre

puma2:~#  module-assistant install lustre

puma2:~# cat /etc/rc.local |grep lustre
modprobe lustre
puma2:~# reboot

puma2:~# mkfs.lustre --mgs --mdt --fsname puma2 /dev/sda5

    Permanent disk data:
Target:     puma2-MDTffff
Index:      unassigned
Lustre FS:  puma2
Mount type: ldiskfs
Flags:      0x75
               (MDT MGS needs_index first_time update )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
Parameters: mdt.group_upcall=/usr/sbin/l_getgroups

checking for existing Lustre data: not found
device size = 262774MB
2 6 26
formatting backing filesystem ldiskfs on /dev/sda5
	target name  puma2-MDTffff
	4k blocks     0
	options        -J size=400 -i 4096 -I 512 -q -O dir_index,uninit_groups -F
mkfs_cmd = mkfs.ext2 -j -b 4096 -L puma2-MDTffff  -J size=400 -i 4096  
-I 512 -q -O dir_index,uninit_groups -F /dev/sda5

mkfs.lustre: Unable to mount /dev/sda5: No such device
Is the ldiskfs module available?

mkfs.lustre FATAL: failed to write local files
mkfs.lustre: exiting with 19 (No such device)

puma2:~# mkdir /mdt

puma2:~# mount -t lustre /dev/sda5 /mdt/
mount.lustre: mount /dev/sda5 at /mdt failed: No such device
Are the lustre modules loaded?
Check /etc/modprobe.conf and /proc/filesystems
Note 'alias lustre llite' should be removed from modprobe.conf

puma2:~# fdisk -l /dev/sda

Disk /dev/sda: 299.4 GB, 299439751168 bytes
255 heads, 63 sectors/track, 36404 cylinders
Units = cylinders of 16065 * 512 = 8225280 bytes
Disk identifier: 0x00059841

    Device Boot      Start         End      Blocks   Id  System
/dev/sda1   *           1          79      634536   83  Linux
/dev/sda2              80         294     1726987+  82  Linux swap / Solaris
/dev/sda3             295        2905    20972857+  83  Linux
/dev/sda4            2906       36404   269080717+   5  Extended
/dev/sda5            2906       36404   269080686   83  Linux

puma2:~# uname -a
Linux puma2 2.6.26-2-xen-amd64 #1 SMP Wed May 13 18:43:45 UTC 2009  
x86_64 GNU/Linux

This is description of booted kernel in /boot/grub/menu.lst

title		Xen 3.2-1-amd64 / Debian GNU/Linux, kernel 2.6.26-2-xen-amd64
root		(hd0,0)
kernel		/xen-3.2-1-amd64.gz
module		/vmlinuz-2.6.26-2-xen-amd64 root=/dev/sda3 ro console=tty0
module		/initrd.img-2.6.26-2-xen-amd64

puma2:~# lsmod |grep lustre
lustre                446816  0
lov                   274056  1 lustre
mdc                   102840  1 lustre
osc                   149512  1 lustre
ptlrpc                716936  5 lustre,lov,mdc,lquota,osc
obdclass              530776  6 lustre,lov,mdc,lquota,osc,ptlrpc
lnet                  233256  4 lustre,ptlrpc,ksocklnd,obdclass
lvfs                   71112  7 lustre,lov,mdc,lquota,osc,ptlrpc,obdclass
libcfs                120312  10  
lustre,lov,mdc,lquota,osc,ptlrpc,ksocklnd,obdclass,lnet,lvfs
puma2:~# lsmod |grep ldisk
puma2:~#

 From another machine i try, with same configuration:

puma30:~# mkdir /ost
puma30:~# mkfs.lustre --ost --fsname puma2 --mgsnode=puma2 at tcp0 /dev/sda5

    Permanent disk data:
Target:     puma2-OSTffff
Index:      unassigned
Lustre FS:  puma2
Mount type: ldiskfs
Flags:      0x72
               (OST needs_index first_time update )
Persistent mount opts: errors=remount-ro,extents,mballoc
Parameters: mgsnode=10.0.2.2 at tcp

checking for existing Lustre data: not found
device size = 262774MB
2 6 26
formatting backing filesystem ldiskfs on /dev/sda5
	target name  puma2-OSTffff
	4k blocks     0
	options        -J size=400 -i 16384 -I 256 -q -O dir_index,uninit_groups -F
mkfs_cmd = mkfs.ext2 -j -b 4096 -L puma2-OSTffff  -J size=400 -i 16384  
-I 256 -q -O dir_index,uninit_groups -F /dev/sda5
mkfs.lustre: Unable to mount /dev/sda5: No such device
Is the ldiskfs module available?

mkfs.lustre FATAL: failed to write local files
mkfs.lustre: exiting with 19 (No such device)

puma30:~# mount -t lustre puma2 at tcp0:/puma2 /ost
mount.lustre: mount puma2 at tcp0:/puma2 at /ost failed: Cannot send  
after transport endpoint shutdown
puma30:~#


Thanks in advance.
-- 
Ettore Enrico Delfino Ligorio ( ettore at usp.br )
Laboratório de Computação Científica Avançada da USP ( http://www.cce.usp.br
http://www.usp.br/lcca )
+55-11-3091-6480      fax: +55-11-3091-1855

Visite: http://iptv.usp.br
Videoconferência? http://wiki.stoa.usp.br/Videoconferencia