[Pkg-lustre-maintainers] Lustre + XEN in Debian

Ettore Enrico Delfino Ligorio ettore at usp.br
Wed Jun 10 19:38:13 UTC 2009


Hi Evan,

Sorry for the inconvenience.


Below are the requested output:

(These machines ar using Debian stable (Lenny))
puma2:~# /sbin/iptables -nvL
Chain INPUT (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source
destination

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source
destination

Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes)
 pkts bytes target     prot opt in     out     source
destination
puma2:~#


puma2:~# dmesg |tail -n 20
[   81.829983] NET: Registered protocol family 10
[   81.829983] lo: Disabled Privacy Extensions
[   81.829983] ADDRCONF(NETDEV_UP): eth1: link is not ready
[   84.839690] bnx2: eth1 NIC Copper Link is Up, 1000 Mbps full duplex
[   84.841266] ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[   85.603393] bnx2: eth0 NIC Copper Link is Down
[   88.880264] bnx2: eth0 NIC Copper Link is Up, 1000 Mbps full duplex
[   92.755753] eth0: no IPv6 routers present
[   94.016709] suspend: event channel 44
[   95.150592] eth1: no IPv6 routers present
[   96.144998] Bridge firewalling registered
[   96.776796] Lustre: Added LNI 10.0.2.2 at tcp [8/256]
[   96.776953] Lustre: Accept secure, port 988
[   96.881533] Lustre: Lustre Client File System; info at clusterfs.com
[140919.261749] LustreError:
20910:0:(obd_mount.c:1241:server_kernel_mount()) premount
/dev/sda5:0x0 ldiskfs failed: -19, ldiskfs2 failed: -19.  Is the
ldiskfs module available?
[140919.261749] LustreError:
20910:0:(obd_mount.c:1560:server_fill_super()) Unable to mount device
/dev/sda5: -19
[140919.261749] LustreError:
20910:0:(obd_mount.c:1951:lustre_fill_super()) Unable to mount  (-19)
[190541.769779] LustreError:
27018:0:(obd_mount.c:1241:server_kernel_mount()) premount
/dev/sda5:0x0 ldiskfs failed: -19, ldiskfs2 failed: -19.  Is the
ldiskfs module available?
[190541.769779] LustreError:
27018:0:(obd_mount.c:1560:server_fill_super()) Unable to mount device
/dev/sda5: -19
[190541.769779] LustreError:
27018:0:(obd_mount.c:1951:lustre_fill_super()) Unable to mount  (-19)
puma2:~#



puma30:~# dmesg |tail -n 10
[140767.809478] LustreError: 15c-8: MGC10.0.2.2 at tcp: The configuration
from log 'puma2-client' failed (-108). This may be the result of
communication errors between this node and the MGS, a bad
configuration, or other errors. See the syslog for more information.
[140767.809636] LustreError:
21147:0:(llite_lib.c:1061:ll_fill_super()) Unable to process log: -108
[140767.809955] Lustre: client ffff8803e7693c00 umount complete
[140767.809998] LustreError:
21147:0:(obd_mount.c:1951:lustre_fill_super()) Unable to mount  (-108)
[189735.081445] Lustre: Request x16 sent from MGC10.0.2.2 at tcp to NID
10.0.2.2 at tcp 5s ago has timed out (limit 5s).
[189735.081531] LustreError:
27174:0:(client.c:716:ptlrpc_import_delay_req()) @@@ IMP_INVALID
req at ffff8803e5e5f600 x18/t0 o501->MGS at MGC10.0.2.2@tcp_0:26/25 lens
136/248 e 0 to 100 dl 0 ref 1 fl Rpc:/0/0 rc 0/0
[189735.081669] LustreError: 15c-8: MGC10.0.2.2 at tcp: The configuration
from log 'puma2-client' failed (-108). This may be the result of
communication errors between this node and the MGS, a bad
configuration, or other errors. See the syslog for more information.
[189735.081794] LustreError:
27174:0:(llite_lib.c:1061:ll_fill_super()) Unable to process log: -108
[189735.082065] Lustre: client ffff8803e7694800 umount complete
[189735.082106] LustreError:
27174:0:(obd_mount.c:1951:lustre_fill_super()) Unable to mount  (-108)
puma30:~#




puma2:~# ifconfig eth0
eth0      Link encap:Ethernet  HWaddr 00:22:19:55:28:59
         inet addr:10.0.2.2  Bcast:10.0.7.255  Mask:255.255.248.0
         inet6 addr: fe80::222:19ff:fe55:2859/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
         RX packets:3570658 errors:0 dropped:0 overruns:0 frame:0
         TX packets:128400 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:229098082 (218.4 MiB)  TX bytes:8463859 (8.0 MiB)
         Interrupt:16 Memory:f8000000-f8012100

puma30:~# ifconfig eth0
eth0      Link encap:Ethernet  HWaddr 00:22:19:58:65:20
         inet addr:10.0.2.30  Bcast:10.0.7.255  Mask:255.255.248.0
         inet6 addr: fe80::222:19ff:fe58:6520/64 Scope:Link
         UP BROADCAST RUNNING MULTICAST  MTU:9000  Metric:1
         RX packets:3572109 errors:0 dropped:0 overruns:0 frame:0
         TX packets:128662 errors:0 dropped:0 overruns:0 carrier:0
         collisions:0 txqueuelen:1000
         RX bytes:229242725 (218.6 MiB)  TX bytes:8539988 (8.1 MiB)
         Interrupt:16 Memory:f8000000-f8012100

puma30:~#



(This machine below is running Debian Unstable)
puma58:~# mkfs.lustre --mgs --mdt --fsname puma58 /dev/sda5

  Permanent disk data:
Target:     puma58-MDTffff
Index:      unassigned
Lustre FS:  puma58
Mount type: ldiskfs
Flags:      0x75
             (MDT MGS needs_index first_time update )
Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
Parameters: mdt.group_upcall=/usr/sbin/l_getgroups

checking for existing Lustre data: not found

device size = 264437MB
2 6 26
formatting backing filesystem ldiskfs on /dev/sda5

       target name  puma58-MDTffff
       4k blocks     0
       options        -J size=400 -i 4096 -I 512 -q -O
dir_index,uninit_groups -F

mkfs_cmd = mkfs.ext2 -j -b 4096 -L puma58-MDTffff  -J size=400 -i 4096
-I 512 -q -O dir_index,uninit_groups -F /dev/sda5
mkfs.lustre: Unable to mount /dev/sda5: No such device
Is the ldiskfs module available?

mkfs.lustre FATAL: failed to write local files
mkfs.lustre: exiting with 19 (No such device)


puma58:~# dmesg |tail -n 25
[   91.965490] tmpbridge: Dropping NETIF_F_UFO since no NETIF_F_HW_CSUM
feature.
[  142.314790] Lustre: OBD class driver, http://www.lustre.org/
[  142.314900] Lustre:         Lustre Version: 1.6.7
[  142.315815] Lustre:         Build Version:
1.6.7-19691231210000-PRISTINE-.lib.modules.2.6.26-2-xen-amd64.build-2.6.26-2-xen-amd64
[  142.446536] Lustre: Added LNI 10.0.8.58 at tcp [8/256]
[  142.446536] Lustre: Accept secure, port 988
[  142.446536] LustreError:
3721:0:(router_proc.c:1020:lnet_proc_init()) couldn't create proc
entry sys/lnet/stats
[  142.680752] Lustre: Lustre Client File System; http://www.lustre.org/


puma58:~#
puma58:~# cat /var/log/messages |tail -n 35
May 20 22:44:18 puma58 kernel: [  142.314790] Lustre: OBD class
driver, http://www.lustre.org/
May 20 22:44:18 puma58 kernel: [  142.314900] Lustre:         Lustre
Version: 1.6.7
May 20 22:44:18 puma58 kernel: [  142.315815] Lustre:         Build
Version:
1.6.7-19691231210000-PRISTINE-.lib.modules.2.6.26-2-xen-amd64.build-2.6.26-2-xen-amd64
May 20 22:44:18 puma58 kernel: [  142.446536] Lustre: Added LNI
10.0.2.58 at tcp [8/256]
May 20 22:44:18 puma58 kernel: [  142.446536] Lustre: Accept secure,
port 988
May 20 22:44:18 puma58 kernel: [  142.680752] Lustre: Lustre Client
File System; http://www.lustre.org/







Running the mkfs.lustre in a newer install of Debian Lenny, gives me the
following output (dmesg).

39.670511] EXT3 FS on sda3, internal journal
[   40.494586] loop: module loaded
[   40.728247] Lustre: OBD class driver, info at clusterfs.com
[   40.728247]         Lustre Version: 1.6.5.1
[   40.728247]         Build Version:
1.6.5.1-19691231210000-PRISTINE-.lib.modules.2.6.26-2-xen-amd64.build-2.6.26-2-xen-amd64
[   40.860339] LustreError:
2555:0:(socklnd.c:2439:ksocknal_enumerate_interfaces()) Can't enumerate
interfaces: 0
[   41.865296] LustreError: 105-4: Error -100 starting up LNI tcp
[   41.865431] LustreError: 2555:0:(events.c:707:ptlrpc_init_portals())
network initialisation failed
[   41.912640] osc: Unknown symbol ldlm_prep_enqueue_req
[   41.912779] osc: Unknown symbol ldlm_resource_get
[   41.912792] osc: Unknown symbol ptlrpc_lprocfs_register_obd
[   41.912986] osc: Unknown symbol ldlm_cli_cancel_unused
[   41.913106] osc: Unknown symbol _ldlm_lock_debug
[   41.913230] osc: Unknown symbol lustre_msg_get_conn_cnt
[   41.913350] osc: Unknown symbol ptlrpc_lprocfs_brw
[   41.913504] osc: Unknown symbol ptlrpcd_addref
[   41.913653] osc: Unknown symbol ptlrpc_deactivate_import
[   41.913772] osc: Unknown symbol llog_origin_connect
[   41.913890] osc: Unknown symbol ptlrpc_check_set
[   41.914029] osc: Unknown symbol ptlrpc_init_rq_pool
[   41.914171] osc: Unknown symbol ptlrpc_queue_wait
[   41.914324] osc: Unknown symbol client_import_del_conn
[   41.914444] osc: Unknown symbol ptlrpc_request_addref
[   41.914659] osc: Unknown symbol ptlrpc_invalidate_import
[   41.914779] osc: Unknown symbol client_obd_setup
[   41.914919] osc: Unknown symbol ldlm_prep_elc_req
[   41.915037] osc: Unknown symbol ldlm_cancel_resource_local
[   41.915170] osc: Unknown symbol ldlm_lock_match
[   41.915308] osc: Unknown symbol ptlrpc_set_import_active
[   41.915476] osc: Unknown symbol client_obd_cleanup
[   41.915595] osc: Unknown symbol ptlrpc_prep_bulk_imp
[   41.915714] osc: Unknown symbol ptlrpc_set_add_req
[   41.915865] osc: Unknown symbol __ldlm_handle2lock
[   41.916015] osc: Unknown symbol ptlrpc_add_rqs_to_pool
[   41.916137] osc: Unknown symbol ptlrpcd_add_req
[   41.916270] osc: Unknown symbol ptlrpc_prep_bulk_page
[   41.916479] osc: Unknown symbol lustre_msg_get_transno
[   41.916613] osc: Unknown symbol lustre_msg_buf
[   41.916782] osc: Unknown symbol ldlm_cli_cancel
[   41.916908] osc: Unknown symbol llog_obd_repl_cancel
[   41.917042] osc: Unknown symbol ptlrpc_req_xid
[   41.917162] osc: Unknown symbol ldlm_lock_put
[   41.917280] osc: Unknown symbol lustre_swab_obd_statfs
[   41.917399] osc: Unknown symbol client_import_add_conn
[   41.917536] osc: Unknown symbol ptlrpc_sample_next_xid
[   41.917664] osc: Unknown symbol ldlm_lock_addref
[   41.917798] osc: Unknown symbol lustre_msg_swabbed
[   41.917916] osc: Unknown symbol lustre_swab_ost_lvb
[   41.918034] osc: Unknown symbol ldlm_lock_decref_and_cancel
[   41.918153] osc: Unknown symbol ldlm_resource_iterate
[   41.924875] osc: Unknown symbol unlock_res_and_lock
[   41.925002] osc: Unknown symbol ldlm_cli_enqueue
[   41.925125] osc: Unknown symbol ptlrpcd_wake
[   41.925242] osc: Unknown symbol ptlrpc_at_set_req_timeout
[   41.925366] osc: Unknown symbol lock_res_and_lock
[   41.925485] osc: Unknown symbol client_disconnect_export
[   41.925605] osc: Unknown symbol ptlrpc_free_rq_pool
[   41.925775] osc: Unknown symbol ldlm_lock2handle
[   41.925907] osc: Unknown symbol ldlm_cli_join_lru
[   41.926039] osc: Unknown symbol ptlrpc_prep_req_pool
[   41.926196] osc: Unknown symbol lustre_msg_get_opc
[   41.926329] osc: Unknown symbol ptlrpc_import_setasync
[   41.926448] osc: Unknown symbol lprocfs_wr_ping
[   41.926565] osc: Unknown symbol ldlm_namespace_cleanup
[   41.926703] osc: Unknown symbol ptlrpc_mark_interrupted
[   41.926837] osc: Unknown symbol ptlrpc_fail_import
[   41.926957] osc: Unknown symbol llog_initiator_connect
[   41.927075] osc: Unknown symbol ldlm_resource_putref
[   41.927212] osc: Unknown symbol lustre_msg_size
[   41.927343] osc: Unknown symbol lustre_msg_early_size
[   41.927486] osc: Unknown symbol lustre_swab_ost_body
[   41.927627] osc: Unknown symbol _debug_req
[   41.927785] osc: Unknown symbol lustre_swab_repbuf
[   41.927903] osc: Unknown symbol lustre_swab_ost_last_id
[   41.928033] osc: Unknown symbol ptlrpc_recover_import
[   41.928192] osc: Unknown symbol ptlrpc_prep_req
[   41.928332] osc: Unknown symbol client_connect_import
[   41.928451] osc: Unknown symbol ptlrpcd_decref
[   41.928568] osc: Unknown symbol ldlm_cli_enqueue_fini
[   41.928784] osc: Unknown symbol ptlrpc_req_finished
[   41.928894] osc: Unknown symbol ldlm_lock_decref
[   41.928894] osc: Unknown symbol ptlrpc_lprocfs_unregister_obd
[   41.950701] mdc: Unknown symbol ldlm_prep_enqueue_req
[   41.950822] mdc: Unknown symbol ldlm_resource_get
[   41.950941] mdc: Unknown symbol ptlrpc_lprocfs_register_obd
[   41.951076] mdc: Unknown symbol lustre_msg_get_last_xid
[   41.951209] mdc: Unknown symbol _ldlm_lock_debug
[   41.951368] mdc: Unknown symbol ptlrpcd_addref
[   41.951486] mdc: Unknown symbol ptlrpc_check_set
[   41.951621] mdc: Unknown symbol lustre_msg_get_last_committed
[   41.951742] mdc: Unknown symbol ptlrpc_queue_wait
[   41.951893] mdc: Unknown symbol client_import_del_conn
[   41.952017] mdc: Unknown symbol ptlrpc_request_addref
[   41.952209] mdc: Unknown symbol lustre_msg_bufcount
[   41.952329] mdc: Unknown symbol ptlrpc_invalidate_import
[   41.952447] mdc: Unknown symbol ldlm_completion_ast
[   41.952565] mdc: Unknown symbol lustre_msg_add_flags
[   41.952684] mdc: Unknown symbol client_obd_setup
[   41.952801] mdc: Unknown symbol ldlm_prep_elc_req
[   41.952919] mdc: Unknown symbol ldlm_cancel_resource_local
[   41.953054] mdc: Unknown symbol ldlm_lock_match
[   41.953190] mdc: Unknown symbol ptlrpc_set_import_active
[   41.953347] mdc: Unknown symbol client_obd_cleanup
[   41.953472] mdc: Unknown symbol ptlrpc_prep_bulk_imp
[   41.953591] mdc: Unknown symbol ptlrpc_set_add_req
[   41.953738] mdc: Unknown symbol lustre_swab_mds_body
[   41.953860] mdc: Unknown symbol __ldlm_handle2lock
[   41.954010] mdc: Unknown symbol ptlrpcd_add_req
[   41.954152] mdc: Unknown symbol llog_client_ops
[   41.954272] mdc: Unknown symbol ptlrpc_prep_bulk_page
[   41.954479] mdc: Unknown symbol lustre_msg_buf
[   41.954664] mdc: Unknown symbol lustre_msg_buflen
[   41.954815] mdc: Unknown symbol ldlm_lock_put
[   41.954942] mdc: Unknown symbol lustre_swab_obd_statfs
[   41.955061] mdc: Unknown symbol client_import_add_conn
[   41.955180] mdc: Unknown symbol lustre_packed_msg_size
[   41.955311] mdc: Unknown symbol ldlm_lock_addref
[   41.955445] mdc: Unknown symbol ldlm_lock_decref_and_cancel
[   41.955565] mdc: Unknown symbol ldlm_resource_iterate
[   41.955683] mdc: Unknown symbol unlock_res_and_lock
[   41.955801] mdc: Unknown symbol ldlm_cli_enqueue
[   41.955920] mdc: Unknown symbol ptlrpc_at_set_req_timeout
[   41.956039] mdc: Unknown symbol lock_res_and_lock
[   41.956157] mdc: Unknown symbol client_disconnect_export
[   41.956277] mdc: Unknown symbol ptlrpc_free_rq_pool
[   41.956416] mdc: Unknown symbol lustre_msg_get_opc
[   41.956550] mdc: Unknown symbol ptlrpc_import_setasync
[   41.956668] mdc: Unknown symbol lprocfs_wr_ping
[   41.956794] mdc: Unknown symbol ldlm_namespace_cleanup
[   41.956945] mdc: Unknown symbol lustre_msg_get_status
[   41.957064] mdc: Unknown symbol ldlm_resource_putref
[   41.957217] mdc: Unknown symbol lustre_msg_size
[   41.957348] mdc: Unknown symbol lustre_msg_early_size
[   41.957500] mdc: Unknown symbol ldlm_it2str
[   41.957626] mdc: Unknown symbol _debug_req
[   41.957781] mdc: Unknown symbol lustre_msg_get_type
[   41.957908] mdc: Unknown symbol lustre_swab_repbuf
[   41.958029] mdc: Unknown symbol ptlrpc_recover_import
[   41.958179] mdc: Unknown symbol ptlrpc_prep_req
[   41.958297] mdc: Unknown symbol client_connect_import
[   41.958417] mdc: Unknown symbol ptlrpcd_decref
[   41.958534] mdc: Unknown symbol ldlm_cli_enqueue_fini
[   41.958673] mdc: Unknown symbol lustre_msg_set_buflen
[   41.958821] mdc: Unknown symbol ptlrpc_req_finished
[   41.958939] mdc: Unknown symbol ldlm_lock_decref
[   41.959071] mdc: Unknown symbol ptlrpc_lprocfs_unregister_obd
[   41.993786] lov: Unknown symbol ptlrpc_set_destroy
[   41.994020] lov: Unknown symbol ptlrpc_prep_set
[   41.994164] lov: Unknown symbol _ldlm_lock_debug
[   41.994470] lov: Unknown symbol lustre_swab_lov_user_md
[   41.994595] lov: Unknown symbol ptlrpc_set_add_cb
[   41.994799] lov: Unknown symbol __ldlm_handle2lock
[   41.995074] lov: Unknown symbol ldlm_lock_put
[   41.995207] lov: Unknown symbol ptlrpc_activate_import
[   41.995374] lov: Unknown symbol ldlm_lock_allow_match
[   41.995618] lov: Unknown symbol lustre_swab_lov_desc
[   41.995961] lov: Unknown symbol ptlrpc_set_wait
[   42.048683] lustre: Unknown symbol ptlrpc_set_destroy
[   42.048839] lustre: Unknown symbol ldlm_lock_dump_handle
[   42.048971] lustre: Unknown symbol lov_stripe_lock
[   42.049149] lustre: Unknown symbol mdc_set_open_replay_data
[   42.049300] lustre: Unknown symbol ptlrpc_prep_set
[   42.049419] lustre: Unknown symbol lustre_msg_string
[   42.049551] lustre: Unknown symbol ldlm_cli_cancel_unused
[   42.049671] lustre: Unknown symbol _ldlm_lock_debug
[   42.049817] lustre: Unknown symbol mdc_revalidate_lock
[   42.049950] lustre: Unknown symbol mdc_clear_open_replay_data
[   42.050070] lustre: Unknown symbol mdc_setxattr
[   42.050193] lustre: Unknown symbol mdc_getattr
[   42.050335] lustre: Unknown symbol ptlrpc_queue_wait
[   42.050524] lustre: Unknown symbol mdc_sync
[   42.050671] lustre: Unknown symbol ldlm_extent_shift_kms
[   42.050867] lustre: Unknown symbol ldlm_flock_completion_ast
[   42.051116] lustre: Unknown symbol lov_test_and_clear_async_rc
[   42.051252] lustre: Unknown symbol mdc_req2lustre_md
[   42.051370] lustre: Unknown symbol mdc_change_cbdata
[   42.051489] lustre: Unknown symbol lustre_swab_lov_user_md
[   42.051608] lustre: Unknown symbol lustre_msg_bufcount
[   42.051735] lustre: Unknown symbol mdc_intent_lock
[   42.051853] lustre: Unknown symbol ldlm_completion_ast
[   42.052005] lustre: Unknown symbol ldlm_lock_match
[   42.052123] lustre: Unknown symbol mdc_set_lock_data
[   42.052267] lustre: Unknown symbol ptlrpc_set_import_active
[   42.052400] lustre: Unknown symbol lustre_swab_lov_user_md_join
[   42.052726] lustre: Unknown symbol mdc_rename
[   42.052898] lustre: Unknown symbol mdc_getstatus
[   42.053097] lustre: Unknown symbol mdc_getattr_name
[   42.053215] lustre: Unknown symbol lustre_pack_reply
[   42.053333] lustre: Unknown symbol lustre_msg_buf
[   42.053479] lustre: Unknown symbol ldlm_cli_cancel
[   42.053617] lustre: Unknown symbol lustre_msg_buflen
[   42.053779] lustre: Unknown symbol it_open_error
[   42.053903] lustre: Unknown symbol mdc_intent_getattr_async
[   42.054046] lustre: Unknown symbol mdc_create
[   42.054224] lustre: Unknown symbol mdc_readpage
[   42.054340] lustre: Unknown symbol osc_extent_blocking_cb
[   42.054517] lustre: Unknown symbol unlock_res_and_lock
[   42.054636] lustre: Unknown symbol ldlm_cli_enqueue
[   42.054763] lustre: Unknown symbol lock_res_and_lock
[   42.054932] lustre: Unknown symbol ldlm_lock2handle
[   42.055073] lustre: Unknown symbol mdc_link
[   42.055233] lustre: Unknown symbol mdc_setattr
[   42.055354] lustre: Unknown symbol it_clear_disposition
[   42.055542] lustre: Unknown symbol mdc_free_lustre_md
[   42.055723] lustre: Unknown symbol mdc_getxattr
[   42.055840] lustre: Unknown symbol mdc_store_inode_generation
[   42.055979] lustre: Unknown symbol lustre_msg_size
[   42.056100] lustre: Unknown symbol lustre_msg_early_size
[   42.056314] lustre: Unknown symbol ldlm_it2str
[   42.056453] lustre: Unknown symbol lustre_swab_repbuf
[   42.056572] lustre: Unknown symbol lustre_swab_lov_user_md_objects
[   42.056737] lustre: Unknown symbol ptlrpc_prep_req
[   42.056902] lustre: Unknown symbol lov_stripe_unlock
[   42.057052] lustre: Unknown symbol ptlrpc_set_wait
[   42.057191] lustre: Unknown symbol mdc_unlink
[   42.057309] lustre: Unknown symbol it_disposition
[   42.057426] lustre: Unknown symbol mdc_init_ea_size
[   42.057545] lustre: Unknown symbol mdc_enqueue
[   42.057727] lustre: Unknown symbol ptlrpc_req_finished
[   42.057862] lustre: Unknown symbol ldlm_lock_decref
[   42.057984] lustre: Unknown symbol mdc_close



Thank you very much for the help.

Best regards.
-- 
Ettore Enrico Delfino Ligorio ( ettore at usp.br )
Laboratório de Computação Científica Avançada da USP
( http://www.cce.usp.br 
http://www.usp.br/lcca )
+55-11-3091-6480      fax: +55-11-3091-1855

Visite: http://iptv.usp.br
Videoconferência? http://wiki.stoa.usp.br/Videoconferencia


On Mon, 2009-05-25 at 18:55 -0700, Evan Felix wrote:
> Dou you have the last 10-20 lines of the kernel log?  Run 'dmesg',
> 
> evan
> 
> 
> On 5/20/09 7:37 AM, "Ettore Enrico Delfino Ligorio" <ettore at usp.br> wrote:
> 
> > Hi,
> > 
> > Please, i need help.
> > 
> > Anyone had success using Lustre (from debian package) with xen in
> > debian (lenny or unstable)? What i must to make this work?
> > 
> > It didn't worked for me.
> > 
> > I have done the following steps:
> > 
> > puma2:~#  apt-get install  liblustre linux-patch-lustre lustre-dev
> > lustre-source lustre-tests lustre-utils ldiskfsck lfsck
> > 
> > puma2:~#  module-assistant build lustre
> > 
> > puma2:~#  module-assistant install lustre
> > 
> > puma2:~# cat /etc/rc.local |grep lustre
> > modprobe lustre
> > puma2:~# reboot
> > 
> > puma2:~# mkfs.lustre --mgs --mdt --fsname puma2 /dev/sda5
> > 
> >     Permanent disk data:
> > Target:     puma2-MDTffff
> > Index:      unassigned
> > Lustre FS:  puma2
> > Mount type: ldiskfs
> > Flags:      0x75
> >                (MDT MGS needs_index first_time update )
> > Persistent mount opts: errors=remount-ro,iopen_nopriv,user_xattr
> > Parameters: mdt.group_upcall=/usr/sbin/l_getgroups
> > 
> > checking for existing Lustre data: not found
> > device size = 262774MB
> > 2 6 26
> > formatting backing filesystem ldiskfs on /dev/sda5
> > target name  puma2-MDTffff
> > 4k blocks     0
> > options        -J size=400 -i 4096 -I 512 -q -O dir_index,uninit_groups -F
> > mkfs_cmd = mkfs.ext2 -j -b 4096 -L puma2-MDTffff  -J size=400 -i 4096
> > -I 512 -q -O dir_index,uninit_groups -F /dev/sda5
> > 
> > mkfs.lustre: Unable to mount /dev/sda5: No such device
> > Is the ldiskfs module available?
> > 
> > mkfs.lustre FATAL: failed to write local files
> > mkfs.lustre: exiting with 19 (No such device)
> > 
> > puma2:~# mkdir /mdt
> > 
> > puma2:~# mount -t lustre /dev/sda5 /mdt/
> > mount.lustre: mount /dev/sda5 at /mdt failed: No such device
> > Are the lustre modules loaded?
> > Check /etc/modprobe.conf and /proc/filesystems
> > Note 'alias lustre llite' should be removed from modprobe.conf
> > 
> > puma2:~# fdisk -l /dev/sda
> > 
> > Disk /dev/sda: 299.4 GB, 299439751168 bytes
> > 255 heads, 63 sectors/track, 36404 cylinders
> > Units = cylinders of 16065 * 512 = 8225280 bytes
> > Disk identifier: 0x00059841
> > 
> >     Device Boot      Start         End      Blocks   Id  System
> > /dev/sda1   *           1          79      634536   83  Linux
> > /dev/sda2              80         294     1726987+  82  Linux swap / Solaris
> > /dev/sda3             295        2905    20972857+  83  Linux
> > /dev/sda4            2906       36404   269080717+   5  Extended
> > /dev/sda5            2906       36404   269080686   83  Linux
> > 
> > puma2:~# uname -a
> > Linux puma2 2.6.26-2-xen-amd64 #1 SMP Wed May 13 18:43:45 UTC 2009
> > x86_64 GNU/Linux
> > 
> > This is description of booted kernel in /boot/grub/menu.lst
> > 
> > title  Xen 3.2-1-amd64 / Debian GNU/Linux, kernel 2.6.26-2-xen-amd64
> > root  (hd0,0)
> > kernel  /xen-3.2-1-amd64.gz
> > module  /vmlinuz-2.6.26-2-xen-amd64 root=/dev/sda3 ro console=tty0
> > module  /initrd.img-2.6.26-2-xen-amd64
> > 
> > puma2:~# lsmod |grep lustre
> > lustre                446816  0
> > lov                   274056  1 lustre
> > mdc                   102840  1 lustre
> > osc                   149512  1 lustre
> > ptlrpc                716936  5 lustre,lov,mdc,lquota,osc
> > obdclass              530776  6 lustre,lov,mdc,lquota,osc,ptlrpc
> > lnet                  233256  4 lustre,ptlrpc,ksocklnd,obdclass
> > lvfs                   71112  7 lustre,lov,mdc,lquota,osc,ptlrpc,obdclass
> > libcfs                120312  10
> > lustre,lov,mdc,lquota,osc,ptlrpc,ksocklnd,obdclass,lnet,lvfs
> > puma2:~# lsmod |grep ldisk
> > puma2:~#
> > 
> >  From another machine i try, with same configuration:
> > 
> > puma30:~# mkdir /ost
> > puma30:~# mkfs.lustre --ost --fsname puma2 --mgsnode=puma2 at tcp0 /dev/sda5
> > 
> >     Permanent disk data:
> > Target:     puma2-OSTffff
> > Index:      unassigned
> > Lustre FS:  puma2
> > Mount type: ldiskfs
> > Flags:      0x72
> >                (OST needs_index first_time update )
> > Persistent mount opts: errors=remount-ro,extents,mballoc
> > Parameters: mgsnode=10.0.2.2 at tcp
> > 
> > checking for existing Lustre data: not found
> > device size = 262774MB
> > 2 6 26
> > formatting backing filesystem ldiskfs on /dev/sda5
> > target name  puma2-OSTffff
> > 4k blocks     0
> > options        -J size=400 -i 16384 -I 256 -q -O dir_index,uninit_groups -F
> > mkfs_cmd = mkfs.ext2 -j -b 4096 -L puma2-OSTffff  -J size=400 -i 16384
> > -I 256 -q -O dir_index,uninit_groups -F /dev/sda5
> > mkfs.lustre: Unable to mount /dev/sda5: No such device
> > Is the ldiskfs module available?
> > 
> > mkfs.lustre FATAL: failed to write local files
> > mkfs.lustre: exiting with 19 (No such device)
> > 
> > puma30:~# mount -t lustre puma2 at tcp0:/puma2 /ost
> > mount.lustre: mount puma2 at tcp0:/puma2 at /ost failed: Cannot send
> > after transport endpoint shutdown
> > puma30:~#
> > 
> > 
> > Thanks in advance.
> 
> 





More information about the Pkg-lustre-maintainers mailing list