Ms. Megan Larko
2009-May-18 14:03 UTC
[Lustre-discuss] Can lustre be a client on CentOS 5.3?
Hi, I''m building some new machines onto which I''d like to mount lustre from our OSS of lustre version 1.6.4.3. The new machines is CentOS 5.3. The default CentOS 5.3 kernel is 2.6.18-128. I couldn''t get lustre to mount on that version so I installed 2.6.18-92.1.17.el5 from rpm and successfully booted into that kernel. I cannot mount any lustre disks on this system as the client. The "modprobe lustre" command fails. There is indeed a module for it in the /lib/modules/2.6.18-92.1.17.el5 directory but using it gives many errors (in attached text format file). I have the impression that I am missing something obvious. I''m not certain what. I am hoping the List can enlighten my "Doh!" Homer-Simpson-esque moment. Distro: CentOS 5.3 [larkoc at cn3 log]$ uname -a Linux cn3.crew.local 2.6.18-92.1.17.el5 #1 SMP Tue Nov 4 13:43:30 EST 2008 x86_64 x86_64 x86_64 GNU/Linux [root at cn3 lustre]# modprobe lustre FATAL: Error inserting lustre (/lib/modules/2.6.18-92.1.17.el5/kernel/fs/lustre/lustre.ko): Unknown symbol in module, or unknown parameter (see dmesg) In the /lib/modules/2.6.18-92.1.17.el5/kernel/fs/lustre there are indeed lustre and associated modules: larkoc at cn3 lustre]$ ls llite_lloop.ko lov.ko lquota.ko lustre.ko lvfs.ko mdc.ko mgc.ko obdclass.ko obdecho.ko osc.ko ptlrpc.ko Small sample of errors from /var/log/messages: May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_create_cq May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_create_cq May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_resolve_addr May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_resolve_addr May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_dereg_mr May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_dereg_mr May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_reject May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_reject May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_disconnect May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_disconnect May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_resolve_route May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_resolve_route May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_bind_addr May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_bind_addr May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_create_qp Thanks in advance for the enlightenment. megan -------------- next part -------------- 15 May 2009 Running a generic CentOS kernel: [larkoc at cn3 log]$ uname -a Linux cn3.crew.local 2.6.18-92.1.17.el5 #1 SMP Tue Nov 4 13:43:30 EST 2008 x86_64 x86_64 x86_64 GNU/Linux [root at cn3 lustre]# modprobe lustre FATAL: Error inserting lustre (/lib/modules/2.6.18-92.1.17.el5/kernel/fs/lustre/lustre.ko): Unknown symbol in module, or unknown parameter (see dmesg) In the /lib/modules/2.6.18-92.1.17.el5/kernel/fs/lustre there are indeed lustre and associated modules: larkoc at cn3 lustre]$ ls llite_lloop.ko lov.ko lquota.ko lustre.ko lvfs.ko mdc.ko mgc.ko obdclass.ko obdecho.ko osc.ko ptlrpc.ko There are *many* "Unknown symbol in module" according to the output in /var/log/messages: May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_create_cq May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_create_cq May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_resolve_addr May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_resolve_addr May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_dereg_mr May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_dereg_mr May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_reject May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_reject May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_disconnect May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_disconnect May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_resolve_route May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_resolve_route May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_bind_addr May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_bind_addr May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_create_qp May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_create_qp May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_destroy_cq May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_destroy_cq May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_create_id May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_create_id May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_listen May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_listen May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_destroy_qp May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_destroy_qp May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_get_dma_mr May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_get_dma_mr May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_alloc_pd May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_alloc_pd May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_connect May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_connect May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_modify_qp May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_modify_qp May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_destroy_id May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_destroy_id May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol rdma_accept May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol rdma_accept May 18 09:38:09 cn3 kernel: ko2iblnd: disagrees about version of symbol ib_dealloc_pd May 18 09:38:09 cn3 kernel: ko2iblnd: Unknown symbol ib_dealloc_pd May 18 09:38:09 cn3 modprobe: FATAL: Error inserting ko2iblnd (/lib/modules/2.6.18-92.1.17.el5/kernel/net/lustre/ko2iblnd.ko): Unknown symbol in module, or unknown parameter (see dmesg) May 18 09:38:09 cn3 kernel: LustreError: 19205:0:(api-ni.c:1043:lnet_startup_lndnis()) Can''t load LND o2ib, module ko2iblnd, rc=256 May 18 09:38:09 cn3 kernel: LustreError: 19205:0:(events.c:713:ptlrpc_init_portals()) network initialisation failed May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_prep_enqueue_req May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_resource_get May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_lprocfs_register_obd May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_cli_cancel_unused May 18 09:38:09 cn3 kernel: osc: Unknown symbol _ldlm_lock_debug May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_msg_get_conn_cnt May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_lprocfs_brw May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpcd_addref May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_deactivate_import May 18 09:38:09 cn3 kernel: osc: Unknown symbol llog_origin_connect May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_check_set May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_init_rq_pool May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_queue_wait May 18 09:38:09 cn3 kernel: osc: Unknown symbol client_import_del_conn May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_request_addref May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_invalidate_import May 18 09:38:09 cn3 kernel: osc: Unknown symbol client_obd_setup May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_prep_elc_req May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_cancel_resource_local May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_lock_match May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_set_import_active May 18 09:38:09 cn3 kernel: osc: Unknown symbol client_obd_cleanup May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_prep_bulk_imp May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_set_add_req May 18 09:38:09 cn3 kernel: osc: Unknown symbol __ldlm_handle2lock May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_add_rqs_to_pool May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpcd_add_req May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_prep_bulk_page May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_lock_fast_match May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_msg_get_transno May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_msg_buf May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_cli_cancel May 18 09:38:09 cn3 kernel: osc: Unknown symbol llog_obd_repl_cancel May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_req_xid May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_lock_put May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_swab_obd_statfs May 18 09:38:09 cn3 kernel: osc: Unknown symbol client_import_add_conn May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_sample_next_xid May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_lock_addref May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_swab_ost_lvb May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_lock_decref_and_cancel May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_resource_iterate May 18 09:38:09 cn3 kernel: osc: Unknown symbol unlock_res_and_lock May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_cli_enqueue May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpcd_wake May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_at_set_req_timeout May 18 09:38:09 cn3 kernel: osc: Unknown symbol lock_res_and_lock May 18 09:38:09 cn3 kernel: osc: Unknown symbol client_disconnect_export May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_free_rq_pool May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_lock_fast_release May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_lock2handle May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_cli_join_lru May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_prep_req_pool May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_msg_get_opc May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_import_setasync May 18 09:38:09 cn3 kernel: osc: Unknown symbol lprocfs_wr_ping May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_namespace_cleanup May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_mark_interrupted May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_fail_import May 18 09:38:09 cn3 kernel: osc: Unknown symbol llog_initiator_connect May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_resource_putref May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_msg_size May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_msg_early_size May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_swab_ost_body May 18 09:38:09 cn3 kernel: osc: Unknown symbol _debug_req May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_swab_repbuf May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_swab_ost_last_id May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_recover_import May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_prep_req May 18 09:38:09 cn3 kernel: osc: Unknown symbol client_connect_import May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpcd_decref May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_cli_enqueue_fini May 18 09:38:09 cn3 kernel: osc: Unknown symbol lustre_swab_fiemap May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_req_finished May 18 09:38:09 cn3 kernel: osc: Unknown symbol ldlm_lock_decref May 18 09:38:09 cn3 kernel: osc: Unknown symbol ptlrpc_lprocfs_unregister_obd May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_prep_enqueue_req May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_resource_get May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_lprocfs_register_obd May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_get_last_xid May 18 09:38:09 cn3 kernel: mdc: Unknown symbol _ldlm_lock_debug May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpcd_addref May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_check_set May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_get_last_committed May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_queue_wait May 18 09:38:09 cn3 kernel: mdc: Unknown symbol client_import_del_conn May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_request_addref May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_bufcount May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_invalidate_import May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_completion_ast May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_add_flags May 18 09:38:09 cn3 kernel: mdc: Unknown symbol client_obd_setup May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_prep_elc_req May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_cancel_resource_local May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_lock_match May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_set_import_active May 18 09:38:09 cn3 kernel: mdc: Unknown symbol client_obd_cleanup May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_prep_bulk_imp May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_set_add_req May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_swab_mds_body May 18 09:38:09 cn3 kernel: mdc: Unknown symbol __ldlm_handle2lock May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpcd_add_req May 18 09:38:09 cn3 kernel: mdc: Unknown symbol llog_client_ops May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_prep_bulk_page May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_buf May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_buflen May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_lock_put May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_swab_obd_statfs May 18 09:38:09 cn3 kernel: mdc: Unknown symbol client_import_add_conn May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_packed_msg_size May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_lock_addref May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_lock_decref_and_cancel May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_resource_iterate May 18 09:38:09 cn3 kernel: mdc: Unknown symbol unlock_res_and_lock May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_cli_enqueue May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_at_set_req_timeout May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lock_res_and_lock May 18 09:38:09 cn3 kernel: mdc: Unknown symbol client_disconnect_export May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_get_opc May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_import_setasync May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lprocfs_wr_ping May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_namespace_cleanup May 18 09:38:09 cn3 kernel: mdc: Unknown symbol llog_initiator_connect May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_get_status May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_resource_putref May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_size May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_early_size May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_early_size May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_it2str May 18 09:38:09 cn3 kernel: mdc: Unknown symbol _debug_req May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_get_type May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_swab_repbuf May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_recover_import May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_prep_req May 18 09:38:09 cn3 kernel: mdc: Unknown symbol client_connect_import May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpcd_decref May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_cli_enqueue_fini May 18 09:38:09 cn3 kernel: mdc: Unknown symbol lustre_msg_set_buflen May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_req_finished May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ldlm_lock_decref May 18 09:38:09 cn3 kernel: mdc: Unknown symbol ptlrpc_lprocfs_unregister_obd May 18 09:38:09 cn3 kernel: lov: Unknown symbol ptlrpc_set_destroy May 18 09:38:09 cn3 kernel: lov: Unknown symbol ptlrpc_prep_set May 18 09:38:09 cn3 kernel: lov: Unknown symbol _ldlm_lock_debug May 18 09:38:09 cn3 kernel: lov: Unknown symbol lustre_swab_lov_user_md May 18 09:38:09 cn3 kernel: lov: Unknown symbol ptlrpc_set_add_cb May 18 09:38:09 cn3 kernel: lov: Unknown symbol __ldlm_handle2lock May 18 09:38:09 cn3 kernel: lov: Unknown symbol ldlm_lock_put May 18 09:38:09 cn3 kernel: lov: Unknown symbol ptlrpc_activate_import May 18 09:38:09 cn3 kernel: lov: Unknown symbol ldlm_lock_allow_match May 18 09:38:09 cn3 kernel: lov: Unknown symbol lustre_swab_lov_desc May 18 09:38:09 cn3 kernel: lov: Unknown symbol ptlrpc_set_wait May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ptlrpc_set_destroy May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_lock_dump_handle May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lov_stripe_lock May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_set_open_replay_data May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ptlrpc_prep_set May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lustre_msg_string May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_cli_cancel_unused May 18 09:38:09 cn3 kernel: lustre: Unknown symbol _ldlm_lock_debug May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_revalidate_lock May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_clear_open_replay_data May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_setxattr May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_getattr May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ptlrpc_queue_wait May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_sync May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ptlrpc_request_addref May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_extent_shift_kms May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_flock_completion_ast May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lov_test_and_clear_async_rc May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_req2lustre_md May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_change_cbdata May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lustre_msg_bufcount May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_intent_lock May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_completion_ast May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_lock_match May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_set_lock_data May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ptlrpc_set_import_active May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_rename May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_getstatus May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_getattr_name May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lustre_pack_reply May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lustre_msg_buf May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_cli_cancel May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lustre_msg_buflen May 18 09:38:09 cn3 kernel: lustre: Unknown symbol it_open_error May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_intent_getattr_async May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_create May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_readpage May 18 09:38:09 cn3 kernel: lustre: Unknown symbol osc_extent_blocking_cb May 18 09:38:09 cn3 kernel: lustre: Unknown symbol unlock_res_and_lock May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_cli_enqueue May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lock_res_and_lock May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_lock2handle May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_link May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_setattr May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_free_lustre_md May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_getxattr May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_store_inode_generation May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lustre_msg_size May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lustre_msg_early_size May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_it2str May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lustre_swab_repbuf May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ptlrpc_prep_req May 18 09:38:09 cn3 kernel: lustre: Unknown symbol lov_stripe_unlock May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ptlrpc_set_wait May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_unlink May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_init_ea_size May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_enqueue May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ptlrpc_req_finished May 18 09:38:09 cn3 kernel: lustre: Unknown symbol ldlm_lock_decref May 18 09:38:09 cn3 kernel: lustre: Unknown symbol mdc_close
Peter Kjellstrom
2009-May-18 14:23 UTC
[Lustre-discuss] Can lustre be a client on CentOS 5.3?
On Monday 18 May 2009, Ms. Megan Larko wrote:> Hi, > > I''m building some new machines onto which I''d like to mount lustre > from our OSS of lustre version 1.6.4.3. > The new machines is CentOS 5.3. The default CentOS 5.3 kernel is > 2.6.18-128.You should be running 2.6.18-128.1.10 (security). Anyhow, it''s easy to compile and use the current lustre-1.6(.7.1) as a patchless client on CentOS-5.3 (we do it on our machines). This is assuming you''re on x86_64, I know nothing about the others. /Peter -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 189 bytes Desc: This is a digitally signed message part. Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090518/8becdb1e/attachment.bin
Joseph Farran
2009-Jun-10 21:29 UTC
[Lustre-discuss] Can lustre be a client on CentOS 5.3?
>You should be running 2.6.18-128.1.10 (security). > >Anyhow, it''s easy to compile and use the current lustre-1.6(.7.1) as a >patchless client on CentOS-5.3 (we do it on our machines). > >This is assuming you''re on x86_64, I know nothing about the others.Can a kind soul describe the steps in this easy building of Lustre on CentOS 5.3 with Lustre 1.6 or 1.8? Thanks, Joseph
Craig Tierney
2009-Jun-10 23:13 UTC
[Lustre-discuss] Can lustre be a client on CentOS 5.3?
Joseph Farran wrote:>> You should be running 2.6.18-128.1.10 (security). >> >> Anyhow, it''s easy to compile and use the current lustre-1.6(.7.1) as a >> patchless client on CentOS-5.3 (we do it on our machines). >> >> This is assuming you''re on x86_64, I know nothing about the others. > > Can a kind soul describe the steps in this easy building of Lustre on CentOS 5.3 with Lustre 1.6 or 1.8? > > Thanks, > Joseph >If you have the kernel source installed, all I did to build lustre-1.8.0.1rc5 was the following: # tar -xvzf lustre-.... (Ok I downloaded from svn, but you need to do this with your tarball) # cd lustre-1.8.0.1rc5 # ./configure --disable-server --prefix=/opt/lustre/1.8.0.1rc5 \ --with-o2ib=/opt/system/ofed/1.4.1/src/openib \ --with-linux=/usr/src/kernels/linux-2.6.18-128.1.10.el5 --enable-quota # make # make install # depmod -a Then I could mount the filesystem with: mount -t lustre -o _netdev,flock 10.180.0.1 at o2ib:/scratch /mnt/scratch It is that easy. Note, if you use a different prefix, you need to create a symlink from /sbin/mount.lustre to $PREFIX/sbin/mount.lustre so mount can find it. If you need to install the source, I think the procedure is: # rpm -i kernel-2.6.18-128.1.10.el5.src.rpm # cd /usr/src/redhat/SPECS # rpmbuild -bp --target $(uname -m) kernel-2.6.spec # cd ../BUILD/kernel-2.6.18 # mv linux-2.6.18_x86_64 /usr/src/kernels/linux-2.6.18-128.1.10.el5 # cd /usr/src/kernels/linux-2.6.18-92.1.10.el5 # cd config # cp kernel-2.6.18-x86_64.config ../.config At this point I don''t know if you have to configure the kernel. If you do: -- Modify Makefile and change EXTRA to -128.1.10.el5 # make oldconfig Also, you may just be able to install the devel and headers packages for the kernel and Lustre will build off those. I have notes that said I tried it but don''t remember the outcome since I had to rebuild the kernel from source anyway. Craig> _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss >-- Craig Tierney (craig.tierney at noaa.gov)
Brian J. Murrell
2009-Jun-11 00:16 UTC
[Lustre-discuss] Can lustre be a client on CentOS 5.3?
On Wed, 2009-06-10 at 17:13 -0600, Craig Tierney wrote:> > # ./configure --disable-server --prefix=/opt/lustre/1.8.0.1rc5 \ > --with-o2ib=/opt/system/ofed/1.4.1/src/openib \ > --with-linux=/usr/src/kernels/linux-2.6.18-128.1.10.el5 --enable-quota > # makemake rpms is also a possibility here if you prefer to have RPMs that you can install rather than "make install". Personally, I would never pollute the filesystem of any machine I run, much less a production system with a "make install". I prefer to have every file in my filesystems catalogued and managed by the O/S'' package management system so that amongst other things, they are cleaned up on upgrades, package removals, etc. YMMV though. b. -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: application/pgp-signature Size: 197 bytes Desc: This is a digitally signed message part Url : http://lists.lustre.org/pipermail/lustre-discuss/attachments/20090610/62302bc0/attachment.bin
Craig Tierney
2009-Jun-11 16:17 UTC
[Lustre-discuss] Can lustre be a client on CentOS 5.3?
Brian J. Murrell wrote:> On Wed, 2009-06-10 at 17:13 -0600, Craig Tierney wrote: >> # ./configure --disable-server --prefix=/opt/lustre/1.8.0.1rc5 \ >> --with-o2ib=/opt/system/ofed/1.4.1/src/openib \ >> --with-linux=/usr/src/kernels/linux-2.6.18-128.1.10.el5 --enable-quota >> # make > > make rpms is also a possibility here if you prefer to have RPMs that you > can install rather than "make install". > > Personally, I would never pollute the filesystem of any machine I run, > much less a production system with a "make install". I prefer to have > every file in my filesystems catalogued and managed by the O/S'' package > management system so that amongst other things, they are cleaned up on > upgrades, package removals, etc. > > YMMV though. > > b. > >You make a good point. I don''t want my filesystem polluted either. That is why it is installed in /opt. My theory is that if it doesn''t come from the vendor OS, it doesn''t belong in /usr. That causes confusion and dependency hell. This procedure works when you have to support multiple versions of other tools (MPI, compilers, development tools, etc). Lustre is a special case. I never would have multiple versions Lustre in use to one time, so this could live in an RPM. Craig> > ------------------------------------------------------------------------ > > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-- Craig Tierney (craig.tierney at noaa.gov)