This node rebooted due to a kernel panic and we are not able to mount the ocfs2
filesystems after that. Please help
[root at guard0 ~]# /etc/init.d/o2cb online
Loading module "configfs": OK
Mounting configfs filesystem at /sys/kernel/config: OK
Loading module "ocfs2_nodemanager": OK
Loading module "ocfs2_dlm": OK
Loading module "ocfs2_dlmfs": OK
Mounting ocfs2_dlmfs filesystem at /dlm: OK
Starting O2CB cluster ocfs2: OK
[root at guard0 ~]# /etc/init.d/ocfs2 start
Starting Oracle Cluster File System (OCFS2) mount.ocfs2: Transport endpoint is
not connected while mounting /dev/sdah on /oracrs. Check 'dmesg' for
more information on this error.
mount.ocfs2: Transport endpoint is not connected while mounting /dev/emcpowerf1
on /orabackup1. Check 'dmesg' for more information on this error.
[FAILED]
Aug 10 10:36:05 guard0 kernel: OCFS2 Node Manager 1.2.9 Mon May 19 11:42:58 PDT
2008 (build 69167bd75e307f3509c09b37da405545)
Aug 10 10:36:05 guard0 kernel: OCFS2 DLM 1.2.9 Mon May 19 11:42:58 PDT 2008
(build aa1e8182d31976099e5080b931a5d104)
Aug 10 10:36:05 guard0 kernel: OCFS2 DLMFS 1.2.9 Mon May 19 11:42:58 PDT 2008
(build aa1e8182d31976099e5080b931a5d104)
Aug 10 10:36:05 guard0 kernel: OCFS2 User DLM kernel interface loaded
Aug 10 10:36:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11694.
Aug 10 10:36:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11880.
Aug 10 10:36:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11708.
Aug 10 10:36:28 guard0 kernel: OCFS2 1.2.9 Mon May 19 11:42:54 PDT 2008 (build
a693806cb619dd7f225004092b675ede)
Aug 10 10:37:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11708.
Aug 10 10:37:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11694.
Aug 10 10:37:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11880.
Aug 10 10:37:24 guard0 kernel: (17056,12):o2net_connect_expired:1585 ERROR: no
connection established with node 1 after 60.0 seconds, giving up and returning
errors.
Aug 10 10:37:24 guard0 kernel: (17171,12):dlm_request_join:901 ERROR: status =
-107
Aug 10 10:37:24 guard0 kernel: (17171,12):dlm_try_to_join_domain:1049 ERROR:
status = -107
Aug 10 10:37:24 guard0 kernel: (17171,12):dlm_join_domain:1321 ERROR: status =
-107
Aug 10 10:37:24 guard0 kernel: (17171,12):dlm_register_domain:1514 ERROR: status
= -107
Aug 10 10:37:24 guard0 kernel: (17171,12):ocfs2_dlm_init:2024 ERROR: status =
-107
Aug 10 10:37:24 guard0 kernel: (17171,12):ocfs2_mount_volume:1133 ERROR: status
= -107
Aug 10 10:37:24 guard0 kernel: ocfs2: Unmounting device (66,16) on (node 0)
Aug 10 10:38:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11708.
Aug 10 10:38:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11880.
Aug 10 10:38:20 guard0 logger: Cluster Ready Services waiting on dependencies.
Diagnostics in /tmp/crsctl.11694.
Aug 10 10:38:29 guard0 kernel: (17056,4):o2net_connect_expired:1585 ERROR: no
connection established with node 1 after 60.0 seconds, giving up and returning
errors.
Aug 10 10:38:29 guard0 kernel: (17304,0):dlm_request_join:901 ERROR: status =
-107
Aug 10 10:38:29 guard0 kernel: (17304,0):dlm_try_to_join_domain:1049 ERROR:
status = -107
Aug 10 10:38:29 guard0 kernel: (17304,0):dlm_join_domain:1321 ERROR: status =
-107
Aug 10 10:38:29 guard0 kernel: (17304,0):dlm_register_domain:1514 ERROR: status
= -107
Aug 10 10:38:29 guard0 kernel: (17304,0):ocfs2_dlm_init:2024 ERROR: status =
-107
Aug 10 10:38:29 guard0 kernel: (17304,0):ocfs2_mount_volume:1133 ERROR: status =
-107
Aug 10 10:38:29 guard0 kernel: ocfs2: Unmounting device (120,81) on (node 0)
Regards,
Saranya Sivakumar
__________________________________________________
Do You Yahoo!?
Tired of spam? Yahoo! Mail has the best spam protection around
http://mail.yahoo.com
-------------- next part --------------
An HTML attachment was scrubbed...
URL:
http://oss.oracle.com/pipermail/ocfs2-users/attachments/20090810/89bc5648/attachment.html
The nodes are failing to connect to each other on that interface. Ensure the ips are correct. The firewalls are disabled or have the rules to enable the traffic on port 7777 (or whatever you have set). You can use "ping -I ethX ipaddress" to check whether the ip is valid. Saranya Sivakumar wrote:> This node rebooted due to a kernel panic and we are not able to mount > the ocfs2 filesystems after that. Please help > > [root at guard0 ~]# /etc/init.d/o2cb online > Loading module "configfs": OK > Mounting configfs filesystem at /sys/kernel/config: OK > Loading module "ocfs2_nodemanager": OK > Loading module "ocfs2_dlm": OK > Loading module "ocfs2_dlmfs": OK > Mounting ocfs2_dlmfs filesystem at /dlm: OK > Starting O2CB cluster ocfs2: OK > > [root at guard0 ~]# /etc/init.d/ocfs2 start > Starting Oracle Cluster File System (OCFS2) mount.ocfs2: Transport > endpoint is not connected while mounting /dev/sdah on /oracrs. Check > 'dmesg' for more information on this error. > mount.ocfs2: Transport endpoint is not connected while mounting > /dev/emcpowerf1 on /orabackup1. Check 'dmesg' for more information on > this error. > [FAILED] > > Aug 10 10:36:05 guard0 kernel: OCFS2 Node Manager 1.2.9 Mon May 19 > 11:42:58 PDT 2008 (build 69167bd75e307f3509c09b37da405545) > Aug 10 10:36:05 guard0 kernel: OCFS2 DLM 1.2.9 Mon May 19 11:42:58 PDT > 2008 (build aa1e8182d31976099e5080b931a5d104) > Aug 10 10:36:05 guard0 kernel: OCFS2 DLMFS 1.2.9 Mon May 19 11:42:58 > PDT 2008 (build aa1e8182d31976099e5080b931a5d104) > Aug 10 10:36:05 guard0 kernel: OCFS2 User DLM kernel interface loaded > Aug 10 10:36:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11694. > Aug 10 10:36:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11880. > Aug 10 10:36:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11708. > Aug 10 10:36:28 guard0 kernel: OCFS2 1.2.9 Mon May 19 11:42:54 PDT > 2008 (build a693806cb619dd7f225004092b675ede) > Aug 10 10:37:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11708. > Aug 10 10:37:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11694. > Aug 10 10:37:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11880. > Aug 10 10:37:24 guard0 kernel: (17056,12):o2net_connect_expired:1585 > ERROR: no connection established with node 1 after 60.0 seconds, > giving up and returning errors. > Aug 10 10:37:24 guard0 kernel: (17171,12):dlm_request_join:901 ERROR: > status = -107 > Aug 10 10:37:24 guard0 kernel: (17171,12):dlm_try_to_join_domain:1049 > ERROR: status = -107 > Aug 10 10:37:24 guard0 kernel: (17171,12):dlm_join_domain:1321 ERROR: > status = -107 > Aug 10 10:37:24 guard0 kernel: (17171,12):dlm_register_domain:1514 > ERROR: status = -107 > Aug 10 10:37:24 guard0 kernel: (17171,12):ocfs2_dlm_init:2024 ERROR: > status = -107 > Aug 10 10:37:24 guard0 kernel: (17171,12):ocfs2_mount_volume:1133 > ERROR: status = -107 > Aug 10 10:37:24 guard0 kernel: ocfs2: Unmounting device (66,16) on > (node 0) > Aug 10 10:38:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11708. > Aug 10 10:38:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11880. > Aug 10 10:38:20 guard0 logger: Cluster Ready Services waiting on > dependencies. Diagnostics in /tmp/crsctl.11694. > Aug 10 10:38:29 guard0 kernel: (17056,4):o2net_connect_expired:1585 > ERROR: no connection established with node 1 after 60.0 seconds, > giving up and returning errors. > Aug 10 10:38:29 guard0 kernel: (17304,0):dlm_request_join:901 ERROR: > status = -107 > Aug 10 10:38:29 guard0 kernel: (17304,0):dlm_try_to_join_domain:1049 > ERROR: status = -107 > Aug 10 10:38:29 guard0 kernel: (17304,0):dlm_join_domain:1321 ERROR: > status = -107 > Aug 10 10:38:29 guard0 kernel: (17304,0):dlm_register_domain:1514 > ERROR: status = -107 > Aug 10 10:38:29 guard0 kernel: (17304,0):ocfs2_dlm_init:2024 ERROR: > status = -107 > Aug 10 10:38:29 guard0 kernel: (17304,0):ocfs2_mount_volume:1133 > ERROR: status = -107 > Aug 10 10:38:29 guard0 kernel: ocfs2: Unmounting device (120,81) on > (node 0) > > > > Regards, > > Saranya Sivakumar > > > __________________________________________________ > Do You Yahoo!? > Tired of spam? Yahoo! Mail has the best spam protection around > http://mail.yahoo.com > ------------------------------------------------------------------------ > > _______________________________________________ > Ocfs2-users mailing list > Ocfs2-users at oss.oracle.com > http://oss.oracle.com/mailman/listinfo/ocfs2-users