Top of Form we''re getting these errors on all our ost''s, oss02: Nov 9 03:43:51 oss02 kernel: LustreError: 9737:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727598: rc -2 oss02: Nov 9 03:55:52 oss02 kernel: LustreError: 9640:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727642: rc -2 oss02: Nov 9 04:07:31 oss02 kernel: LustreError: 9712:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727692: rc -2 oss02: Nov 9 04:43:22 oss02 kernel: LustreError: 9629:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727827: rc -2 oss02: Nov 9 05:58:03 oss02 kernel: LustreError: 9679:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64728103: rc -2 what causes this, and how do we fix it? Regards Hellen -------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20101109/f667adb8/attachment.html
Looks like some file objects on the OSS are missing. Were there some client evictions lately in your system? You can do a lfsck on the filesystem to check whether there are missing objects. ? 2010-11-9???4:15? Hellen ???> > we''re getting these errors on all our ost''s, > oss02: Nov 9 03:43:51 oss02 kernel: LustreError: 9737:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727598: rc -2 > oss02: Nov 9 03:55:52 oss02 kernel: LustreError: 9640:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727642: rc -2 > oss02: Nov 9 04:07:31 oss02 kernel: LustreError: 9712:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727692: rc -2 > oss02: Nov 9 04:43:22 oss02 kernel: LustreError: 9629:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727827: rc -2 > oss02: Nov 9 05:58:03 oss02 kernel: LustreError: 9679:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64728103: rc -2 > what causes this, and how do we fix it? > Regards > Hellen > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20101109/18d5b395/attachment.html
Hellen, you can see that message in two cases 1) valid race, when client try get info via stat() syscall and unlink that file in same time. 2) some ost objects are lost. that case typically hit after unclean shutdown. second case you need 1) stop OST 2) run e2fsck to OST partition. 3) mount partition as ldiskfs and run ll_recover_lost_found_objs tool to move objects into correct place from "lost+found". 4) umount partition after it you can start OST again. if you will see that messages after that procedure - you need run lfsck to find which files are corrupted and restore it from backup. On Nov 9, 2010, at 11:15, Hellen wrote:> > we''re getting these errors on all our ost''s, > oss02: Nov 9 03:43:51 oss02 kernel: LustreError: 9737:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727598: rc -2 > oss02: Nov 9 03:55:52 oss02 kernel: LustreError: 9640:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727642: rc -2 > oss02: Nov 9 04:07:31 oss02 kernel: LustreError: 9712:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727692: rc -2 > oss02: Nov 9 04:43:22 oss02 kernel: LustreError: 9629:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64727827: rc -2 > oss02: Nov 9 05:58:03 oss02 kernel: LustreError: 9679:0:(ldlm_resource.c:849:ldlm_resource_add()) lvbo_init failed for resource 64728103: rc -2 > what causes this, and how do we fix it? > Regards > Hellen > _______________________________________________ > Lustre-discuss mailing list > Lustre-discuss at lists.lustre.org > http://lists.lustre.org/mailman/listinfo/lustre-discuss-------------- next part -------------- An HTML attachment was scrubbed... URL: http://lists.lustre.org/pipermail/lustre-discuss/attachments/20101109/e992253b/attachment.html