This may be a coincidence or not, but I''m building a new XEN system for
myself for work purposes.
I support several different versions of a software that cannot be installed
at the same time, so I decided I wanted to setup a XEN domU for each.
I had 5 spare 500GB drives so I put them in my system and partitioned them
so I have a RAID1 boot, a RAID5 root and a RAID5 images.
I got linux (Funtoo) installed on the root with my kernel on the boot. XEN
is installed as well and setup and running.
I created a xen_images folder and a iso _images folder both in the /images
folder.
I downloaded the ISO''s for the OS''s I need to install into
iso_images.
I then created several .img files in the xen_images folder using dd. For
example (dd if=/dev/zero of=/images/xen_images/Win7x86_Base.img bs=1 count=1
seek=50G)
I then started my first xen domU booting from the Win7 ISO I had and started
the install.
I got to the point where it formatted the "drive" and started
installing, it
failed on the extraction step saying my "DVD" was bad.
When I went back to check the md5/sha on the ISO I noticed that both of my
RAID5''s "lost" several members. The RAID1 is fine.
Strangely enough the system stays up with an OS drive that is supposedly
failed, granted a lot of functionality is lost, like missing files etc on
the missing parts of the RAID5 root
# cat /proc/mdstat
Personalities : [raid1] [raid6] [raid5] [raid4] [multipath]
md2 : active raid5 sda5[0](F) sde5[4](F) sdd5[3](F) sdc5[2] sdb5[1]
1724864512 blocks super 1.2 level 5, 512k chunk, algorithm 2 [5/2]
[_UU__]
md1 : active raid5 sda4[5](F) sde4[6](F) sdd4[7](F) sdc4[2] sdb4[1]
209713152 blocks level 5, 512k chunk, algorithm 2 [5/2] [_UU__]
md0 : active raid1 sda1[0] sde1[4] sdd1[3] sdc1[2] sdb1[1]
511936 blocks [5/5] [UUUUU]
If I check the drives I get informed that the md superblock has vanished on
the missing drives.
A reboot fails, because the RAID5''s are out of sync, and I have to go
into
the busybox shell in order to repair them.
After repairing, and forcing a fsck, the system checks out again as good. I
cannot get it to fail the RAID5''s again unless I attempt to start the
domU
install again.
Anyone run into this or something similar before?
MarcT
_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.xen.org/xen-users
On Sun, 2012-09-16 at 18:28 +0100, Marc Tousignant wrote:> I then created several .img files in the xen_images folder using dd. > For example (dd if=/dev/zero of=/images/xen_images/Win7x86_Base.img > bs=1 count=1 seek=50G)[...]> I got to the point where it formatted the “drive” and started > installing, it failed on the extraction step saying my “DVD” was bad.What does your guest config file look like, in particular the disk line. Is there any chance that you have accidentally pointed the VM's disks at one or more of the physical disks which makes up your RAID array? Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
On Sun, 2012-09-16 at 18:28 +0100, Marc Tousignant wrote:> I then created several .img files in the xen_images folder using dd. > For example (dd if=/dev/zero of=/images/xen_images/Win7x86_Base.img > bs=1 count=1 seek=50G)[...]> I got to the point where it formatted the “drive” and started > installing, it failed on the extraction step saying my “DVD” was bad.What does your guest config file look like, in particular the disk line. Is there any chance that you have accidentally pointed the VM's disks at one or more of the physical disks which makes up your RAID array? Ian. ---- Nope, no chance. Here is the entire config: kernel = "/usr/lib/xen/boot/hvmloader" builder='hvm' memory = 1024 #memory = 2048 # Should be at least 2KB per MB of domain memory, plus a few MB per vcpu. shadow_memory = 8 name = "Win7x86_Base" vfb = [ 'type=vnc,vncdisplay=11,vncpasswd=eva1unit' ] vif = [ 'mac=00:16:3E:33:5E:F9, bridge=xenbr0' ] acpi = 1 apic = 1 disk = [ 'tap:aio://images/xen_images/Win7x86_Base.img,hda,w', 'tap:aio://images/iso_images/en_windows_7_enterprise_with_sp1_x86_dvd_u_677710.iso,hdc:cdrom,r' ] #disk = [ 'tap:aio://images/xen_images/Win7x86_base.img,hda,w' ] device_model = '/usr/lib64/xen/bin/qemu-dm' #----------------------------------------------------------------------------- # boot on floppy (a), hard disk (c) or CD-ROM (d) # default: hard disk, cd-rom, floppy boot="dc" vncunused=1 sdl=0 serial='pty' usbdevice='tablet' vcpus=1 cpus = ['1'] localtime = 1 usb = 1 _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
FYI, I switched to file: and still the same issue occurred, with one exception.. This time it "lost" the RAID members while booting off the ISO. I hadn't even gotten to the install screens yet. -----Original Message----- From: Ian Campbell [mailto:Ian.Campbell@citrix.com] Sent: Sunday, September 16, 2012 2:08 PM To: Marc Tousignant Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? On Sun, 2012-09-16 at 18:28 +0100, Marc Tousignant wrote:> I then created several .img files in the xen_images folder using dd. > For example (dd if=/dev/zero of=/images/xen_images/Win7x86_Base.img > bs=1 count=1 seek=50G)[...]> I got to the point where it formatted the “drive” and started > installing, it failed on the extraction step saying my “DVD” was bad.What does your guest config file look like, in particular the disk line. Is there any chance that you have accidentally pointed the VM's disks at one or more of the physical disks which makes up your RAID array? Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Are there any messages in the kernel log or dmesg regarding these disks? On 09/16/2012 04:06 PM, Marc Tousignant wrote:> FYI, I switched to file: and still the same issue occurred, with > one exception.. This time it "lost" the RAID members while booting > off the ISO. I hadn't even gotten to the install screens yet. > > -----Original Message----- From: Ian Campbell > [mailto:Ian.Campbell@citrix.com] Sent: Sunday, September 16, 2012 > 2:08 PM To: Marc Tousignant Cc: xen-users@lists.xen.org Subject: > Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? > > On Sun, 2012-09-16 at 18:28 +0100, Marc Tousignant wrote: > >> I then created several .img files in the xen_images folder using >> dd. For example (dd if=/dev/zero >> of=/images/xen_images/Win7x86_Base.img bs=1 count=1 seek=50G) > [...] >> I got to the point where it formatted the “drive” and started >> installing, it failed on the extraction step saying my “DVD” was >> bad. > > What does your guest config file look like, in particular the disk > line. > > Is there any chance that you have accidentally pointed the VM's > disks at one or more of the physical disks which makes up your RAID > array? > > Ian. > > > > _______________________________________________ Xen-users mailing > list Xen-users@lists.xen.org http://lists.xen.org/xen-users >- -- Tony Lill, OCT, Tony.Lill@AJLC.Waterloo.ON.CA President, A. J. Lill Consultants (519) 650 0660 539 Grand Valley Dr., Cambridge, Ont. N3H 2S2 (519) 241 2461 - --------------- http://www.ajlc.waterloo.on.ca/ ---------------- -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/ iEYEARECAAYFAlBWYD0ACgkQGS8yZq1uvxBrOACfZvcort2fSIv1jTIL4I658art 3eMAn2AAtpfMSxHoBAw/vp7WE3u8jk6k =zydx -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
No messages in dmesg or on the console, though to be fair, the root partition is "broken" at that point and can't write to any files. I just tested again to be sure, this time I cant even cat the logs. -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Tony Lill Sent: Sunday, September 16, 2012 7:27 PM To: xen-users@lists.xen.org Subject: Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Are there any messages in the kernel log or dmesg regarding these disks? On 09/16/2012 04:06 PM, Marc Tousignant wrote:> FYI, I switched to file: and still the same issue occurred, with one > exception.. This time it "lost" the RAID members while booting off the > ISO. I hadn't even gotten to the install screens yet. > > -----Original Message----- From: Ian Campbell > [mailto:Ian.Campbell@citrix.com] Sent: Sunday, September 16, 2012 > 2:08 PM To: Marc Tousignant Cc: xen-users@lists.xen.org Subject: > Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? > > On Sun, 2012-09-16 at 18:28 +0100, Marc Tousignant wrote: > >> I then created several .img files in the xen_images folder using dd. >> For example (dd if=/dev/zero of=/images/xen_images/Win7x86_Base.img >> bs=1 count=1 seek=50G) > [...] >> I got to the point where it formatted the “drive” and started >> installing, it failed on the extraction step saying my “DVD” was bad. > > What does your guest config file look like, in particular the disk > line. > > Is there any chance that you have accidentally pointed the VM's disks > at one or more of the physical disks which makes up your RAID array? > > Ian. > > > > _______________________________________________ Xen-users mailing list > Xen-users@lists.xen.org http://lists.xen.org/xen-users >- -- Tony Lill, OCT, Tony.Lill@AJLC.Waterloo.ON.CA President, A. J. Lill Consultants (519) 650 0660 539 Grand Valley Dr., Cambridge, Ont. N3H 2S2 (519) 241 2461 - --------------- http://www.ajlc.waterloo.on.ca/ ---------------- -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/ iEYEARECAAYFAlBWYD0ACgkQGS8yZq1uvxBrOACfZvcort2fSIv1jTIL4I658art 3eMAn2AAtpfMSxHoBAw/vp7WE3u8jk6k =zydx -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 When I tried to upgrade my xen systems to a pvops xen/linux combo, I found that high disk I/O would cause disk errors and caused disks to be thrown out of the raid and all sorts of other badness. High of course, is a relative term. For one of my boxes, copying a large file was enough, on another, it needed something like running backups on several VMs simultaneously or trying to start my VM''s while rebuilding the raid. FWIW, I went back to Xen 3.4.4 and the SLES1 xenlinux kernel and they''ve been rock solid. On 09/16/2012 09:52 PM, Marc Tousignant wrote:> No messages in dmesg or on the console, though to be fair, the > root partition is "broken" at that point and can''t write to any > files. I just tested again to be sure, this time I cant even cat > the logs. > > -----Original Message----- From: xen-users-bounces@lists.xen.org > [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Tony Lill > Sent: Sunday, September 16, 2012 7:27 PM To: > xen-users@lists.xen.org Subject: Re: [Xen-users] Setting up XEN > domU causes RAID5 to fail? > > Are there any messages in the kernel log or dmesg regarding these > disks? > > On 09/16/2012 04:06 PM, Marc Tousignant wrote: >> FYI, I switched to file: and still the same issue occurred, with >> one exception.. This time it "lost" the RAID members while >> booting off the ISO. I hadn''t even gotten to the install screens >> yet. > >> -----Original Message----- From: Ian Campbell >> [mailto:Ian.Campbell@citrix.com] Sent: Sunday, September 16, 2012 >> 2:08 PM To: Marc Tousignant Cc: xen-users@lists.xen.org Subject: >> Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? > >> On Sun, 2012-09-16 at 18:28 +0100, Marc Tousignant wrote: > >>> I then created several .img files in the xen_images folder >>> using dd. For example (dd if=/dev/zero >>> of=/images/xen_images/Win7x86_Base.img bs=1 count=1 seek=50G) >> [...] >>> I got to the point where it formatted the “drive” and started >>> installing, it failed on the extraction step saying my “DVD” >>> was bad. > >> What does your guest config file look like, in particular the >> disk line. > >> Is there any chance that you have accidentally pointed the VM''s >> disks at one or more of the physical disks which makes up your >> RAID array? > >> Ian. > > > >> _______________________________________________ Xen-users >> mailing list Xen-users@lists.xen.org >> http://lists.xen.org/xen-users > > > > _______________________________________________ Xen-users mailing > list Xen-users@lists.xen.org http://lists.xen.org/xen-users > > > _______________________________________________ Xen-users mailing > list Xen-users@lists.xen.org http://lists.xen.org/xen-users >- -- Tony Lill, OCT, Tony.Lill@AJLC.Waterloo.ON.CA President, A. J. Lill Consultants (519) 650 0660 539 Grand Valley Dr., Cambridge, Ont. N3H 2S2 (519) 241 2461 - --------------- http://www.ajlc.waterloo.on.ca/ ---------------- -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/ iEYEARECAAYFAlBWhuoACgkQGS8yZq1uvxATEACbB6d3xJ/hgvf5fXClnvHNC2SA G88AniIiriGdvl10JF49zyfBh01WEuvQ =oRVn -----END PGP SIGNATURE-----
Maybe that is my issue. I''ll ask one of my coworkers if he can misplace a 2TB drive and I can eliminate the RAID. I had a few 500GB drives laying around and decided to repurpose them. MarcT -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Tony Lill Sent: Sunday, September 16, 2012 10:12 PM To: xen-users@lists.xen.org Subject: Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 When I tried to upgrade my xen systems to a pvops xen/linux combo, I found that high disk I/O would cause disk errors and caused disks to be thrown out of the raid and all sorts of other badness. High of course, is a relative term. For one of my boxes, copying a large file was enough, on another, it needed something like running backups on several VMs simultaneously or trying to start my VM''s while rebuilding the raid. FWIW, I went back to Xen 3.4.4 and the SLES1 xenlinux kernel and they''ve been rock solid. On 09/16/2012 09:52 PM, Marc Tousignant wrote:> No messages in dmesg or on the console, though to be fair, the root > partition is "broken" at that point and can''t write to any files. I > just tested again to be sure, this time I cant even cat the logs. > > -----Original Message----- From: xen-users-bounces@lists.xen.org > [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Tony Lill > Sent: Sunday, September 16, 2012 7:27 PM To: > xen-users@lists.xen.org Subject: Re: [Xen-users] Setting up XEN domU > causes RAID5 to fail? > > Are there any messages in the kernel log or dmesg regarding these > disks? > > On 09/16/2012 04:06 PM, Marc Tousignant wrote: >> FYI, I switched to file: and still the same issue occurred, with one >> exception.. This time it "lost" the RAID members while booting off >> the ISO. I hadn''t even gotten to the install screens yet. > >> -----Original Message----- From: Ian Campbell >> [mailto:Ian.Campbell@citrix.com] Sent: Sunday, September 16, 2012 >> 2:08 PM To: Marc Tousignant Cc: xen-users@lists.xen.org Subject: >> Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? > >> On Sun, 2012-09-16 at 18:28 +0100, Marc Tousignant wrote: > >>> I then created several .img files in the xen_images folder using dd. >>> For example (dd if=/dev/zero of=/images/xen_images/Win7x86_Base.img >>> bs=1 count=1 seek=50G) >> [...] >>> I got to the point where it formatted the "drive" and started >>> installing, it failed on the extraction step saying my "DVD" >>> was bad. > >> What does your guest config file look like, in particular the disk >> line. > >> Is there any chance that you have accidentally pointed the VM''s disks >> at one or more of the physical disks which makes up your RAID array? > >> Ian. > > > >> _______________________________________________ Xen-users mailing >> list Xen-users@lists.xen.org http://lists.xen.org/xen-users > > > > _______________________________________________ Xen-users mailing list > Xen-users@lists.xen.org http://lists.xen.org/xen-users > > > _______________________________________________ Xen-users mailing list > Xen-users@lists.xen.org http://lists.xen.org/xen-users >- -- Tony Lill, OCT, Tony.Lill@AJLC.Waterloo.ON.CA President, A. J. Lill Consultants (519) 650 0660 539 Grand Valley Dr., Cambridge, Ont. N3H 2S2 (519) 241 2461 - --------------- http://www.ajlc.waterloo.on.ca/ ---------------- -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/ iEYEARECAAYFAlBWhuoACgkQGS8yZq1uvxATEACbB6d3xJ/hgvf5fXClnvHNC2SA G88AniIiriGdvl10JF49zyfBh01WEuvQ =oRVn -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
On Mon, Sep 17, 2012 at 4:55 AM, Marc Tousignant <myrdhn@gmail.com> wrote:> Maybe that is my issue. I''ll ask one of my coworkers if he can misplace a > 2TB drive and I can eliminate the RAID. I had a few 500GB drives laying > around and decided to repurpose them. > > MarcT > >Have you tried doing this with RAID 6 or RAID 10 instead? -- Kind Regards Rudi Ahlers SoftDux Website: http://www.SoftDux.com Technical Blog: http://Blog.SoftDux.com Cell: 082 554 7532 Fax: 086 268 8492
RAID1+0 is also a no go due to loss of space, and uselessness. If you want speed and redundancy and have the drives for RAID1+0, just go with RAID6 I''d lose too much space with RAID6, I have plans for all ~1.8TB, the loss of ~500GB would be too much of a hit. I do have a second machine running XEN with software RAID1 and hardware RAID5 without issues. The drives in this config are both physical and file based. No issues and I have been running for over 2 years moving from 3 all the way to 4 without incident. -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Rudi Ahlers Sent: Monday, September 17, 2012 2:57 AM To: Marc Tousignant Cc: xen-users@lists.xen.org; Tony Lill Subject: Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? On Mon, Sep 17, 2012 at 4:55 AM, Marc Tousignant <myrdhn@gmail.com> wrote:> Maybe that is my issue. I''ll ask one of my coworkers if he can > misplace a 2TB drive and I can eliminate the RAID. I had a few 500GB > drives laying around and decided to repurpose them. > > MarcT > >Have you tried doing this with RAID 6 or RAID 10 instead? -- Kind Regards Rudi Ahlers SoftDux Website: http://www.SoftDux.com Technical Blog: http://Blog.SoftDux.com Cell: 082 554 7532 Fax: 086 268 8492 _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users
On Mon, Sep 17, 2012 at 9:46 AM, Marc Tousignant <myrdhn@gmail.com> wrote:> RAID1+0 is also a no go due to loss of space, and uselessness. If you want > speed and redundancy and have the drives for RAID1+0, just go with RAID6 > I''d lose too much space with RAID6, I have plans for all ~1.8TB, the loss of > ~500GB would be too much of a hit. >RAID5 with no spare drive (i.e. another 500GB loss) has 0 redundancy, and rebuild on RAID5 is often too high for production. If this is what caused your problems, then RAID6 / RAID10 would be better since it could sustain the high IO demands. a single 2TB drive gives no redundancy either, but could yield slightly better IO since it won''t need to "rebuild'' the parity while installing Windows.> I do have a second machine running XEN with software RAID1 and hardware > RAID5 without issues. The drives in this config are both physical and file > based. No issues and I have been running for over 2 years moving from 3 all > the way to 4 without incident. > > -----Original Message----- > From: xen-users-bounces@lists.xen.org > [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Rudi Ahlers > Sent: Monday, September 17, 2012 2:57 AM > To: Marc Tousignant > Cc: xen-users@lists.xen.org; Tony Lill > Subject: Re: [Xen-users] Setting up XEN domU causes RAID5 to fail? > > On Mon, Sep 17, 2012 at 4:55 AM, Marc Tousignant <myrdhn@gmail.com> wrote: >> Maybe that is my issue. I''ll ask one of my coworkers if he can >> misplace a 2TB drive and I can eliminate the RAID. I had a few 500GB >> drives laying around and decided to repurpose them. >> >> MarcT >> >> > > > > > Have you tried doing this with RAID 6 or RAID 10 instead? > > > > -- > Kind Regards > Rudi Ahlers > SoftDux > > Website: http://www.SoftDux.com > Technical Blog: http://Blog.SoftDux.com > Cell: 082 554 7532 > Fax: 086 268 8492 > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users >-- Kind Regards Rudi Ahlers SoftDux Website: http://www.SoftDux.com Technical Blog: http://Blog.SoftDux.com Cell: 082 554 7532 Fax: 086 268 8492
On Mon, September 17, 2012 4:11 am, Tony Lill wrote:> -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > When I tried to upgrade my xen systems to a pvops xen/linux combo, I > found that high disk I/O would cause disk errors and caused disks to > be thrown out of the raid and all sorts of other badness. High of > course, is a relative term. For one of my boxes, copying a large file > was enough, on another, it needed something like running backups on > several VMs simultaneously or trying to start my VM''s while rebuilding > the raid. > > FWIW, I went back to Xen 3.4.4 and the SLES1 xenlinux kernel and > they''ve been rock solid.This could be related to Xen version, but can also be related to the use of desktop-drives in a RAID-configuration. Linux Software raid is more tolerant than hardware raid, but it still doesn''t like it if a disk dissappears/fails/acts up and will then kick it out. I''m surprised there are no messages in the logs as I have always seen at least a message from the raid-stack when a disk was thrown out. Are those drives SMART-compliant? If yes, try running a self-test on those drives to see if there are any detectable problems. Other possible cause: The PSU can''t handle the load of all the drives and the CPU going full speed. You could also try to do some heavy load on those drives by simultaneously copying "/dev/zero" to each of the drives. -- Joost
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 09/17/2012 02:22 AM, J. Roeleveld wrote:> > On Mon, September 17, 2012 4:11 am, Tony Lill wrote: >> -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 >> >> When I tried to upgrade my xen systems to a pvops xen/linux >> combo, I found that high disk I/O would cause disk errors and >> caused disks to be thrown out of the raid and all sorts of other >> badness. High of course, is a relative term. For one of my >> boxes, copying a large file was enough, on another, it needed >> something like running backups on several VMs simultaneously or >> trying to start my VM''s while rebuilding the raid. >> >> FWIW, I went back to Xen 3.4.4 and the SLES1 xenlinux kernel and >> they''ve been rock solid. > > This could be related to Xen version, but can also be related to > the use of desktop-drives in a RAID-configuration. Linux Software > raid is more tolerant than hardware raid, but it still doesn''t > like it if a disk dissappears/fails/acts up and will then kick it > out. > > I''m surprised there are no messages in the logs as I have always > seen at least a message from the raid-stack when a disk was thrown > out.On the one box I got tons of messages, the other I got a error message once, and the second time it just hung, after which I stopped trying.> Are those drives SMART-compliant? If yes, try running a self-test > on those drives to see if there are any detectable problems. > > Other possible cause: The PSU can''t handle the load of all the > drives and the CPU going full speed. > > You could also try to do some heavy load on those drives by > simultaneously copying "/dev/zero" to each of the drives.The drives are smart compliant and healthy and have worked fine for months/years, same as the PSU. The only difference is the XEN technology. pvops, both self compiled and from the squeeze distro, were totally unstable. On one box I could trash it just by copying a large file. The xenlinux system is rock solid. - -- Tony Lill, OCT, Tony.Lill@AJLC.Waterloo.ON.CA President, A. J. Lill Consultants (519) 650 0660 539 Grand Valley Dr., Cambridge, Ont. N3H 2S2 (519) 241 2461 - --------------- http://www.ajlc.waterloo.on.ca/ ---------------- -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://www.enigmail.net/ iEYEARECAAYFAlBd4LYACgkQGS8yZq1uvxDvFACeNmeHQZ0HocXmYOBQ+IyMCdyv 3REAn2Mp6co7f1GOYl+1KETkVbYL93D5 =/uBk -----END PGP SIGNATURE-----