Roman
2015-Jul-14 13:30 UTC
[Gluster-users] back to problems: gluster 3.5.4, qemu and debian 8
Hey, thanks for reply. If it would be networking related, it would affect everything. But it is only debian 8 which won't install. And yes, i did iperf test between gluster and proxmox nodes. Its ok. Installation fails on every node, where i try to install d8. Sometimes it goes well (today 1 of 6 tries was fine). Other distros install fine. Sometimes installation process finishes, but VM won't start, just hangs with errors like in this attached. 2015-07-14 16:17 GMT+03:00 Scott Harvanek <scott.harvanek at login.com>:> We don't have this issue, I'll take a stab tho- > > Have you confirmed everything is good on the network side of things? > MTU/Loss/Errors? > > Is your inconsistency linked to one specific brick? Have you tried running > a replica instead of distributed? > -- > Scott H. > Login, LLC. > > > > Roman <romeo.r at gmail.com> > July 14, 2015 at 6:38 AM > here is one of the errors example. its like files that debian installer > copies to the virtual disk that is located on glusterfs storage are getting > corrupted. > in-target is /dev/vda1 > > > > > > -- > Best regards, > Roman. > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users > Roman <romeo.r at gmail.com> > July 14, 2015 at 4:50 AM > Ubuntu 14.04 LTS base install and then mate install were fine! > > > > > -- > Best regards, > Roman. > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users > Roman <romeo.r at gmail.com> > July 13, 2015 at 7:35 PM > Bah... the randomness of this issue is killing me. > Not only HA volumes are affected. Got an error during installation of d8 > with mate (on python-gtk2 pkg) on Distributed volume also. > I've checked the MD5SUM of installation iso, its ok. > > Shortly after that on the same VE node I installed D7 with Gnome without > any problem on the HA glusterf volume. > > And on the same VE node I've installed D8 with both Mate and Gnome using > local storage disks without problems. There is a bug somewhere in gluster > or qemu... Proxmox uses RH kernel btw: > > Linux services 2.6.32-37-pve > QEMU emulator version 2.2.1 > glusterfs 3.6.4 > > any ideas? > I'm ready to help to investigate this bug. > When sun will shine, I'll try to install latest Ubuntu also. But now I'm > going to sleep. > > > > > -- > Best regards, > Roman. > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users > Roman <romeo.r at gmail.com> > July 13, 2015 at 5:54 PM > So, just to conclude this: > > upgraded to 3.6.4 > problem still exists and is only with D8 and gluster HA volumes. Someone > from devs really should test it. > > > > > -- > Best regards, > Roman. > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users > Roman <romeo.r at gmail.com> > July 13, 2015 at 12:59 PM > Hi, > > I've reported a lot about this, but every time there was something that > made me think, that it was not a glusterfs problem, but it seems it is. > > Please, some1 from dev-s, setup a very simple installation: > > lates proxmox > glusterfs server and client 3.5.4 > and try to install debian jessie (8) on such platform. > > You will be out of luck every single try with random errors. Even if you > will get a lucky bird and install the OS itself, you will fail on any > installation that requires a lot of small files to download and unpack: > like gnome3 installation ie. the files a being corrupted. > > Need help with this ASAP. > > -- > Best regards, > Roman. > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users > > >-- Best regards, Roman. -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150714/cdb7e63c/attachment.html> -------------- next part -------------- A non-text attachment was scrubbed... Name: debian2.png Type: image/png Size: 56225 bytes Desc: not available URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150714/cdb7e63c/attachment.png>
Vijay Bellur
2015-Jul-14 13:35 UTC
[Gluster-users] back to problems: gluster 3.5.4, qemu and debian 8
On Tuesday 14 July 2015 07:00 PM, Roman wrote:> Hey, > > thanks for reply. > If it would be networking related, it would affect everything. But it is > only debian 8 which won't install. > And yes, i did iperf test between gluster and proxmox nodes. Its ok. > Installation fails on every node, where i try to install d8. Sometimes > it goes well (today 1 of 6 tries was fine). Other distros install fine. > Sometimes installation process finishes, but VM won't start, just hangs > with errors like in this attached. >Answers to the following questions might help: 1. Do you see any errors in qemu logs? 2. What is the output of gluster volume info? 3. Any errors/warnings observed in /var/log/glusterfs? Prasanna - can you please help here? thanks, vijay
Scott Harvanek
2015-Jul-14 13:37 UTC
[Gluster-users] back to problems: gluster 3.5.4, qemu and debian 8
What happens if you install from a full CD and not a net-install? Limit the variables. Currently you are relying on remote mirrors and Internet connectivity. It's either a Proxmox or Debian issue, I really don't think it's Gluster. We have hundreds of Jessie installs running on GlusterFS backends. -- Scott H. Login, LLC.> Roman <mailto:romeo.r at gmail.com> > July 14, 2015 at 9:30 AM > Hey, > > thanks for reply. > If it would be networking related, it would affect everything. But it > is only debian 8 which won't install. > And yes, i did iperf test between gluster and proxmox nodes. Its ok. > Installation fails on every node, where i try to install d8. Sometimes > it goes well (today 1 of 6 tries was fine). Other distros install fine. > Sometimes installation process finishes, but VM won't start, just > hangs with errors like in this attached. > > > > > -- > Best regards, > Roman. > Scott Harvanek <mailto:scott.harvanek at login.com> > July 14, 2015 at 9:17 AM > We don't have this issue, I'll take a stab tho- > > Have you confirmed everything is good on the network side of things? > MTU/Loss/Errors? > > Is your inconsistency linked to one specific brick? Have you tried > running a replica instead of distributed? > > > > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users > Roman <mailto:romeo.r at gmail.com> > July 14, 2015 at 6:38 AM > here is one of the errors example. its like files that debian > installer copies to the virtual disk that is located on glusterfs > storage are getting corrupted. > in-target is /dev/vda1 > > > > > > -- > Best regards, > Roman. > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users > Roman <mailto:romeo.r at gmail.com> > July 14, 2015 at 4:50 AM > Ubuntu 14.04 LTS base install and then mate install were fine! > > > > > -- > Best regards, > Roman. > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users > Roman <mailto:romeo.r at gmail.com> > July 13, 2015 at 7:35 PM > Bah... the randomness of this issue is killing me. > Not only HA volumes are affected. Got an error during installation of > d8 with mate (on python-gtk2 pkg) on Distributed volume also. > I've checked the MD5SUM of installation iso, its ok. > > Shortly after that on the same VE node I installed D7 with Gnome > without any problem on the HA glusterf volume. > > And on the same VE node I've installed D8 with both Mate and Gnome > using local storage disks without problems. There is a bug somewhere > in gluster or qemu... Proxmox uses RH kernel btw: > > Linux services 2.6.32-37-pve > QEMU emulator version 2.2.1 > glusterfs 3.6.4 > > any ideas? > I'm ready to help to investigate this bug. > When sun will shine, I'll try to install latest Ubuntu also. But now > I'm going to sleep. > > > > > -- > Best regards, > Roman. > _______________________________________________ > Gluster-users mailing list > Gluster-users at gluster.org > http://www.gluster.org/mailman/listinfo/gluster-users-------------- next part -------------- An HTML attachment was scrubbed... URL: <http://www.gluster.org/pipermail/gluster-users/attachments/20150714/cdfb9654/attachment.html>