Hello List, I hope some other folks out there running FreeBSD on KVM as well. I set up a base VM while doing so I noticed that the disk operations are very slow. Many times I edit a file in vim or try to run a command there is a huge lag. I use UFS as the root filesystem. To have something to compare it with I have tested it against an OpenBSD 6.6 VM on the same host, same hardware. both have 1 vCPU and 1GB of ram, 20GB virtual disk (they are exactly on the same physical disk no raid or anything to have a fair comparison). Here is an example simple file search time for a non-existent file: FreeBSD 13 time find / -name cacert.pem real 0m30.656s user 0m0.516s sys 0m3.938s Second run even worse real 2m38.618s user 0m0.711s sys 0m6.882s While on the OpenBSD VM I get time find / -name cacert.pem real 0m2.258s user 0m0.290s sys 0m1.970s The amount of data is about the same on both systems but I would not consider this a "slight" performance degradation. If the base system is so slow then imagine putting Apache and other servers on top of it. Did anyone run into this? Unless there is a definitive solution I will opt out to using other BSD variants.
> Am 24.04.2021 um 11:25 schrieb dashdruid via freebsd-stable <freebsd-stable at freebsd.org>: > > Hello List, > > I hope some other folks out there running FreeBSD on KVM as well. I set up a base VM while doing so I noticed that the disk operations are very slow. Many times I edit a file in vim or try to run a command there is a huge lag.It?s a huge and common problem that has been going on for years. I also had the same problem with XenServer. You can search bugzilla for ?KVM? bugs, as well as the forums. Apparently, it was mostly fixed for VMWare, but fixing for KVM is apparently very difficult. Even more so as there are many different versions of KVM around that all behave differently, depending on how you configure the virtual hardware (of which there are endless variations and permutations on how you attach with virtual devices to which virtual PCI-bus etc.pp.). It?s also likely fixed on AWS (but I do not use that, so I hardly care). E.g. when I created a KVM VM on my local workstation at work, it performed identically (more or less) to e.g. a CentOS VM. However, if I create a VM on our on-premise Openstack cloud, it achieves maybe 10% or 20% of the disk-IO-speed of a CentOS VM with the same volume type. There?s some work going on in some differentials, but I haven?t had the time to try. The problem is IMHO that most of the paid developers (for FreeBSD) these days either use it on bare metal (hello Netflix, EMC, Netapp, Netgate et.al.) or use it inside VMWare, where the main pain-points seem to have been fixed. Or they even use FreeBSD?s own hypervisor (bhyve). It?s a tragedy IMO and it totally rules out FreeBSD here around for almost all future use-cases (that are almost certainly moving to Openstack in the future).
I'm running 12.2 and 13.0 on KVM using virtio and zfs. I am not having disk I/O issues. Jeff Love On 4/24/21 5:25 AM, dashdruid via freebsd-stable wrote:> Hello List, > > I hope some other folks out there running FreeBSD on KVM as well. I set up a base VM while doing so I noticed that the disk operations are very slow. Many times I edit a file in vim or try to run a command there is a huge lag. > > I use UFS as the root filesystem. To have something to compare it with I have tested it against an OpenBSD 6.6 VM on the same host, same hardware. both have 1 vCPU and 1GB of ram, 20GB virtual disk (they are exactly on the same physical disk no raid or anything to have a fair comparison). > > Here is an example simple file search time for a non-existent file: > > FreeBSD 13 > > time find / -name cacert.pem > > real 0m30.656s > user 0m0.516s > sys 0m3.938s > > Second run even worse > > real 2m38.618s > user 0m0.711s > sys 0m6.882s > > While on the OpenBSD VM I get > > time find / -name cacert.pem > > real 0m2.258s > user 0m0.290s > sys 0m1.970s > > The amount of data is about the same on both systems but I would not consider this a "slight" performance degradation. If the base system is so slow then imagine putting Apache and other servers on top of it. Did anyone run into this? > > Unless there is a definitive solution I will opt out to using other BSD variants. > _______________________________________________ > freebsd-stable at freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe at freebsd.org" >-- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.