search for: cephfs

Michal Pr??vozn??k > On 6/12/23 20:17, Jerry Buburuz wrote: >> Just found my issue. >> After I removed the cephfs mounts it worked! >> I will debug ceph. >> I assumed because I could touch files on mounted cephfs it was working. Now virsh list works! > Out of curiosity. Do you perhaps have a storage pool defined over cephfs? I can see two possible sources for the problem: > 1) autostarted sto...

Hi list, we have migrated a single node Samba server from Ubuntu Trusty to a 3-node CTDB Cluster on Debian Bullseye with Sernet packages. Storage is CephFS. We are running Samba in Standalone Mode with LDAP Backend. Samba Version: sernet-samba 99:4.18.2-2debian11 I don't know if it is relevant here's how we have mounted CephFS on the samba nodes: (fstab):/samba /srv/samba ceph name=samba,_netdev 0 0 Client caps: client.samba key:...

...onding file, would that mean that it generate the same ammount of IO as it would do with one file per message? Also, if using mdbox many messages will be appended to a said file before a new file is created. That should mean that a file descriptor is kept open for sometime by dovecot process. Using cephfs as backend, how would this impact cluster performance regarding MDS caps and inodes cached when files from thousands of users are opened and appended all over? I would like to understand this better. Why? We are a small Business Email Hosting provider with bare metal, self hosted systems, using d...

Just found my issue. After I removed the cephfs mounts it worked! I will debug ceph. I assumed because I could touch files on mounted cephfs it was working. Now virsh list works! thanks jerry Lars Kellogg-Stedman > On Tue, Jun 06, 2023 at 04:56:38PM -0400, Jerry Buburuz wrote: >> Recently both virsh stopped talking to the libvirtd....

...r discussions when we, as an email provider, discussed to move away from traditional NAS/NFS storage to Ceph. The problem with POSIX file systems and dovecot is that e.g. with mdbox only around ~20% of the IO operations are READ/WRITE, the rest are metadata IOs. You will not change this with using CephFS since it will basically behave the same way as e.g. NFS. We decided to develop librmb to store emails as objects directly in RADOS instead of CephFS. The project is still under development, so you should not use it in production, but you can try it to run a POC. For more information check out my...

...gards, Webert Lima DevOps Engineer at MAV Tecnologia *Belo Horizonte - Brasil* *IRC NICK - WebertRLZ* On Wed, May 16, 2018 at 4:45 PM Jack <ceph at jack.fr.eu.org> wrote: > On 05/16/2018 09:35 PM, Webert de Souza Lima wrote: > > We'll soon do benchmarks of sdbox vs mdbox over cephfs with bluestore > > backend. > > We'll have to do some some work on how to simulate user traffic, for > writes > > and readings. That seems troublesome. > I would appreciate seeing these results ! > > > Thanks for the plugins recommendations. I'll take the ch...

Hello Jack, yes, I imagine I'll have to do some work on tuning the block size on cephfs. Thanks for the advise. I knew that using mdbox, messages are not removed but I though that was true in sdbox too. Thanks again. We'll soon do benchmarks of sdbox vs mdbox over cephfs with bluestore backend. We'll have to do some some work on how to simulate user traffic, for writes and re...

Hi, I'm testing out ceph_vms vs a cephfs mount with a cifs export. I currently have 3 active ceph mds servers to maximise throughput and when I have configured a cephfs mount with a cifs export, I'm getting a reasonable benchmark results. However, when I tried some benchmarking with the ceph_vms module, I only got a 3rd of the com...

...X/inbox BEFORE 2013-01-01. doveadm(testuser): Warning: Transaction log file /var/dovecot/testuser/index/.INBOX.inbox/dovecot.index.log was locked for 215 seconds (rotating while syncing) I have read about how this can be related to default locking fcntl and nfs, anyone having this solved with cephfs? https://www.dovecot.org/list/dovecot/2009-January/036194.html

Hi Folks, is the vfs_ceph supporting quota set on a directory inside cephfs? Regards Felix -- Forschungszentrum Jülich GmbH 52425 Jülich Sitz der Gesellschaft: Jülich Eingetragen im Handelsregister des Amtsgerichts Düren Nr. HR B 3498 Vorsitzender des Aufsichtsrats: MinDir. Dr. Karl Eugen Huthmacher Geschäftsführung: Prof. Dr.-Ing. Wolfgang Marquardt (Vorsitzender), Ka...

...r for each user. At this time i have about 8000 home directories. The directorys are subfolders from [home]. Is it possible to enable a trash folder inside the home directory for each user? I enabled successful a trash folder with vsf_recycle by a specific share. [test] ??????? path = /media/cephfs/samba/c_test/00_test ??????? read only = No ??????? vfs objects = recycle ??????? recycle:versions = yes ??????? recycle:keeptree = yes ??????? recycle:repository = .recycle But how can i do this when a folder is a subfolder from a share? for example: home->User1-> .recycle home->U...

...enz wrote: > > Hello List, > > > > as anyone tried to install samba with/ontop on a ceph cluster? > > Try compiling and setting up with vfs_ceph. Correct, that's basically it. > Needs some more work, but should work. Some posix features are not quite there yet in CephFS: E.g. fcntl locks (only possibly in most recent cephfs code), so better start off with 'posix locking = no'. And for ctdb this means that recovery lock may or may not work, depending on the ceph version. There are more things (not 100% sure about acls at this time). People are actively wor...

On Fri, Oct 12, 2018 at 11:19:50AM +0200, David Disseldorp via samba wrote: > Hi Felix, > > On Mon, 8 Oct 2018 16:30:17 +0200, Felix Stolte via samba wrote: > > > is the vfs_ceph supporting quota set on a directory inside cephfs? > > Not at this stage. CephFS uses a non-standard (xattr) interface for > quotas, which is not currently supported by Samba. Getting/setting Quotas is a VFS call, so this is 'simple matter of programming' (SMOP:-). Patches welcome David :-).

...t; > ctdb works from root, so just root ownership. Ok, thanks. It's also what I figured by looking at the fedora spec file.. >> I've merged your patch and added the missing directories to the ctdb >> package. However, I'm not sure I'll be building binary rpms with cephfs >> enabled as this makes ctdb dependent on ceph (see below). I'm probably >> going to include it as a non-default option and people will have to >> rebuild the rpms with '--with vfs_cephfs' > This good, thanks. The updated packages (version with '3.1')...

Hi All I have a newly implemented two node CTDB cluster running on CentOS 7, Samba 4.7.1 The node network is a direct 1Gb link Storage is Cephfs ctdb status is OK It seems to be running well so far but I'm frequently seeing the following in my log.smbd: [2018/09/18 19:16:15.897742, 0] > ../source3/lib/dbwrap/dbwrap_ctdb.c:1207(fetch_locked_internal) > db_ctdb_fetch_locked for /var/lib/ctdb/locking.tdb.1 key > DE0726567AF1...

Hi Konstantin, Thank you for the diff. I will review it and merge it today. About the missing directories, I think it may be doable to add them to the 'ctdb' rpm. As I'm not using ctdb, what should the ownership/permissions be for those directories? Regards, Vincent On Thu, 11 Jul 2019, Konstantin Shalygin wrote: > On 7/10/19 9:49 PM, vincent at cojot.name wrote: > >

...to disabling those options for a branch office node on a high-latency WAN connection? Throughput maxes out at 20 Mbit/sec, with latency in the 20 - 30 ms range. I am mostly concerned about SMB read/list performance which drops significantly for folders with an object count >1000. Share mount is Cephfs over Ceph Kraken/Jewel. Any pointers greatly appreciated! Mike

...On Tue, 18 Sep 2018 19:34:25 +0100, David C via samba > <samba at lists.samba.org> wrote: > > > I have a newly implemented two node CTDB cluster running on CentOS 7, > Samba > > 4.7.1 > > > > The node network is a direct 1Gb link > > > > Storage is Cephfs > > > > ctdb status is OK > > > > It seems to be running well so far but I'm frequently seeing the > following > > in my log.smbd: > > > > [2018/09/18 19:16:15.897742, 0] > > > ../source3/lib/dbwrap/dbwrap_ctdb.c:1207(fetch_locked_internal)...

Hello List, as anyone tried to install samba with/ontop on a ceph cluster? Regards, Dirk

Hi Tom, On Wed, 23 May 2018 09:15:15 +0200, Thomas Bennett via samba wrote: > Hi, > > I'm testing out ceph_vms vs a cephfs mount with a cifs export. I take it you mean the Ceph VFS module (vfs_ceph)? > I currently have 3 active ceph mds servers to maximise throughput and > when I have configured a cephfs mount with a cifs export, I'm getting > a reasonable benchmark results. Keep in mind that increasi...