Displaying 20 results from an estimated 1000 matches similar to: "Huge directory tree: Get files to sync via tools like sysdig"
2017 Feb 09
3
Huge directory tree: Get files to sync via tools like sysdig
Am 09.02.2017 um 11:05 schrieb Ben RUBSON:
>> On 09 Feb 2017, at 10:05, Thomas Güttler <guettliml at thomas-guettler.de> wrote:
>>
>> Hi,
>>
>> we have a huge directory tree.
>>
>>
>> * 17M files (number of files)
>> * 2.2TBytes of data.
>> * Only 0.1% changes per day
>>
>> Current pain: rsyncs directory tree traversal
2017 Feb 10
1
Alternatives to rsync. Was: Huge directory tree: Get files to sync via tools like sysdig
Am 09.02.2017 um 16:21 schrieb Ben RUBSON:
>
>> On 09 Feb 2017, at 16:10, Thomas Güttler <guettliml at thomas-guettler.de> wrote:
>>
>> Am 09.02.2017 um 11:05 schrieb Ben RUBSON:
>>>> On 09 Feb 2017, at 10:05, Thomas Güttler <guettliml at thomas-guettler.de> wrote:
>>>>
>>>> Hi,
>>>>
>>>> we have a huge
2017 Feb 09
0
Huge directory tree: Get files to sync via tools like sysdig
> Has someone experience with collecting the changed files
> with a third party tool which detects which files were changed?
I don't know of sysdig but am the developer of Lsyncd which does exactly
that, collect file changes via inotify event mechanism and then calls rsync
with a matching filter mask.
However, since you say, your directory tree is hugh, the main issue is that
for every
2017 Feb 09
2
Huge directory tree: Get files to sync via tools like sysdig
On Thu, 9 Feb 2017 10:55:51 +0100
Axel Kittenberger <axkibe at gmail.com> wrote:
> > Has someone experience with collecting the changed files
> > with a third party tool which detects which files were changed?
>
> I don't know of sysdig but am the developer of Lsyncd which does
> exactly that, collect file changes via inotify event mechanism and
> then calls
2017 Mar 14
4
Relaiable ssh tunnel via systemd
Am 14.03.2017 um 15:10 schrieb Nico Kadel-Garcia:
> Look into the "autossh" program, which is very good to manage and
> maintain such tunnels.
>
Hi Nico and other ssh users,
Systemd restarts the ssh if it terminates. AFAIK this is all that is needed.
But maybe I am missing something. Is there a feature of autossh that I don't
get with systemd?
--
2017 Feb 24
2
[SUSPECTED SPAM] Canonical Link to Reference of "ServerAliveInterval"
What is the canonical link to Reference of "ServerAliveInterval"?
Background: I want to write an answer at serverfault (Q-A Site).
I want to avoid copy+pasting. I would like to lead the new comer
to the canonical reference.
Regards,
Thomas G?ttler
--
Thomas Guettler http://www.thomas-guettler.de/
2017 Mar 15
2
Relaiable ssh tunnel via systemd
Am 14.03.2017 um 21:43 schrieb Nico Kadel-Garcia:
> On Tue, Mar 14, 2017 at 4:20 PM, Thomas G?ttler
> <guettliml at thomas-guettler.de> wrote:
>>
>>
>>
>> Am 14.03.2017 um 15:10 schrieb Nico Kadel-Garcia:
>>> Look into the "autossh" program, which is very good to manage and
>>> maintain such tunnels.
>>>
>>
>> Hi
2017 Feb 09
1
Huge directory tree: Get files to sync via tools like sysdig
On Thu, 9 Feb 2017 14:43:57 +0100
Axel Kittenberger <axkibe at gmail.com> wrote:
> >
> > Not only that, but inotify is not guaranteed. (At least not on
> > 3.16.0. Can't say regards later versions.) So you might miss some
> > changes.
> >
>
> Got any info on that?
>
> I noted that MOVE_FROM and MOVE_TO events are not guaranted to arrive
2017 Mar 14
3
Relaiable ssh tunnel via systemd
We try to run a reliable ssh tunnel vis systemd.
This is the unit configuration file:
{{{
[Unit]
Description=Tunnel For %i
After=network.target
[Service]
User=autossh
ExecStart=/usr/bin/ssh -o "ExitOnForwardFailure yes" -o "ServerAliveInterval 60" -N -R 40443:installserver:40443 -R
8080:installserver:8080
ExecStartPre=-/usr/bin/ssh tunnel@%i "for pid in $$(ps -u
2018 Jan 23
8
Sending Signal to remote process
I want ssh to forward the SIGTERM signal to the remote command.
Example:
ssh root at localhost /root/print-signal.py
Get PID of ssh:
ps aux| grep print-signal
Kill the matching ssh process:
kill pid-of-ssh
Unfortunately only the ssh process itself gets the signal, not the remote command (print-signal.py). The remote command
does not terminate :-(
How can I make ssh
2015 Mar 18
10
[Bug 2368] New: ssh -v does not display the username which gets used to connect
https://bugzilla.mindrot.org/show_bug.cgi?id=2368
Bug ID: 2368
Summary: ssh -v does not display the username which gets used
to connect
Product: Portable OpenSSH
Version: 6.9p1
Hardware: Other
OS: All
Status: NEW
Severity: enhancement
Priority: P5
Component: ssh
2017 Sep 01
3
sftp/scp only without real users
Hi,
my goal: sftp/scp only access, without the need for linux users.
I want to provide 10 sftp/scp directories to 10 people. Let's call this
"virtual account"
I don't want to create linux users for each of them.
I would like to create one linux user (backup_user). In his
home-directory will be 10 directories. For each "virtual account" one
directory.
Every
2019 Nov 13
5
http API for IMAP
2017 Feb 10
0
Huge directory tree: Get files to sync via tools like sysdig
On Fri, 10 Feb 2017 12:38:32 +1300
Henri Shustak <henri.shustak at gmail.com> wrote:
> As Ben mentioned, ZFS snapshots is one possible approach. Another
> approach is to have a faster storage system. I have seen considerable
> speed improvements with rsync on similar data sets by say upgrading
> the storage sub system.
Another possibility could be to use lvm and lvmcache to
2017 Feb 09
4
Huge directory tree: Get files to sync via tools like sysdig
As Ben mentioned, ZFS snapshots is one possible approach. Another approach is to have a faster storage system. I have seen considerable speed improvements with rsync on similar data sets by say upgrading the storage sub system.
--------------------------------------------------------------------
This email is protected by LBackup, an open source backup solution
http://www.lbackup.org
2019 Nov 14
4
JMAP: Re: http API for IMAP
Am 14.11.19 um 14:03 schrieb Benny Pedersen via dovecot:
> Thomas G?ttler via dovecot skrev den 2019-11-14 08:55:
>
>> Is there already an open source imap2jmap server?
>
> why do you say imap here ?
>
> https://www.cyrusimap.org/imap/developer/jmap.html
>
> cyrus already have it, we just wait for dovecot :)
I used my favorite search engine (ecosia) and found
2019 Nov 18
2
Perl was: JMAP: Re: http API for IMAP
Am 16.11.19 um 08:15 schrieb Bron Gondwana via dovecot:
> proxy.jmap.io is very stale code at the moment.? I'm hoping to have enough time to hack on it at the IETF hackathon this
> weekend :)
I am a big biased. AFAIK it is written in Perl. I am very happy that I did not need to use Perl since 18 years now.
The regex where great. But time has changed.
Everytime you use regex today, I
2019 Nov 14
6
http API for IMAP
Am 13.11.19 um 17:21 schrieb Ralph Seichter via dovecot:
> * Thomas G?ttler via dovecot:
>
>> Is there a way to access mails in dovecot via https?
>
> Why on earth would that be beneficial?
>
> "The Internet Message Access Protocol, Version 4rev1 (IMAP4rev1)
> allows a client to access and manipulate electronic mail messages
> on a server."
2019 Nov 14
2
JMAP: Re: http API for IMAP
Am 13.11.19 um 15:07 schrieb Benny Pedersen via dovecot:
> Thomas G?ttler via dovecot skrev den 2019-11-13 14:40:
>> I would love to write a progressive web app for accessing dovecot (via
>> IMAP)
>
> like all other webmail is using imap
>
>> But JavaScript in the browser can only use http/https.
>
> so what ? :=)
>
> hopefully you wont run webmail
2019 Jan 04
3
[SUSPECTED SPAM] VPN over SSH: State of the art?
I know that this has been discussed before and I know that you should avoid
it, and use a real VPN solution.
I would like to move from port-forwarding via ssh to VPN and I have only
the ssh port open.
What is the current state of the art if you want to create VPN over ssh?
Regards,
Thomas
--
Thomas Guettler http://www.thomas-guettler.de/
I am looking for feedback: