similar to: "non-efficient" sparse file copying with rsync

Displaying 20 results from an estimated 20000 matches similar to: ""non-efficient" sparse file copying with rsync"

2013 Dec 11
1
Making --inplace and --sparse compatible
It seems to me that it should be possible to make --inplace and --sparse compatible. The manpage says -S, --sparse ... Conflicts with --inplace because it's not possible to overwrite data in a sparse fashion. but I think it _is_ possible to do that, provided the receiving side opens the dest file read-write instead of write-only. When writing within the existing
2010 May 22
2
Regression with sparse matricies
I would like to run a logistic regression on some factor variables (main effects and eventually an interaction) that are very sparse. I have a moderately large dataset, ~100k observations with 1500 factor levels for one variable (x1) and 600 for another (X2), creating ~19000 levels for the interaction (X1:X2). I would like to take advantage of the sparseness in these factors to avoid using GLM.
2020 Jan 22
3
[PATCH libnbd] PROPOSAL Add nbdcp (NBD copying) tool.
This is a proposal for an NBD to/from file copying tool (not actually written). Obviously this would duplicate functionality which is already available in qemu-img convert. The reasons for writing this tool would be: - to produce a tool which is very focused on the specific needs of virt-v2v and similar migration scenarios - to have a small tool with minimal dependencies - fix some of
2010 Dec 08
3
DO NOT REPLY [Bug 7854] New: Abysmal sparse file performance
https://bugzilla.samba.org/show_bug.cgi?id=7854 Summary: Abysmal sparse file performance Product: rsync Version: 3.0.7 Platform: x86 OS/Version: FreeBSD Status: NEW Severity: major Priority: P3 Component: core AssignedTo: wayned at samba.org ReportedBy: grarpamp at gmail.com
2010 Sep 21
1
Abysmal sparse file performance!
I have a 5.5GB file, mostly sparse. Tar performs far[!] better than rsync. I have no ideas yet, so just an FYI as to current state. FreeBSD 8.1 i386 zfs Yes, I know the blocks used differs but don't know why yet, could be just how zfs does things or related to the large amount of sparseness. There are no media errors, CPU/IO load or anything like that and the source and dest paths are on the
2016 Feb 02
3
Question: resize: non-sparse copying of extended partition
Hello everyone! I faced an issue using virt-resize. I have an image with extended -> logical -> pv -> lv -> ext4 (although I think LVM does not matter). And image is 65G virtual size and 1G actualSize. When I call virt-resize to 60G, it blindly copies the extended partition content, but does it non-sparse (resize.ml:1231), irrespective to --no-sparse option. So the destination image
2010 Aug 19
1
Converting sparse matrix to data.frame in Matrix package
I am able to create a coordinate list sparse matrix this way: r = c(1,2,2,3,3) c = c(4,1,2,3,5) v = c(1,2,1,3,1) a = sparseMatrix(i=r,j=c,x=v) However, this results in an object that looks like this: a 3 x 5 sparse Matrix of class "dgCMatrix" [1,] . . . 1 . [2,] 2 1 . . . [3,] . . 3 . 1 How do I convert this object into a data.frame that would look like this:
2015 Dec 26
1
[Bug 11651] New: Can we allow --inplace and --sparse to coexist when --whole-file is in play?
https://bugzilla.samba.org/show_bug.cgi?id=11651 Bug ID: 11651 Summary: Can we allow --inplace and --sparse to coexist when --whole-file is in play? Product: rsync Version: 3.1.2 Hardware: All OS: All Status: NEW Severity: enhancement Priority: P5 Component: core
2003 Jan 08
1
[Q] e2image: tools for sparse files & e2sfck support
Hi, i have two twofold e2image related questions: 1) The man page mentions "cp (1)"'s --sparse=always option. I wonder if there are sparse aware tools which a) display the "real" amount of disk space occupied by a sparse file b) compress sparse files (other than compressing very thightly several GiB of zeros) 2) "E2fsck, mke2fs, etc.
2009 Sep 27
1
Clustering with R - efficient processing of large sparse data sets (text data)
I checked the R procedure HCLUST (hierarchical clustering) but it looks like it requires a full triangular n x n similarity matrix as input, where n = number of observations. The number of variables is 200. My data set has n = 50,000 observations (keywords), and I use ad-hoc similarity measures, not available in R, to measure keyword similarity. Here, the vast majority of the n x n similarities
2012 Sep 26
5
sparse to no sparse
Hi. I have an old Xen para virt vm which I created using sparse file. Is there any way to convert this vm image to non-sparse without shutting down the vm?. Thanks Paras.
2008 Mar 23
1
[PATCH] allow to change the block size used to handle sparse files
In some filesystems, typically optimized for large I/O throughputs (like IBM GPFS, IBM SAN FS, or distributed filesystems in general) a lot of lseek() operations can strongly impact on performances. In this cases it can be helpful to enlarge the block size used to handle sparse files directly from a command line parameter. For example, using a sparse write size of 32KB, I've been able to
2012 Sep 05
1
Is the --sparse option suitable for .dbf files
Please let me know -------------- next part -------------- An HTML attachment was scrubbed... URL: <http://lists.samba.org/pipermail/rsync/attachments/20120905/15183c58/attachment.html>
2008 Sep 29
5
DO NOT REPLY [Bug 5801] New: Sparse (-S) option doesn't work with new files
https://bugzilla.samba.org/show_bug.cgi?id=5801 Summary: Sparse (-S) option doesn't work with new files Product: rsync Version: 3.1.0 Platform: Other OS/Version: Linux Status: NEW Severity: normal Priority: P3 Component: core AssignedTo: wayned@samba.org ReportedBy:
2016 Apr 20
0
Matrix: How create a _row-oriented_ sparse Matrix (=dgRMatrix)?
>>>>> Henrik Bengtsson <henrik.bengtsson at gmail.com> >>>>> on Tue, 19 Apr 2016 14:04:11 -0700 writes: > Using the Matrix package, how can I create a row-oriented sparse > Matrix from scratch populated with some data? By default a > column-oriented one is created and I'm aware of the note that the > package is optimized for
2015 Nov 03
26
[Bug 11588] New: missing option: preallocate for all files except for sparse
https://bugzilla.samba.org/show_bug.cgi?id=11588 Bug ID: 11588 Summary: missing option: preallocate for all files except for sparse Product: rsync Version: 3.1.2 Hardware: x64 OS: Linux Status: NEW Severity: enhancement Priority: P5 Component: core
2012 Mar 09
1
Eigenvalue calculation of sparse matrices
Dear all, I am currently working on the calculation of eigenvalues (and -vectors) of large matrices. Since these are mostly sparse matrices and I remember some specific functionalities in MATLAB for sparse matrices, I started a research how to optimize the calculation of eigenvalues of a sparse matrix. The function eigen itself works with the LAPACK library which has no special handling for
2020 Jul 21
2
trivial typo in ?Matrix::sparse.model.matrix.Rd
? "form" -> "from". Diff against latest SVN: Index: sparse.model.matrix.Rd =================================================================== --- sparse.model.matrix.Rd??? (revision 3336) +++ sparse.model.matrix.Rd??? (working copy) @@ -4,7 +4,7 @@ ?\alias{fac2sparse} ?\alias{fac2Sparse} ?\description{Construct a sparse model or \dQuote{design} matrix, -? form a formula
2018 Feb 14
1
[vhost:vhost 22/23] drivers/firmware/qemu_fw_cfg.c:130:36: sparse: incorrect type in initializer (different base types)
tree: https://git.kernel.org/pub/scm/linux/kernel/git/mst/vhost.git vhost head: 3d22d7c1190db3209b644b8a13a75a9802b4587f commit: b3a8771f409b74c42deee28aee3092fc5d2c8dab [22/23] fw_cfg: write vmcoreinfo details reproduce: # apt-get install sparse git checkout b3a8771f409b74c42deee28aee3092fc5d2c8dab make ARCH=x86_64 allmodconfig make C=1 CF=-D__CHECK_ENDIAN__
2009 Jan 20
1
Creating a Sparse Matrix from a Sparse Vector
Hello, I am working with a sparse matrix that is approx. 13,900 by 14,100. My goal is to select a row out of the matrix and create a new matrix with that row repeated 13,900 times without having to do any looping. Example: Starting Matrix: exampleMatrix 3 x 4 sparse Matrix of class "dgCMatrix" [1,] 1 . . . [2,] . 1 . 0.5 [3,] . . 1 .. New Matrix:.. newExampleMatrix 3 x 4 sparse