Displaying 20 results from an estimated 20000 matches similar to: ""non-efficient" sparse file copying with rsync"
2013 Dec 11
1
Making --inplace and --sparse compatible
It seems to me that it should be possible to make --inplace and
--sparse compatible.
The manpage says
-S, --sparse
... Conflicts with --inplace because it's not
possible to overwrite data in a sparse fashion.
but I think it _is_ possible to do that, provided the receiving
side opens the dest file read-write instead of write-only.
When writing within the existing
2010 May 22
2
Regression with sparse matricies
I would like to run a logistic regression on some factor variables (main
effects and eventually an interaction) that are very sparse. I have a
moderately large dataset, ~100k observations with 1500 factor levels for one
variable (x1) and 600 for another (X2), creating ~19000 levels for the
interaction (X1:X2).
I would like to take advantage of the sparseness in these factors to avoid
using GLM.
2020 Jan 22
3
[PATCH libnbd] PROPOSAL Add nbdcp (NBD copying) tool.
This is a proposal for an NBD to/from file copying tool (not actually
written). Obviously this would duplicate functionality which is
already available in qemu-img convert.
The reasons for writing this tool would be:
- to produce a tool which is very focused on the specific needs of
virt-v2v and similar migration scenarios
- to have a small tool with minimal dependencies
- fix some of
2010 Dec 08
3
DO NOT REPLY [Bug 7854] New: Abysmal sparse file performance
https://bugzilla.samba.org/show_bug.cgi?id=7854
Summary: Abysmal sparse file performance
Product: rsync
Version: 3.0.7
Platform: x86
OS/Version: FreeBSD
Status: NEW
Severity: major
Priority: P3
Component: core
AssignedTo: wayned at samba.org
ReportedBy: grarpamp at gmail.com
2010 Sep 21
1
Abysmal sparse file performance!
I have a 5.5GB file, mostly sparse. Tar performs far[!] better than rsync.
I have no ideas yet, so just an FYI as to current state.
FreeBSD 8.1 i386 zfs
Yes, I know the blocks used differs but don't know why yet, could
be just how zfs does things or related to the large amount of sparseness.
There are no media errors, CPU/IO load or anything like that and the source
and dest paths are on the
2016 Feb 02
3
Question: resize: non-sparse copying of extended partition
Hello everyone!
I faced an issue using virt-resize. I have an image with
extended -> logical -> pv -> lv -> ext4
(although I think LVM does not matter).
And image is 65G virtual size and 1G actualSize.
When I call virt-resize to 60G, it blindly copies the extended partition
content,
but does it non-sparse (resize.ml:1231), irrespective to --no-sparse option.
So the destination image
2010 Aug 19
1
Converting sparse matrix to data.frame in Matrix package
I am able to create a coordinate list sparse matrix this way:
r = c(1,2,2,3,3)
c = c(4,1,2,3,5)
v = c(1,2,1,3,1)
a = sparseMatrix(i=r,j=c,x=v)
However, this results in an object that looks like this:
a
3 x 5 sparse Matrix of class "dgCMatrix"
[1,] . . . 1 .
[2,] 2 1 . . .
[3,] . . 3 . 1
How do I convert this object into a data.frame that would look like this:
2015 Dec 26
1
[Bug 11651] New: Can we allow --inplace and --sparse to coexist when --whole-file is in play?
https://bugzilla.samba.org/show_bug.cgi?id=11651
Bug ID: 11651
Summary: Can we allow --inplace and --sparse to coexist when
--whole-file is in play?
Product: rsync
Version: 3.1.2
Hardware: All
OS: All
Status: NEW
Severity: enhancement
Priority: P5
Component: core
2003 Jan 08
1
[Q] e2image: tools for sparse files & e2sfck support
Hi,
i have two twofold e2image related questions:
1) The man page mentions "cp (1)"'s --sparse=always option. I
wonder if there are sparse aware tools which
a) display the "real" amount of disk space occupied by a
sparse file
b) compress sparse files (other than compressing very
thightly several GiB of zeros)
2) "E2fsck, mke2fs, etc.
2009 Sep 27
1
Clustering with R - efficient processing of large sparse data sets (text data)
I checked the R procedure HCLUST (hierarchical clustering) but it
looks like it requires a full triangular n x n similarity matrix as
input, where n = number of observations. The number of variables is
200.
My data set has n = 50,000 observations (keywords), and I use ad-hoc
similarity measures, not available in R, to measure keyword
similarity. Here, the vast majority of the n x n similarities
2012 Sep 26
5
sparse to no sparse
Hi.
I have an old Xen para virt vm which I created using sparse file. Is
there any way to convert this vm image to non-sparse without shutting
down the vm?.
Thanks
Paras.
2008 Mar 23
1
[PATCH] allow to change the block size used to handle sparse files
In some filesystems, typically optimized for large I/O throughputs (like
IBM GPFS, IBM SAN FS, or distributed filesystems in general) a lot of
lseek() operations can strongly impact on performances. In this cases it
can be helpful to enlarge the block size used to handle sparse files
directly from a command line parameter.
For example, using a sparse write size of 32KB, I've been able to
2012 Sep 05
1
Is the --sparse option suitable for .dbf files
Please let me know
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.samba.org/pipermail/rsync/attachments/20120905/15183c58/attachment.html>
2008 Sep 29
5
DO NOT REPLY [Bug 5801] New: Sparse (-S) option doesn't work with new files
https://bugzilla.samba.org/show_bug.cgi?id=5801
Summary: Sparse (-S) option doesn't work with new files
Product: rsync
Version: 3.1.0
Platform: Other
OS/Version: Linux
Status: NEW
Severity: normal
Priority: P3
Component: core
AssignedTo: wayned@samba.org
ReportedBy:
2016 Apr 20
0
Matrix: How create a _row-oriented_ sparse Matrix (=dgRMatrix)?
>>>>> Henrik Bengtsson <henrik.bengtsson at gmail.com>
>>>>> on Tue, 19 Apr 2016 14:04:11 -0700 writes:
> Using the Matrix package, how can I create a row-oriented sparse
> Matrix from scratch populated with some data? By default a
> column-oriented one is created and I'm aware of the note that the
> package is optimized for
2015 Nov 03
26
[Bug 11588] New: missing option: preallocate for all files except for sparse
https://bugzilla.samba.org/show_bug.cgi?id=11588
Bug ID: 11588
Summary: missing option: preallocate for all files except for
sparse
Product: rsync
Version: 3.1.2
Hardware: x64
OS: Linux
Status: NEW
Severity: enhancement
Priority: P5
Component: core
2012 Mar 09
1
Eigenvalue calculation of sparse matrices
Dear all,
I am currently working on the calculation of eigenvalues (and -vectors)
of large matrices. Since these are mostly sparse matrices and I remember
some specific functionalities in MATLAB for sparse matrices, I started a
research how to optimize the calculation of eigenvalues of a sparse matrix.
The function eigen itself works with the LAPACK library which has no
special handling for
2020 Jul 21
2
trivial typo in ?Matrix::sparse.model.matrix.Rd
? "form" -> "from". Diff against latest SVN:
Index: sparse.model.matrix.Rd
===================================================================
--- sparse.model.matrix.Rd??? (revision 3336)
+++ sparse.model.matrix.Rd??? (working copy)
@@ -4,7 +4,7 @@
?\alias{fac2sparse}
?\alias{fac2Sparse}
?\description{Construct a sparse model or \dQuote{design} matrix,
-? form a formula
2018 Feb 14
1
[vhost:vhost 22/23] drivers/firmware/qemu_fw_cfg.c:130:36: sparse: incorrect type in initializer (different base types)
tree: https://git.kernel.org/pub/scm/linux/kernel/git/mst/vhost.git vhost
head: 3d22d7c1190db3209b644b8a13a75a9802b4587f
commit: b3a8771f409b74c42deee28aee3092fc5d2c8dab [22/23] fw_cfg: write vmcoreinfo details
reproduce:
# apt-get install sparse
git checkout b3a8771f409b74c42deee28aee3092fc5d2c8dab
make ARCH=x86_64 allmodconfig
make C=1 CF=-D__CHECK_ENDIAN__
2009 Jan 20
1
Creating a Sparse Matrix from a Sparse Vector
Hello,
I am working with a sparse matrix that is approx. 13,900 by 14,100. My
goal is to select a row out of the matrix and create a new matrix with that
row repeated 13,900 times without having to do any looping. Example:
Starting Matrix:
exampleMatrix
3 x 4 sparse Matrix of class "dgCMatrix"
[1,] 1 . . .
[2,] . 1 . 0.5
[3,] . . 1 ..
New Matrix:..
newExampleMatrix
3 x 4 sparse