joanv
2014-Dec-23 17:31 UTC
[Rd] how useful could be a fast and embedded database for the R community?
Dear all, I'm developing a new database with the ability to perform very fast seek, insert, and delete operations. Also is able to perform very fast comparison of datasets. It has been designed to work embedded into other programs programmed in R, Fortran, C++, etc. It can manage efficiently billions of numeric datasets in a single machine. Right now I do not know in what fields of the R community could be helpful such a database, or if there could be a need of such a capability in the R community. Could someone help me in this topic? Partners for the project are also wanted, specially R experts, or experts on other kinds of calculation programs (vasp, gaussian, etc... ) Regards and thank you. -- View this message in context: http://r.789695.n4.nabble.com/how-useful-could-be-a-fast-and-embedded-database-for-the-R-community-tp4701051.html Sent from the R devel mailing list archive at Nabble.com.
elijah wright
2014-Dec-24 17:48 UTC
[Rd] how useful could be a fast and embedded database for the R community?
I believe in patches and working code. You're proposing to compete with the likes of sqlite and berkeley db -- not small competition, with excellent performance characteristics when used properly. You also used the 'b'illions word in reference to data sets - really? best, --e On Tue, Dec 23, 2014 at 11:31 AM, joanv <joan.iglesias at live.com> wrote:> Dear all, > > I'm developing a new database with the ability to perform very fast seek, > insert, and delete operations. Also is able to perform very fast comparison > of datasets. It has been designed to work embedded into other programs > programmed in R, Fortran, C++, etc. > > It can manage efficiently billions of numeric datasets in a single machine. > > Right now I do not know in what fields of the R community could be helpful > such a database, or if there could be a need of such a capability in the R > community. > > Could someone help me in this topic? Partners for the project are also > wanted, specially R experts, or experts on other kinds of calculation > programs (vasp, gaussian, etc... ) > > Regards and thank you. > > > > > -- > View this message in context: http://r.789695.n4.nabble.com/how-useful-could-be-a-fast-and-embedded-database-for-the-R-community-tp4701051.html > Sent from the R devel mailing list archive at Nabble.com. > > ______________________________________________ > R-devel at r-project.org mailing list > https://stat.ethz.ch/mailman/listinfo/r-devel
joanv
2014-Dec-24 18:49 UTC
[Rd] how useful could be a fast and embedded database for the R community?
I've already done some benchmarks, again leveldb and sqlite, are quite slow compared with my release. They cannot be used very intensively in a huge computation, because the low performance. Yes, billions ( American ones : thousands of millions) with a generous RAM. More details at: www.vulcandb.com My main concern, is where can feet better such a database. In what fields, or in what kind of calculations. Regards and thank you -- View this message in context: http://r.789695.n4.nabble.com/how-useful-could-be-a-fast-and-embedded-database-for-the-R-community-tp4701051p4701075.html Sent from the R devel mailing list archive at Nabble.com.
Seemingly Similar Threads
- how useful could be a fast and embedded database for the R community?
- how useful could be a fast and embedded database for the R community?
- how useful could be a fast and embedded database for the R community?
- corruption of active mmapped files in btrfs snapshots
- how useful could be a fast and embedded database for the R community?