R devel - Dec 2014 - how useful could be a fast and embedded database for the R community?

Dear all,

I'm developing a new database with the ability to perform very fast seek,
insert, and delete operations. Also is able to perform very fast comparison
of datasets. It has been designed to work embedded into other programs
programmed in R, Fortran, C++, etc.

It can manage efficiently billions of numeric datasets in a single machine.

Right now I do not know in what fields of the R community could be helpful
such a database, or if there could be a need of such a capability in the R
community.

Could someone help me in this topic? Partners for the project are also
wanted, specially R experts, or experts on other kinds of calculation
programs (vasp, gaussian, etc... )

Regards and thank you.




--
View this message in context:
http://r.789695.n4.nabble.com/how-useful-could-be-a-fast-and-embedded-database-for-the-R-community-tp4701051.html
Sent from the R devel mailing list archive at Nabble.com.

I believe in patches and working code.

You're proposing to compete with the likes of sqlite and berkeley db
-- not small competition, with excellent performance characteristics
when used properly.

You also used the 'b'illions word in reference to data sets - really?

best,

--e


On Tue, Dec 23, 2014 at 11:31 AM, joanv <joan.iglesias at live.com>
wrote:
> Dear all,
>
> I'm developing a new database with the ability to perform very fast
seek,
> insert, and delete operations. Also is able to perform very fast comparison
> of datasets. It has been designed to work embedded into other programs
> programmed in R, Fortran, C++, etc.
>
> It can manage efficiently billions of numeric datasets in a single machine.
>
> Right now I do not know in what fields of the R community could be helpful
> such a database, or if there could be a need of such a capability in the R
> community.
>
> Could someone help me in this topic? Partners for the project are also
> wanted, specially R experts, or experts on other kinds of calculation
> programs (vasp, gaussian, etc... )
>
> Regards and thank you.
>
>
>
>
> --
> View this message in context:
http://r.789695.n4.nabble.com/how-useful-could-be-a-fast-and-embedded-database-for-the-R-community-tp4701051.html
> Sent from the R devel mailing list archive at Nabble.com.
>
> ______________________________________________
> R-devel at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-devel

I've already done some benchmarks, again leveldb and sqlite, are quite slow
compared with my release.

They cannot be used very intensively in a huge computation, because the low
performance.

Yes, billions ( American ones : thousands of millions) with a generous RAM.

More details at: www.vulcandb.com

My main concern, is where can feet better such a database. In what fields,
or in what kind of calculations.

Regards and thank you




--
View this message in context:
http://r.789695.n4.nabble.com/how-useful-could-be-a-fast-and-embedded-database-for-the-R-community-tp4701051p4701075.html
Sent from the R devel mailing list archive at Nabble.com.