search for: rhipe

Greetings, I would like to announce the 0.1 release of RHIPE:R and Hadoop Integrated Processing Environment. The website is located at : http://www.stat.purdue.edu/~sguha/rhipe<http://www.stat.purdue.edu/%7Esguha/rhipe>. The download link is the bottom most link on left side of the page. RHIPE works on top of Hadoop, providing the R user a way to dis...

Hi, Since we can?t access Google Groups here in China, so please forgive me if anyone has asked this question before. Sincerely Xiaobo Gu

...We have created an interface between R and Hadoop so that the user can, after a fashion, interact with very large datasets using the Map Reduce programming model. We also use IBM's TSpaces to implement a shared memory implementation that can be accessed via R(somewhat like networkspaces). RHIPE uses Rserve to execute R code. Some of the functions implemented are: mrlapply - run lapply across a Hadoop cluster mrsubsetf - subset a file according to an R function mtapplyf - run a tapply on a file - mrmapreduce - run a map reduce algorithm on a file or group of files. The user provides...

I am a beginner with R. After I installed R 2.8.0, I tried to add a package. R CMD INSTALL RHIPE.tar.gz I got following error message: cannot extract package from RHIPE.tar.gz Can anyone tell me what's the problem? -- Best Regards, Zihang Yin 919-225-1717 Computer Science Duke University

...function(.index, k, r) { { len <- length(r$addon) rhcollect(len, 1) } }, 1:length(map.values), map.keys, map.values) NULL }) attr(,"class") [1] "expression" "rhmr-map" ewrap is defined in the GlobalEnv. In my package (Rhipe), a function rhwrap has the exact same definition rhwap <- function(co1=NULL,before=NULL,after=NULL){ co <- substitute(co1); before=substitute(before) j <- as.expression(bquote({ .(BE) result <- mapply(function(.index,k,r){ .(CO) },1:length(map.values),map.keys,m...

...I will now put down my understanding of each of the tools: 1) R text mining toolbox: Meant for local (client side) text processing and it uses the XML library 2) Hive: Hadoop interative, provides the framework to call map/reduce and also provides the DFS interface for storing files on the DFS. 3) RHIPE: R Hadoop integrated environment 4) Elastic MapReduce with R: a MapReduce framework for those who do not have their own clusters 5) Distributed Text Mining with R: An attempt to make seamless move form local to server side processing, from R-tm to R-distributed-tm I have the following questions an...

...function(.index, k, r) { { len <- length(r$addon) rhcollect(len, 1) } }, 1:length(map.values), map.keys, map.values) NULL }) attr(,"class") [1] "expression" "rhmr-map" ewrap is defined in the GlobalEnv. In my package (Rhipe), a function rhwrap has the exact same definition rhwap <- function(co1=NULL,before=NULL,after=NULL){ co <- substitute(co1); before=substitute(before) j <- as.expression(bquote({ .(BE) result <- mapply(function(.index,k,r){ .(CO) },1:length(map.values),map.keys,m...

...ge on OS X (Snow Leopard) using the following command, but instead of respecting the arch directive it install i386. How can this be resolved? R --arch=x86_64 CMD INSTALL .... * installing to library ‘/Library/Frameworks/R.framework/Versions/2.15/Resources/library’ * installing *source* package ‘Rhipe’ ... ** libs *** arch - i386 g++ -arch i386 -I/Library/Frameworks/R.framework/Resources/include -I..... My system (from cmd: R --arch=x86_64 ) R version 2.15.2 (2012-10-26) -- "Trick or Treat" Copyright (C) 2012 The R Foundation for Statistical Computing ISBN 3-900051-07-0 Platform: x8...

...e[2]: Leaving directory `/home/Edoardo/r-3.1.2/src/unix' make[1]: *** [R] Error 1 make[1]: Leaving directory `/home/Edoardo/r-3.1.2/src' make: *** [R] Error 1 I am not an expert programmer and would appreciate some help. My final objective is to install R as shared library in order to use RHIPE. Thanks Edoardo [[alternative HTML version deleted]]

...cibility and efficiency: http://bit.ly/bopvbR A video of using the "code snippets" feature in the Revolution R IDE to insert templates of R code: http://bit.ly/dgJ7aR A new competition to build a predictive model to identify popular R packages in CRAN: http://bit.ly/cL9NI7 A profile of Rhipe (Hadoop/R integration) author and new Revolution employee Saptarshi Guha: http://bit.ly/9k7ABg . Saptarshi Guha's presentation at Hadoop World on using Rhipe to analyze VOIP quality data was profiled in the SD Times: http://bit.ly/a81qdy A lattice chart illustrates the impact of the new Googl...

...op <- Sys.getenv("HADOOP") allfiles <- c(list.files(hadoop,pattern="jar$",full.names=T),list.files(paste(hadoop,"lib",sep=.Platform$file.sep,collapse=""),pattern="jar$",full.names=T)) allfiles <- c(allfiles,"/home/sguha/tmp/x/build/jar/rhipe.jar") .jinit(classpath=allfiles) Now, I create a new object .jnew("org/guha/SeqKeyList",.jnull) but get this error Exception in thread "main" java.lang.RuntimeException: java.lang.ClassNotFoundException: org.apache.hadoop.hdfs.DistributedFileSystem at org.apache.hadoop.co...

...- read("20110506_orders", sep = "\t", header = F) Does the group have experience with a better way to handle this? The goal would be to write data directly from hive into the R CLI in order to avoid unnecessary file clutter on a shared server. There are hadoop packages, such as Rhipe and hive Thanks. Josh [[alternative HTML version deleted]]

...ed to deploy predictive models to production environments: http://bit.ly/VAGLe3 Guest blogger Andrew Winterman uses R to design interactive data applications: http://bit.ly/VAGLe2 Guest blogger Ron Fredericks shares tips on making videos of R user group meetings, and links to a presentation about Rhipe at Facebook: http://bit.ly/VAGIz2 Guest blogger Garrett Grolemund introduced the ggsubplot package, and gave several examples of using small multiples for data visualization: http://bit.ly/VAGIz3 Guest blogger Naomi Robbins reprised several examples from her Forbes blog where R was used to improv...

...and a replay of the webinar introducing RevoDeployR here: http://bit.ly/aRUrPh . http://bit.ly/afwmwf linked to a feature article about R in Tech Target: "R's time is now". http://bit.ly/bB2MVC reviewed the state of running R on the iPhone and iPad. http://bit.ly/bBRHB2 noted that RHIPE creator Saptarshi Guha is presenting at the Hadoop World conference, and linked to an interview with him. (There's also a new profile of Saptarshi at: http://bit.ly/9k7ABg .) http://bit.ly/aPcxBP linked to a collection of guidelines for efficient R programming by Martin Morgan. http://bit.ly/...

...evoScaleR package to analyze a large airline data set: http://bit.ly/laTNrt A new guide for R beginners, "How to Learn R", provides links to R resources, blogs and courses: http://bit.ly/knQr5q Antonio Piccolboni compares 7 language interfaces to Hadoop, with a focus on the R interface, Rhipe: http://bit.ly/lNWZka Airline route charts make for a fun game of "guess the airline": http://bit.ly/k1bwe8 . FlowingData shows how it's done in R: http://bit.ly/kgkrTT Jeffrey Breen provides some useful slides on accessing databases from R with direct interfaces to MySQL and Oracle...