R devel - Oct 2007 - Cell or PS3 Port

Hello,

I am interested in optimizing some of R's vector math functions to 
utilize the SPE units of the Cell processor (commonly found in the 
Playstation 3) and I am wondering if anyone has already done any work in 
that area.  I can't find anything using the search page or Google. 
(Admittedly it is difficult to search for information on a 
one-letter-named programming language whose contributed documentation 
intrinsically refers to "cells" frequently. :)  I'm assuming it
will be
possible to compile R under a PS3 version of Linux, since it has a ppc64 
architecture and R already runs on OS X.  Are there any known caveats to 
compiling R for a distro like Ubuntu with X11 support?

I'm just going through the Cell SDK documentation at this point so it 
will be a few days before I really get into the guts of it.  Any 
information would be greatly appreciated.

-Ed

On 27 October 2007 at 10:35, Ed Knutson wrote:
| I am interested in optimizing some of R's vector math functions to 
| utilize the SPE units of the Cell processor (commonly found in the 
| Playstation 3) and I am wondering if anyone has already done any work in 
| that area.  I can't find anything using the search page or Google. 
| (Admittedly it is difficult to search for information on a 
| one-letter-named programming language whose contributed documentation 
| intrinsically refers to "cells" frequently. :)  I'm assuming it
will be

See the r-devel archives for August where Doug Bates started a thread 
	[Rd] Compiling R for the Sony Playstation 3
with many posts.  

The upshot,as I recall, is the he 'simply' installed Ubuntu on his PS3
in
order to real software (read: Emacs, R) running on his 'dvd player' as
he
calls it.

There is a lot of interest in making R work on things like the Cell as well
as in GPGPU frameworks, at least for subroutines and libraries (and I
understand that some work is ongoing in that area).  The main R thread will
probably remain single-threaded 'forever'.  Others may have more
pertinent
comments.

Hope this helps, Dirk

-- 
Three out of two people have difficulties with fractions.

I have been experimenting with ways of parallelizing many of the
functions in the math library.  There are two experimental packages
available in http://www.stat.uiowa.edu/~luke/R/experimental: pnmath,
based on OpenMP, and pnmath0, based on basic pthreads.  I'm not sure
to what degree the approach there would carry over to GPUs or Cell
where the additional processors are different from the main processor
and may not share memory (I forget how that works on Cell).

The first issue is that you need some modifications to the some
functions to ensure they are thread-safe.  For the most part these are
minor; a few functions would require major changes and I have not
tackled them for now (Bessel functions, wilcox, signrank I believe).
RNG functions are also not suitable for parallelization given the
dependence on the sequential underlying RNG.

It is not too hard to get parallel versions to use all available
processor cores. The challenge is to make sure that the parallel
versions don't run slower than the serial versions. They may if the
amount of data is too small.  What is too small for each function
depends on the OS and the processor/memory architecture; if memory is
not shared this gets more complicated still.  For some very simple
functions (floor, ceiling, sign) I could not see any reliable benefit
of parallelization for reasonable data sizes on the systems I was
using so I left those alone for now.

luke

On Sat, 27 Oct 2007, Ed Knutson wrote:
> Hello,
>
> I am interested in optimizing some of R's vector math functions to
> utilize the SPE units of the Cell processor (commonly found in the
> Playstation 3) and I am wondering if anyone has already done any work in
> that area.  I can't find anything using the search page or Google.
> (Admittedly it is difficult to search for information on a
> one-letter-named programming language whose contributed documentation
> intrinsically refers to "cells" frequently. :)  I'm assuming
it will be
> possible to compile R under a PS3 version of Linux, since it has a ppc64
> architecture and R already runs on OS X.  Are there any known caveats to
> compiling R for a distro like Ubuntu with X11 support?
>
> I'm just going through the Cell SDK documentation at this point so it
> will be a few days before I really get into the guts of it.  Any
> information would be greatly appreciated.
>
> -Ed
>
> ______________________________________________
> R-devel at r-project.org mailing list
> https://stat.ethz.ch/mailman/listinfo/r-devel
>
-- 
Luke Tierney
Chair, Statistics and Actuarial Science
Ralph E. Wareham Professor of Mathematical Sciences
University of Iowa                  Phone:             319-335-3386
Department of Statistics and        Fax:               319-335-3017
    Actuarial Science
241 Schaeffer Hall                  email:      luke at stat.uiowa.edu
Iowa City, IA 52242                 WWW:  http://www.stat.uiowa.edu