R help - Oct 2011 - calculating joint entropy of many variables

Hello list.
I need help (e.g., a reference, code, package, etc.) in calculating the
joint entropy of many variables (some sure highly mutually-informative and
some not).
Is there anyone here who knows a computationally-efficient solution (such
as an R package)? I appreciate you help ...
Best, Reza

	[[alternative HTML version deleted]]

You may want to use this for basic measures :
http://cran.r-project.org/web/packages/entropy/
from http://strimmerlab.org/software/entropy/
Look at their paper, it may give you some idea 
Before going into more complicated cases,
http://arxiv.org/PS_cache/arxiv/pdf/0811/0811.3579v3.pdf


 


>-----Original Message-----
>From: r-help-bounces at r-project.org
[mailto:r-help-bounces at r-project.org]
>On Behalf Of Reza Salimi-Khorshidi
>Sent: 30 October 2011 14:45
>To: r-help at r-project.org
>Subject: [R] calculating joint entropy of many variables
>
>Hello list.
>I need help (e.g., a reference, code, package, etc.) in calculating the
>joint entropy of many variables (some sure highly mutually-informative
>and
>some not).
>Is there anyone here who knows a computationally-efficient solution
>(such
>as an R package)? I appreciate you help ...
>Best, Reza
>
>	[[alternative HTML version deleted]]
>
>______________________________________________
>R-help at r-project.org mailing list
>https://stat.ethz.ch/mailman/listinfo/r-help
>PLEASE do read the posting guide http://www.R-project.org/posting-
>guide.html
>and provide commented, minimal, self-contained, reproducible code.
LEGAL NOTICE
This message is intended for the use o...{{dropped:10}}