R help - Feb 2018 - Aggregate over multiple and unequal column length data frames

Thank you Pikal and Bert. My apology for posting parts of my previous
email in HTML. Bert's suggestion will work but i am wondering if there
is an alternative
especially in the case where the data frames are big; that is the
difference in lengths among them is large. Below is a list of sample
date frames and desired result.

EK


dput(df1<-data.frame(col1=c(1,2,3,4,5),col2=c("aa","aa","bb","cc","dd")))
dput(df2<-data.frame(col1=c(1,2,4,5),col2=c("bb","bb","cc","bb")))
dput(df3<-data.frame(col1=c(1,3),col2=c("aa","aa")))
# desired result
dput(dfn<-data.frame(col1=c(2,2,1,1),col2=c(0,3,1,0),col3=c(2,0,0,0),row.names
= c("aa","bb","cc","dd")))

On Fri, Feb 23, 2018 at 7:45 AM, PIKAL Petr <petr.pikal at precheza.cz>
wrote:
> Hi
>
> Your example is rather confusing - partly because HTML formating, partly
because weird coding.
>
> You probably could concatenate your data frames e.g. by rbind or merge and
after that you could try to aggregate them somehow.
>
> I could construct example data.frames myself but most probably they would
be different from yours and also the result would not be necessary the same as
you expect.
>
> You should post those data frames as output from dput(data) and show us
real desired result from those example data frames.
>
> Cheers
> Petr
>
>> -----Original Message-----
>> From: R-help [mailto:r-help-bounces at r-project.org] On Behalf Of Ek
Esawi
>> Sent: Wednesday, February 21, 2018 3:34 AM
>> To: r-help at r-project.org
>> Subject: [R] Aggregate over multiple and unequal column length data
frames
>>
>>  Hi All--
>>
>> I have generated several 2 column data frames with variable length. The
data
>> frames have the same column names and variable types. I was trying to
>> aggregate over the 2nd column for all the date frames, but could not
figure out
>> how.
>>
>> I thought i could make them all of equal length then combine them in 1
data
>> frame where i can use aggregate, the formula version Or to put them in
a list
>> and loop use lapply but did not know how to do that and thought there
might
>> be a simpler way.
>>
>> Below is an example of 3 data frames and the desired result; note that
some
>> levels don't appear in all and may be null over all variable, like
the case of dd
>> on the desired result which i would like to list all levels even if
some are all null.
>>
>> Thanks in advance,
>>
>> EK
>>
>>    df1           df2          df3
>>
>> c1 c2 c1 c2 c1 c2
>> 1 aa 1 bb 1 aa
>> 2 aa 2 bb 2 aa
>> 3 bb 3 cc
>> 4 cc 4 bb
>> 5 bb
>>
>> desired result
>>
>> c1 c2 c2 c2
>> aa 2 2
>> bb 1 2 2
>> cc 1 1
>> dd
>>
>> [[alternative HTML version deleted]]
>>
>> ______________________________________________
>> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
>> https://stat.ethz.ch/mailman/listinfo/r-help
>> PLEASE do read the posting guide
http://www.R-project.org/posting-guide.html
>> and provide commented, minimal, self-contained, reproducible code.
>
> ________________________________
> Tento e-mail a jak?koliv k n?mu p?ipojen? dokumenty jsou d?v?rn? a jsou
ur?eny pouze jeho adres?t?m.
> Jestli?e jste obdr?el(a) tento e-mail omylem, informujte laskav? neprodlen?
jeho odes?latele. Obsah tohoto emailu i s p??lohami a jeho kopie vyma?te ze
sv?ho syst?mu.
> Nejste-li zam??len?m adres?tem tohoto emailu, nejste opr?vn?ni tento email
jakkoliv u??vat, roz?i?ovat, kop?rovat ?i zve?ej?ovat.
> Odes?latel e-mailu neodpov?d? za eventu?ln? ?kodu zp?sobenou modifikacemi
?i zpo?d?n?m p?enosu e-mailu.
>
> V p??pad?, ?e je tento e-mail sou??st? obchodn?ho jedn?n?:
> - vyhrazuje si odes?latel pr?vo ukon?it kdykoliv jedn?n? o uzav?en?
smlouvy, a to z jak?hokoliv d?vodu i bez uveden? d?vodu.
> - a obsahuje-li nab?dku, je adres?t opr?vn?n nab?dku bezodkladn? p?ijmout;
Odes?latel tohoto e-mailu (nab?dky) vylu?uje p?ijet? nab?dky ze strany p??jemce
s dodatkem ?i odchylkou.
> - trv? odes?latel na tom, ?e p??slu?n? smlouva je uzav?ena teprve v?slovn?m
dosa?en?m shody na v?ech jej?ch n?le?itostech.
> - odes?latel tohoto emailu informuje, ?e nen? opr?vn?n uzav?rat za
spole?nost ??dn? smlouvy s v?jimkou p??pad?, kdy k tomu byl p?semn? zmocn?n nebo
p?semn? pov??en a takov? pov??en? nebo pln? moc byly adres?tovi tohoto emailu
p??padn? osob?, kterou adres?t zastupuje, p?edlo?eny nebo jejich existence je
adres?tovi ?i osob? j?m zastoupen? zn?m?.
>
> This e-mail and any documents attached to it may be confidential and are
intended only for its intended recipients.
> If you received this e-mail by mistake, please immediately inform its
sender. Delete the contents of this e-mail with all attachments and its copies
from your system.
> If you are not the intended recipient of this e-mail, you are not
authorized to use, disseminate, copy or disclose this e-mail in any manner.
> The sender of this e-mail shall not be liable for any possible damage
caused by modifications of the e-mail or by delay with transfer of the email.
>
> In case that this e-mail forms part of business dealings:
> - the sender reserves the right to end negotiations about entering into a
contract in any time, for any reason, and without stating any reasoning.
> - if the e-mail contains an offer, the recipient is entitled to immediately
accept such offer; The sender of this e-mail (offer) excludes any acceptance of
the offer on the part of the recipient containing any amendment or variation.
> - the sender insists on that the respective contract is concluded only upon
an express mutual agreement on all its aspects.
> - the sender of this e-mail informs that he/she is not authorized to enter
into any contracts on behalf of the company except for cases in which he/she is
expressly authorized to do so in writing, and such authorization or power of
attorney is submitted to the recipient or the person represented by the
recipient, or the existence of such authorization is known to the recipient of
the person represented by the recipient.

Hi

you does not need this:
dput(df1<-data.frame(col1=c(1,2,3,4,5),col2=c("aa","aa","bb","cc","dd")))

this is enough to represent exactly any object to mail:
> dput(df1)
structure(list(col1 = c(1, 2, 3, 4, 5), col2 = structure(c(1L,
1L, 2L, 3L, 4L), .Label = c("aa", "bb", "cc",
"dd"), class = "factor")), .Names = c("col1",
"col2"), row.names = c(NA, -5L), class = "data.frame")

Anyway (I am sure there is better way but)
# make list from your data frames
lll<-list(df1, df2, df3)

#add new column to each part
for (i in 1:3) lll[[i]]$n<-i

#concatenate data to one data frame
dat<-do.call(rbind, lll)

# make table (and data frame from it)
data.frame(unclass(table(dat$col2, dat$n)))
   X1 X2 X3
aa  2  0  2
bb  1  3  0
cc  1  1  0
dd  1  0  0

I believe that in your dfn is typo in second row and first column and that with
your 3 data.frames the result should be 1.

Cheers
Petr
> -----Original Message-----
> From: Ek Esawi [mailto:esawiek at gmail.com]
> Sent: Tuesday, February 27, 2018 2:54 PM
> To: PIKAL Petr <petr.pikal at precheza.cz>; r-help at r-project.org
> Subject: Re: [R] Aggregate over multiple and unequal column length data
> frames
>
> Thank you Pikal and Bert. My apology for posting parts of my previous email
in
> HTML. Bert's suggestion will work but i am wondering if there is an
alternative
> especially in the case where the data frames are big; that is the
difference in
> lengths among them is large. Below is a list of sample date frames and
desired
> result.
>
> EK
>
>
>
dput(df1<-data.frame(col1=c(1,2,3,4,5),col2=c("aa","aa","bb","cc","dd")))
>
dput(df2<-data.frame(col1=c(1,2,4,5),col2=c("bb","bb","cc","bb")))
> dput(df3<-data.frame(col1=c(1,3),col2=c("aa","aa")))
> # desired result
>
dput(dfn<-data.frame(col1=c(2,2,1,1),col2=c(0,3,1,0),col3=c(2,0,0,0),row.names
> = c("aa","bb","cc","dd")))
>
> On Fri, Feb 23, 2018 at 7:45 AM, PIKAL Petr <petr.pikal at
precheza.cz> wrote:
> > Hi
> >
> > Your example is rather confusing - partly because HTML formating,
partly
> because weird coding.
> >
> > You probably could concatenate your data frames e.g. by rbind or merge
and
> after that you could try to aggregate them somehow.
> >
> > I could construct example data.frames myself but most probably they
would
> be different from yours and also the result would not be necessary the same
as
> you expect.
> >
> > You should post those data frames as output from dput(data) and show
us
> real desired result from those example data frames.
> >
> > Cheers
> > Petr
> >
> >> -----Original Message-----
> >> From: R-help [mailto:r-help-bounces at r-project.org] On Behalf Of
Ek
> >> Esawi
> >> Sent: Wednesday, February 21, 2018 3:34 AM
> >> To: r-help at r-project.org
> >> Subject: [R] Aggregate over multiple and unequal column length
data
> >> frames
> >>
> >>  Hi All--
> >>
> >> I have generated several 2 column data frames with variable
length.
> >> The data frames have the same column names and variable types. I
was
> >> trying to aggregate over the 2nd column for all the date frames,
but
> >> could not figure out how.
> >>
> >> I thought i could make them all of equal length then combine them
in
> >> 1 data frame where i can use aggregate, the formula version Or to
put
> >> them in a list and loop use lapply but did not know how to do that
> >> and thought there might be a simpler way.
> >>
> >> Below is an example of 3 data frames and the desired result; note
> >> that some levels don't appear in all and may be null over all
> >> variable, like the case of dd on the desired result which i would
like to list all
> levels even if some are all null.
> >>
> >> Thanks in advance,
> >>
> >> EK
> >>
> >>    df1           df2          df3
> >>
> >> c1 c2 c1 c2 c1 c2
> >> 1 aa 1 bb 1 aa
> >> 2 aa 2 bb 2 aa
> >> 3 bb 3 cc
> >> 4 cc 4 bb
> >> 5 bb
> >>
> >> desired result
> >>
> >> c1 c2 c2 c2
> >> aa 2 2
> >> bb 1 2 2
> >> cc 1 1
> >> dd
> >>
> >> [[alternative HTML version deleted]]
> >>
________________________________
Tento e-mail a jak?koliv k n?mu p?ipojen? dokumenty jsou d?v?rn? a jsou ur?eny
pouze jeho adres?t?m.
Jestli?e jste obdr?el(a) tento e-mail omylem, informujte laskav? neprodlen? jeho
odes?latele. Obsah tohoto emailu i s p??lohami a jeho kopie vyma?te ze sv?ho
syst?mu.
Nejste-li zam??len?m adres?tem tohoto emailu, nejste opr?vn?ni tento email
jakkoliv u??vat, roz?i?ovat, kop?rovat ?i zve?ej?ovat.
Odes?latel e-mailu neodpov?d? za eventu?ln? ?kodu zp?sobenou modifikacemi ?i
zpo?d?n?m p?enosu e-mailu.

V p??pad?, ?e je tento e-mail sou??st? obchodn?ho jedn?n?:
- vyhrazuje si odes?latel pr?vo ukon?it kdykoliv jedn?n? o uzav?en? smlouvy, a
to z jak?hokoliv d?vodu i bez uveden? d?vodu.
- a obsahuje-li nab?dku, je adres?t opr?vn?n nab?dku bezodkladn? p?ijmout;
Odes?latel tohoto e-mailu (nab?dky) vylu?uje p?ijet? nab?dky ze strany p??jemce
s dodatkem ?i odchylkou.
- trv? odes?latel na tom, ?e p??slu?n? smlouva je uzav?ena teprve v?slovn?m
dosa?en?m shody na v?ech jej?ch n?le?itostech.
- odes?latel tohoto emailu informuje, ?e nen? opr?vn?n uzav?rat za spole?nost
??dn? smlouvy s v?jimkou p??pad?, kdy k tomu byl p?semn? zmocn?n nebo p?semn?
pov??en a takov? pov??en? nebo pln? moc byly adres?tovi tohoto emailu p??padn?
osob?, kterou adres?t zastupuje, p?edlo?eny nebo jejich existence je adres?tovi
?i osob? j?m zastoupen? zn?m?.

This e-mail and any documents attached to it may be confidential and are
intended only for its intended recipients.
If you received this e-mail by mistake, please immediately inform its sender.
Delete the contents of this e-mail with all attachments and its copies from your
system.
If you are not the intended recipient of this e-mail, you are not authorized to
use, disseminate, copy or disclose this e-mail in any manner.
The sender of this e-mail shall not be liable for any possible damage caused by
modifications of the e-mail or by delay with transfer of the email.

In case that this e-mail forms part of business dealings:
- the sender reserves the right to end negotiations about entering into a
contract in any time, for any reason, and without stating any reasoning.
- if the e-mail contains an offer, the recipient is entitled to immediately
accept such offer; The sender of this e-mail (offer) excludes any acceptance of
the offer on the part of the recipient containing any amendment or variation.
- the sender insists on that the respective contract is concluded only upon an
express mutual agreement on all its aspects.
- the sender of this e-mail informs that he/she is not authorized to enter into
any contracts on behalf of the company except for cases in which he/she is
expressly authorized to do so in writing, and such authorization or power of
attorney is submitted to the recipient or the person represented by the
recipient, or the existence of such authorization is known to the recipient of
the person represented by the recipient.

Then you need to rethink your data structure. Use a list instead of a data
frame. The components of a list can have different lengths, and the
"apply"
family of functions (lapply(), etc.) can operate on them. Consult any good
R tutorial for details.

Cheers,
Bert

Bert Gunter

"The trouble with having an open mind is that people keep coming along and
sticking things into it."
-- Opus (aka Berkeley Breathed in his "Bloom County" comic strip )

On Tue, Feb 27, 2018 at 5:54 AM, Ek Esawi <esawiek at gmail.com> wrote:
> Thank you Pikal and Bert. My apology for posting parts of my previous
> email in HTML. Bert's suggestion will work but i am wondering if there
> is an alternative
> especially in the case where the data frames are big; that is the
> difference in lengths among them is large. Below is a list of sample
> date frames and desired result.
>
> EK
>
>
>
dput(df1<-data.frame(col1=c(1,2,3,4,5),col2=c("aa","aa","bb","cc","dd")))
>
dput(df2<-data.frame(col1=c(1,2,4,5),col2=c("bb","bb","cc","bb")))
> dput(df3<-data.frame(col1=c(1,3),col2=c("aa","aa")))
> # desired result
> dput(dfn<-data.frame(col1=c(2,2,1,1),col2=c(0,3,1,0),col3=c(
> 2,0,0,0),row.names
> = c("aa","bb","cc","dd")))
>
> On Fri, Feb 23, 2018 at 7:45 AM, PIKAL Petr <petr.pikal at
precheza.cz>
> wrote:
> > Hi
> >
> > Your example is rather confusing - partly because HTML formating,
partly
> because weird coding.
> >
> > You probably could concatenate your data frames e.g. by rbind or merge
> and after that you could try to aggregate them somehow.
> >
> > I could construct example data.frames myself but most probably they
> would be different from yours and also the result would not be necessary
> the same as you expect.
> >
> > You should post those data frames as output from dput(data) and show
us
> real desired result from those example data frames.
> >
> > Cheers
> > Petr
> >
> >> -----Original Message-----
> >> From: R-help [mailto:r-help-bounces at r-project.org] On Behalf Of
Ek
> Esawi
> >> Sent: Wednesday, February 21, 2018 3:34 AM
> >> To: r-help at r-project.org
> >> Subject: [R] Aggregate over multiple and unequal column length
data
> frames
> >>
> >>  Hi All--
> >>
> >> I have generated several 2 column data frames with variable
length. The
> data
> >> frames have the same column names and variable types. I was trying
to
> >> aggregate over the 2nd column for all the date frames, but could
not
> figure out
> >> how.
> >>
> >> I thought i could make them all of equal length then combine them
in 1
> data
> >> frame where i can use aggregate, the formula version Or to put
them in
> a list
> >> and loop use lapply but did not know how to do that and thought
there
> might
> >> be a simpler way.
> >>
> >> Below is an example of 3 data frames and the desired result; note
that
> some
> >> levels don't appear in all and may be null over all variable,
like the
> case of dd
> >> on the desired result which i would like to list all levels even
if
> some are all null.
> >>
> >> Thanks in advance,
> >>
> >> EK
> >>
> >>    df1           df2          df3
> >>
> >> c1 c2 c1 c2 c1 c2
> >> 1 aa 1 bb 1 aa
> >> 2 aa 2 bb 2 aa
> >> 3 bb 3 cc
> >> 4 cc 4 bb
> >> 5 bb
> >>
> >> desired result
> >>
> >> c1 c2 c2 c2
> >> aa 2 2
> >> bb 1 2 2
> >> cc 1 1
> >> dd
> >>
> >> [[alternative HTML version deleted]]
> >>
> >> ______________________________________________
> >> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more,
see
> >> https://stat.ethz.ch/mailman/listinfo/r-help
> >> PLEASE do read the posting guide http://www.R-project.org/
> posting-guide.html
> >> and provide commented, minimal, self-contained, reproducible code.
> >
> > ________________________________
> > Tento e-mail a jak?koliv k n?mu p?ipojen? dokumenty jsou d?v?rn? a
jsou
> ur?eny pouze jeho adres?t?m.
> > Jestli?e jste obdr?el(a) tento e-mail omylem, informujte laskav?
> neprodlen? jeho odes?latele. Obsah tohoto emailu i s p??lohami a jeho kopie
> vyma?te ze sv?ho syst?mu.
> > Nejste-li zam??len?m adres?tem tohoto emailu, nejste opr?vn?ni tento
> email jakkoliv u??vat, roz?i?ovat, kop?rovat ?i zve?ej?ovat.
> > Odes?latel e-mailu neodpov?d? za eventu?ln? ?kodu zp?sobenou
> modifikacemi ?i zpo?d?n?m p?enosu e-mailu.
> >
> > V p??pad?, ?e je tento e-mail sou??st? obchodn?ho jedn?n?:
> > - vyhrazuje si odes?latel pr?vo ukon?it kdykoliv jedn?n? o uzav?en?
> smlouvy, a to z jak?hokoliv d?vodu i bez uveden? d?vodu.
> > - a obsahuje-li nab?dku, je adres?t opr?vn?n nab?dku bezodkladn?
> p?ijmout; Odes?latel tohoto e-mailu (nab?dky) vylu?uje p?ijet? nab?dky ze
> strany p??jemce s dodatkem ?i odchylkou.
> > - trv? odes?latel na tom, ?e p??slu?n? smlouva je uzav?ena teprve
> v?slovn?m dosa?en?m shody na v?ech jej?ch n?le?itostech.
> > - odes?latel tohoto emailu informuje, ?e nen? opr?vn?n uzav?rat za
> spole?nost ??dn? smlouvy s v?jimkou p??pad?, kdy k tomu byl p?semn? zmocn?n
> nebo p?semn? pov??en a takov? pov??en? nebo pln? moc byly adres?tovi tohoto
> emailu p??padn? osob?, kterou adres?t zastupuje, p?edlo?eny nebo jejich
> existence je adres?tovi ?i osob? j?m zastoupen? zn?m?.
> >
> > This e-mail and any documents attached to it may be confidential and
are
> intended only for its intended recipients.
> > If you received this e-mail by mistake, please immediately inform its
> sender. Delete the contents of this e-mail with all attachments and its
> copies from your system.
> > If you are not the intended recipient of this e-mail, you are not
> authorized to use, disseminate, copy or disclose this e-mail in any manner.
> > The sender of this e-mail shall not be liable for any possible damage
> caused by modifications of the e-mail or by delay with transfer of the
> email.
> >
> > In case that this e-mail forms part of business dealings:
> > - the sender reserves the right to end negotiations about entering
into
> a contract in any time, for any reason, and without stating any reasoning.
> > - if the e-mail contains an offer, the recipient is entitled to
> immediately accept such offer; The sender of this e-mail (offer) excludes
> any acceptance of the offer on the part of the recipient containing any
> amendment or variation.
> > - the sender insists on that the respective contract is concluded only
> upon an express mutual agreement on all its aspects.
> > - the sender of this e-mail informs that he/she is not authorized to
> enter into any contracts on behalf of the company except for cases in which
> he/she is expressly authorized to do so in writing, and such authorization
> or power of attorney is submitted to the recipient or the person
> represented by the recipient, or the existence of such authorization is
> known to the recipient of the person represented by the recipient.
>
> ______________________________________________
> R-help at r-project.org mailing list -- To UNSUBSCRIBE and more, see
> https://stat.ethz.ch/mailman/listinfo/r-help
> PLEASE do read the posting guide http://www.R-project.org/
> posting-guide.html
> and provide commented, minimal, self-contained, reproducible code.
>
	[[alternative HTML version deleted]]

Thank you again Pikal and Bert. Using lapply, as Bert suggested, was
the first thing that i thought of dealing with this question and  was
mentioned in my original posting. I just did not know how to implement
it to get the results/form i want. Below is what i did but could not
get it to give me the results as i want which was given on Pikal's
answer.

nlist <- list(df1$col2,df2$col2, df3$col2)

lapply(nlist, function(x) table(x))
[[1]]
x
aa bb cc dd
 2  1  1  1

[[2]]
x
bb cc
 3  1

[[3]]
x
aa
 2