R 101: Summarizing Data
[This article was first published on Mathew Analytics » R, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.
When working with large amounts of data that is structured in a tabular format, a common operation is to summarize that data in different ways using specific variables. In Microsoft Excel, pivot tables are a nice feature that is used for this purpose. While not as “efficient” in relation to Excel pivot tables, R also has similar calculations that can be used to summarize large amount of data. In the following R code, I utilize R to summarize a data frame by specific variables.
## CREATE DATA dat = data.frame( name=c("Tony","James","Sara","Alice","David","Angie","Don","Faith","Becky","Jenny", "Kristi","Neil","Brandon","Kara","Kendra","Liz","Gina","Amber","Alice","George"), state=c("KS","IA","CA","FL","MI","CO","KA","CO","KS","CA","MN","FL","NM","MS","GA", "IA","IL","ID","NY","NJ"), gender=c("M","M","F","F","F","M","F","M","F","F","F","M","M","F","F","F","F","F","F","M"), marital_status=c("M","S","S","S","M","M","S","M","S","M","M","S","S","S","M","M","S","M","S","M"), credit=c("good","good","poor","fair","poor","fair","fair","fair","good","fair", "good","good","poor","fair","poor","fair","fair","fair","good","fair"), owns_home=c(0,1,0,0,1,0,1,1,1,1,0,1,0,0,1,0,1,1,1,1), cost=c(500,200,300,150,200,300,400,450,250,150,500,200,300,150,200,300,400,450,250,150)) ## AGGREGATE FUNCTION FROM BASE R aggregate(cost ~ marital_status, data=dat, FUN=mean) aggregate(cost ~ marital_status + gender, data=dat, FUN=mean) aggregate(cost ~ marital_status + credit + gender, data=dat, FUN=mean) ## SUMMARY BY IN DOBY: library(doBy) summaryBy(cost ~ marital_status, data=dat, FUN=c(mean, sd)) summaryBy(cost ~ gender, data=dat, FUN=c(mean, sd)) summaryBy(cost ~ credit, data=dat, FUN=c(mean, sd)) ## DDPLY IN PLYR library(plyr) ddply(dat, .(credit), "nrow") ddply(dat, .(credit, gender), "nrow") ddply(dat, .(marital_status), summarise, avg=mean(cost)) ddply(dat, .(marital_status, gender), summarise, avg=mean(cost)) ddply(dat, .(marital_status, gender, credit), summarise, avg=mean(cost)) ## DPLYR PACKAGE library(dplyr) Good = filter(dat, credit=="good") Good arrange(Good, desc(cost)) select(Good, owns_home, cost) mutate(Good, New_Value=cost/5) by.type <- group_by(Good, gender) summarise(by.type, num.types = n(), counts = sum(cost)) ## SQLDF PACKAGE library(sqldf) sqldf("SELECT gender, COUNT(*) FROM dat GROUP BY gender") sqldf("SELECT gender, credit, COUNT(*) FROM dat GROUP BY gender, credit") sqldf("SELECT gender, credit, COUNT(*), AVG(cost) FROM dat GROUP BY gender, credit")
To leave a comment for the author, please follow the link and comment on their blog: Mathew Analytics » R.
R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.