Tutorial: Using R for Scalable Data Analytics
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.
At the recent Strata conference in San Jose, several members of the Microsoft Data Science team presented the tutorial Using R for Scalable Data Analytics: Single Machines to Spark Clusters. The materials are all available online, including the presentation slides and hands-on R scripts. You can follow along with the materials at home, using the Data Science Virtual Machine for Linux, which provides all the necessary components like Spark and Microsoft R Server. (If you don't already have an Azure account, you can get $200 credit with the Azure free trial.)
The tutorial covers many different techniques for training predictive models at scale, and deploying the trained models as predictive engines within production environments. Among the technologies you'll use are Microsoft R Server running on Spark, the SparkR package, the sparklyr package and H20 (via the rsparkling package). It also touches on some non-Spark methods, like the bigmemory and ff packages for R (and various other packages that make use of them), and using the foreach package for coarse-grained parallel computations. You'll also learn how to create prediction engines from these trained models using the mrsdeploy package.
The tutorial also includes scripts for comparing the performance of these various techniques, both for training the predictive model:
and for generating predictions from the trained model:
(The above tests used 4 worker nodes and 1 edge node, all with with 16 cores and 112Gb of RAM.)
You can find the tutorial details, including slides and scripts, at the link below.
Strata + Hadoop World 2017, San Jose: Using R for scalable data analytics: From single machines to Hadoop Spark clusters
R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.