Analyzing emotions in video with R

[This article was first published on Revolutions, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

In the run-up to the election last year, Ben Heubl from The Economist used the Emotion API to chart the emotions portrayed by the candidates during the debates (note: auto-play video in that link). In his walkthrough of the implementation, Ben used Python to process the video files, and R to create the charts from the sentiment scores generated by the API.

Now, the learn dplyr blog has recreated the analysis using R. A detailed walkthrough steps through the process of creating a free Emotion API key, submitting a video to the API using the httr package, and retrieving the emotion scores as an R data frame. 

With the emotion scores in hand, the blog visualizes the data using exploratory.io, a web-based data exploration GUI based on R. With a few points and clicks (plus a little R code to wrangle the data), Exploratory produced this chart of the emotions expressed by the two candidates over time. (Click for an interactive version.) 

Exploratory

For the complete details, including the R code used to interface with the Emotion API, follow the link below.

Learn dplyr: Analyzing Emotions using Facial Expressions in Video with Microsoft AI and R

To leave a comment for the author, please follow the link and comment on their blog: Revolutions.

R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

Never miss an update!
Subscribe to R-bloggers to receive
e-mails with the latest R posts.
(You will not see this message again.)

Click here to close (This popup will not appear again)