Product revenue prediction with R – part 1

In my upcoming three blogs, I am going to discuss about how Product managers, Data analyst and Data scientists can develop model for the prediction of the transactional product revenue on the basis of user actions like total numbers of time product added to the cart, total numbers of time product added to the cart, total numbers of page view of product and more. Product managers and data scientists can use linear regression tool for model based predictive analysis on business data here. We will apply regression learning on product transactional data for defining most effective variables that can impact on product transactional revenue. In this blog, I will discuss about how can we develop prediction model on GA dataset and what are the summary statistics of the model. First, we will see how data analyst can get transaction related dataset from source (Google Analytics) for predictive analysis of product revenue.

Business Dataset:

For business analytics, we require set of product purchase historical data on which we can perform analysis operations. We  use Google Analytics for capturing datasets like product name, product SKU for purchase items, numbers of instances removed from the cart, total numbers of product page view, item revenue and more.

After capturing data from Google Analytics, we store it on our Mongo Instance on Amazon server. With RMongo Package we can load datasets in R-studio (is free and open source integrated development environment (IDE) for R) or can also use r-google-analytics  for doing the same.

As we know, business data can be either numerical or categorical. Suppose, if we take product revenue and number of product page views then they will be considered as Numerical Data.  But if we take product-name and country-name then they will be considered as  Categorical Data.

We have available extracted Google Analytics dataset which looks like below that we used for Shopping cart analysis in last post.

[click on image for full-size image]

We have collected list of necessary variables from available Google analytics dataset for predictive model development, which are

1. yitemrevenue – Item Revenue at Rs
2. xcartadd – Numbers of instance added to cart
3. xcartuniqadd – Numbers of unique instance added to cart
4. xcartaddtotalrs –Total Rs value of products after they are added to cart
5. xcartremove- Numbers of instances removed from cart
6. xcardtremovetotal – Total numbers of instances removed from cart
7. xcardtremovetotalrs – Total  Rs after numbers of instances removed from cart
8. xproductviews – Numbers of page views
9. xuniqprodview – Numbers of uniqe product views
10. xprodviewinrs – Rs at total numbers of page views

After collecting the necessary data, we are ready to develop predictive model in R. Here, we require a response variable and explanatory variables for regression modeling. The element which is predicted is called the response variable. The variables by which we are going to predict the response variable are called the explanatory variables. In the next part, we will develop model with regression tool.

Model development in R:

Since  we are trying to describe the relationship between product revenue and user behavior, we will develop a regression model with  product revenue as the response variable and the rest are explanatory variables. With this  relationship, we can predict transactional product revenue. We have separated the dataset in response variable and explanatory variables as:

Response variable:

1. yitemrevenue – Item Revenue at Rs

Explanatory variables:

1. xcartadd – Numbers of instance added to cart
2. xcartuniqadd – Numbers of unique instance added to cart
3. xcartaddtotalrs –Total Rs after instances added to cart
4. xcartremove- Numbers of instances removed from cart
5. xcardtremovetotal – Total numbers of instances removed from cart
6. xcardtremovetotalrs – Total  Rs after numbers of instances removed from cart
7. xproductviews – Numbers of page views
8. xuniqprodview – Numbers of uniqe product views
9. xprodviewinrs – Rs at total numbers of page views

Now, we can assume that this dataset is ready for preparing the linear regression model. In R, we can use lm() function for implementation of linear model with following syntax.

> fit <- lm(formula,data)

Here, (fit) object is linear model and (data) is data object to be applied in the model. A model can be developed using the following code

> model <- lm(formula=yitemrevenue ~ xcartadd + xcartuniqadd + xcartaddtotalrs + xcartremove + xcardtremovetotal + xcardtremovetotalrs + xproductviews + xuniqprodview + xprodviewinrs , data = data)

Here, model object  is regression model in which we are interested in. We have implemented it by above formula, (~ ) sign separates the response variables with explanatory variable. Variable on the left side of the sign is the response variable and on the right are explanatory variables. We can check summary statistics of the model with the summary function in R. With summary statistics, we can measure the prediction accuracy of model. Here is summary of our linear model

> summary(model)
Call:
lm(formula = yitemrevenue ~ xcartadd + xcartuniqadd + xcartaddtotalrs +
    xcartremove + xcardtremovetotal + xcardtremovetotalrs + xproductviews +
    xuniqprodview + xprodviewinrs)
Residuals:
   Min     1Q Median     3Q    Max
-22489   -143    -58    -34  37838
Coefficients:
                      Estimate Std. Error t value Pr(>|t|)
(Intercept)          3.544e+01  2.325e+01   1.524 0.127464
xcartadd            -5.209e+01  1.343e+01  -3.878 0.000107 ***
xcartuniqadd         4.220e+01  1.786e+01   2.362 0.018208 *
xcartaddtotalrs      7.089e-02  2.406e-03  29.465  < 2e-16 ***
xcartremove         -5.810e+01  3.842e+01  -1.512 0.130598
xcardtremovetotal    4.299e+02  5.430e+01   7.917 3.09e-15 ***
xcardtremovetotalrs -7.004e-02  2.066e-02  -3.390 0.000705 ***
xproductviews        9.629e+00  9.405e-01  10.238  < 2e-16 ***
xuniqprodview       -1.097e+01  1.080e+00 -10.159  < 2e-16 ***
xprodviewinrs        2.344e-04  4.456e-05   5.261 1.51e-07 ***
---
Signif. codes:  0 ‘***’ 0.001 ‘**’ 0.01 ‘*’ 0.05 ‘.’ 0.1 ‘ ’ 1
Residual standard error: 1351 on 4174 degrees of freedom
Multiple R-squared: 0.7109,	Adjusted R-squared: 0.7103
F-statistic:  1140 on 9 and 4174 DF,  p-value: < 2.2e-16

And this summary has list of parameters like

Residual Sum of squares(RSS)  =

Degrees of Freedom (DF) = Length of rows in your dataset – Total numbers of your explanatory variables

Residual standard error =

Multiple R squared error  =

pr  = probability for variable to be included into the model, it should be less than 0.05 for a variable to be included.

t values =

Vignesh Prajapati

Vignesh is Data Engineer at Tatvic. He loves to play with opensource playground to make predictive solution on Big data with R, Hadoop and Google Prediction API.
Google Plus profile: Vignesh Prajapati