Visualizing uncertainty using Jackknife
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.
Once again, I (re)discovered last week at the Rmetrics conference that old toolds can be extremely interesting to illustrate complex ideas, like uncertainty in fnancial markets, and stock prices. For instance a 99.5% quantile: we look for the scenario that occur with a probability of 1 out of 200. Are there nice ways to illustrate that quantity ?
Consider the monthly evolution of the SP500 index over the last 22 years,
> library(quantmod) > getSymbols('^GSPC', from='1990-01-01') [1] "GSPC" > GSPC = adjustOHLC(GSPC, + symbol.name='^GSPC') > MGSPC = to.monthly(GSPC) > CLOSE = MGSPC$GSPC.Close > plot(CLOSE)
It is possible to use Jackknife technique to illustrate uncertainty. The idea, in Jackknife, it to remove one of the observations, and to do that for all observations. More formally, from a sample , we define a (sub)sample where observation as been removed, i.e. . Then, we can study all samples when one observation was removed.
Here, in the context of financial time series, over 270 months, we can wonder what might have been the final value of the index if one observation (i.e. one month) had been removed. It is actually the idea of Jackknife,
> R=diff(log(CLOSE)); R=R[-1] > n=length(R) > X=rnorm(n,mean(R),sd(R)) > X=R > MX=t(matrix(X,n,n)) > MX=exp(MX) > diag(MX)=1 > SMX=MX > for(k in 2:n){SMX[,k]=SMX[,k-1]*(MX[,k])}
We can plot the different trajectories of the index, when we remove one month,
> init=as.numeric(CLOSE[1]) > plot(1:n,init*cumprod(exp(X)),type="l", + xlab="",ylab="",col="white") > for(k in 1:n){lines(0:n,init*c(1,SMX[k,]), + col="light blue")} > lines(0:n,init*c(1,cumprod(exp(X))),lwd=2, + col="blue")
This can be used to understand sensitivity, or unccertainty, of financial time series,
We can then look closer at the final value of the index, over those 270 scenarios,
or we also use a Box-Plot,
Here we can clearly see the impact: if we remove one good month, the index ends around 1250, while it reaches 1650 if we remove a bad month. The difference is huge. So instead of talking about volatility (which is actually a complex concept), that Jackknife idea of remove observations might be more intuitive, and much easier to get a first understanding of uncertainty. But those ideas of resampling are great. I will post a nice application soon (but first, I will discuss with some colleagues in Lyon).
R-bloggers.com offers daily e-mail updates about R news and tutorials about learning R and many other topics. Click here if you're looking to post or find an R/data-science job.
Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.