Congruential generators all are RANDUs!

Posted on January 30, 2010 by xi'an in R bloggers | 0 Comments

[This article was first published on Xi'an's Og » R, and kindly contributed to R-bloggers]. (You can report issue about the content on this page here)

Want to share your content on R-bloggers? click here if you have a blog, or here if you don't.

In case you did not read all the slides of Regis Lebrun’s talk on pseudo-random generators I posted yesterday, one result from Marsaglia’s (in a 1968 PNAS paper) exhibited my ignorance during Regis’ Big’ MC seminar on Thursday. Marsaglia indeed showed that all multiplicative congruential generators

$r_{i+1}= kr_i text{modulo }m$

lie on a series of hyperplanes whose number gets ridiculously small as the dimension d increases! If you turn the $r_i$ ’s into uniforms $u_i$ and look at the d dimensional vectors

$pi_1=(u_1,ldots,u_d),,pi_2=(u_2,ldots,u_{n+1}),,ldots$

they are on a small number of hyperplanes, at most $(d!m)^{1/m}$ , which gives 41 hyperplanes when $m=2^{32}$ … So in this sense all generators share the same poor property as the infamous RANDU which is such that that $(u_{i},u_{i+1},u_{i+2})$ is always over one of 16 hyperplanes, an exercise we use in both Introducing Monte Carlo Methods with R and Monte Carlo Statistical Methods (but not in our general audience out solution manual). I almost objected to the general result being irrelevant as the $pi_i$ ’s share $u_j$ ’s, but of course the subsequence $pi_1,pi_d,pi_{2d},...$ also share enjoys this property!