[R] R: ridge regression
Clark Allan
Allan at STATS.uct.ac.za
Wed Feb 16 11:58:33 CET 2005
hi all
a technical question for those bright statisticians.
my question involves ridge regression.
definition:
n=sample size of a data set
X is the matrix of data with , say p variables
Y is the y matrix i.e the response variable
Z(i,j) = ( X(i,j)- xbar(j) / [ (n-1)^0.5* std(x(j))]
Y_new(i)=( Y(i)- ybar(j) ) / [ (n-1)^0.5* std(Y(i))] (note that i have
scaled the Y matrix as well)
k is the ridge constant
the ridge estimate for the betas is = inverse(Z'Z+kI)*Z'Y_new=W*Z'Y_new
the associated variance covariance matrix sigma*W*(Z'Z)*W where sigma is
the residual variance based on the transformed variables
if we transform the variables back to the original variables the beta
estimates are now: beta(j)= std(y)*betaridge(j)/std(x(j))
but what is the covariance matrix of these estimates???
i know that this might not be the correct forum for this question, but
since i know that many users are statisticians i know that i will get an
informed response.
More information about the R-help
mailing list