Problem of Intervening Variables: Spurious Relationships
- x= ice cream sales; y=violent crime; z= heat waves
- x= ice cream sales; y=drownings; z= heat waves
- x= number of electrical appliances; y=decreased birth rates; z= industrialization
- x= smoking; y=lung cancer; z= tissue damage
- x= age; y=reading ability; z= education
- The DV is continuous and free from outliers (EXPLORE vs. DESCRIPTIVES)
- The IVs (predictors) are continuous and free from intercorrelation/multicolinearity (CORRELATE. Tolerance/VIF)
- intercorrelations among predicters should be low. There is no specific cut-off.. some say .60,
others not sure, and some say none of these.
- Considering that .70 suggests about 50% shared variance, we can use this as a cut-off
- If tolerance is less than .20, a problem with multicollinearity is indicated.
- when VIF is high there is high multicollinearity and instability of the b and beta coefficients.
- VIF >= 4 is an arbitrary but common cut-off criterion for deciding when a given independent variable displays "too much" multicollinearity
- values above 4 suggest a multicollinearity problem
- Some researchers use the more lenient cutoff of 5.0 or even 10.0 to signal when multicollinearity is a problem.
- We will use the combination of tolerance and VIF to determine...
- The subject-to-predictor ratio is not below 10:1... 15:1 is ideal
- The IVs are free from outliers
- Z-residuals (less than 3)
- Mahalanobis' distance (p>.05; see Stevens p. 108) and Cook's distance (less than 1.0)
In order to control for "shrinkage" (reduction in the predictive power of the regression equations; observation that a fitted relationship appears to perform less well on a new data set than on the data set used for fitting: the value of the coefficient of determination 'shrinks'):
- Correlations between predictor variables should be inspected. When pairs of variables have correlations higher than .70, you should consider:
- removing one of the correlated predictors (usually the one with the lowest r with the DV) or
- combining the correlated predictors (average, sum, etc)
- the ratios of subjects-to-predictors in the main regression analyses should at least 15:1.
- and adjusted R2 coefficients should be used as a conservative estimate of explained variance (in all regression analyses).
- Default values for the probabilities of "F-to-enter" (.05) and "F-to-remove" (.10) should remain constant for all of the regression analyses.
- Dependent measures should be analyzed for "outliers" by inspecting Z-scores of residuals. No significant effects of outliers, as measures by Z-scores greater than three standard deviations from the mean, should be noted on the dependent variable. Outliers on predictor variables should be identified using Mahalanobis' Distance Formula, and analyzed for their influence on the regression equations using Cook's Distance Formula.