Skip to main content

Section 27.6 Summary of Inference for Regression

Summary of Inference for Regression.

To test \(H_0\!: \beta_1 =\) hypothesized slope vs. \(H_a\!: \beta_1 \neq\) hypothesized slope
The standardized statistic: \(t = \dfrac{b_1 - \text{hypothesized slope}}{SE(b_1)}\) follows a t-distribution with df = \(n - 2\)
An approximate \(100 \times C\%\) confidence interval formula is \(b_1 \pm t_{n-2}\,SE(b_1)\) where \(-t_{n-2}\) is the \(100 \times (1 - C)/2\) percentile of the student t-distribution with \(n - 2\) degrees of freedom.
These procedures are valid as long as
  • L: There is a linear relationship between the response and explanatory variable.
  • I: The observations are independent.
  • N: The response follows a normal distribution for each value of \(x\text{.}\)
  • E: The standard deviation of the responses is the equal at each value of \(x\text{.}\)
These conditions are checked by examining the residual plots: residuals vs. explanatory variable and histogram/normal probability plot of the residuals.
Technology: Most packages automatically report the two-sided p-value. This p-value can be divided in half to obtain a one-sided p-value (assuming the observed slope is in the direction conjectured).

Discussion.

Typically, we are most interested in testing whether the population slope coefficient equals zero, as that would suggest that the population regression line is flat and so the explanatory variable is of no use in predicting the response variable. Because testing whether the slope coefficient is zero tests whether the regression model with this explanatory variable is of any use, it is sometimes called a model utility test.
There are situations where we might want to test other values of the population slope, for example \(\beta_1 = 1\) (do \(x\) and \(y\) change at the same rate?). We can also use the same approach to carry out tests and create confidence intervals for the population intercept. However, these are less useful in practice, in particular because the intercept is often far outside the range of data and does not have a meaningful interpretation.
Checking the technical conditions is an important step of the process. Notice that you will typically fit the regression model first to obtain the residuals to allow you to assess the model. As with ANOVA, these t procedures are fairly robust to departures from normality. If the conditions are violated, you can again explore transformations of the data.
You have attempted of activities on this page.