Skip to main content

Section 27.7 Technology Exploration: The Regression Effect

Exercises The Study

In the 2018 Masters golf tournament, Jordan Speith had a score of 66 in the first round but a score of 74 in the second round. Keep in mind that in golf, lower scores are better than higher scores. Is this evidence that he choked? The data file Masters18.txt contains golfers’ scores in the first two rounds of the 2018 Masters.

1. Scatterplot and Correlation.

Use technology to construct a scatterplot of second round score vs. first round score. Also calculate the correlation coefficient between these two variables. Does it reveal an association between scores in these two rounds? If so, is it positive or negative? Would you call it weak, moderate, or strong?
Solution.
described in detail following the image
Scatterplot of second round score (R2) versus first round score (R1) for the 2018 Masters golfers, showing a scattered cloud of points with a weak to moderate positive association.
\(r = 0.345\)
There is a moderate, linear, positive association between the round1 and round2 scores.

2. Sort and List Extremes.

Use technology to sort the data according to the golfers’ first-round scores:
Hint 1. R Instructions
mydata=data.frame(golfer, round1, round2)
sortdata=mydata[order(mydata[,2]),]
Hint 2. JMP Instructions
Select Tables > Sort.
Add the round1 column to the By list. Then add the golfer and round2 columns.
(Note: JMP will sort in the order the columns are entered in the By box.)
You can change from ascending to descending order if you like, and you can check the Replace Table box if you wish to overwrite the original table (not recommended).
described in detail following the image
JMP Sort dialog with round1, golfer, and round2 in the By list and By and Remove buttons.
List the ten golfers who scored lowest in the first round, along with their scores in both rounds. Then list the ten golfers who scored highest in the first round, along with their scores in both rounds.
Solution.
Top ten:
Golfer Round 1 Round 2
JordanSpieth 66 74
TonyFinau 68 74
MattKuchar 68 75
PatrickReed 69 66
HenrikStenson 69 70
RoryMcIlroy 69 71
CharleyHoffman 69 73
AdamHadwin 69 75
LiHaotong 69 76
RafaelCabrera 69 76
Bottom ten:
Golfer Round 1 Round 2
RossFisher 78 74
TrevorImmelman 78 75
GaryWoodland 78 76
MarkO’Meara 78 81
KiradechAphibarnrat 79 70
IanWoosnam 79 76
LinYuxin 79 80
SergioGarcia 81 78
MattParziale 81 79
HarryEllis 86 80

3. Improvement Counts.

How many of the β€œtop ten” from the first round improved (scored lower) in the second round than the first? How many of the β€œbottom ten” from the first round improved?
Solution.
For the top ten: one golfer (Patrick Reed) had a lower second round score
For the bottom ten: Eight of the ten golfers improved (lowered) their scores

4. Compare Improvement Rates.

Which group saw more people improve? Is this difference small or substantial?
Solution.
The bottom ten group saw substantially more (8 vs 0) people improve.

5. Median Round-2 Scores.

Determine the median second round score for the two groups (the β€œtop ten” from round one and the β€œbottom ten” from round one). Which group tended to score better (lower) in the second round?
Solution.
The median (sorting first) round 2 score for the top ten is 74 and for the bottom ten it’s 77. The top ten golfers tended to score better than the bottom ten golfers in the second round.

6. Add the \(y = x\) Line.

Add the β€œ\(y = x\)” line to your scatterplot.
Hint 1. R Instructions
lines(round1, round1)
Hint 2. JMP Instructions
Click the red Bivariate Fit arrow and select Fit Special; Check the box for Constrain Intercept to: and put 0 in the box; Check the box for Constrain Slope to: and put 1 in the box; Click OK.
Identify any golfers by name who improved in the second round after scoring in the top ten of the first round. Identify any golfers by name who did worse in the second round after scoring in the bottom ten of the first round.
Solution.
described in detail following the image
Scatterplot of R2 versus R1 with the y equals x line added; the top-ten golfers are boxed at the lower left with one point below the line, and two bottom-ten points are marked above the line at the right.
One golfer from the original top ten (on the left) is below the line (Patrick Reed, the eventual champion) and two from the original bottom ten are above the line (Mark O’Meara and Lin Yuxin). [Two golfers in the original top ten had identical scores in the two ground.]

7. Evaluate the \(y = x\) Line.

Do you think the β€œ\(y = x\)” line does a good job of summarizing the relationship? How do you think the regression line will compare? Will the slope be greater or smaller?
Solution.
The line doesn’t really go through the β€œmiddle” of the points. It’s too low for small round 1 scores and too high for larger round 1 scores.
Expect the regression line to have a smaller slope.

8. Add the Mean Line.

Add the \(\bar{y}\) line to the scatterplot.
Hint 1. R Instructions
abline(h=mean(round2))
Hint 2. JMP Instructions
Click the Bivariate Fit hot spot and select Fit Mean.
Do you think this line does a good job of summarizing the relationship? How do you think the regression line will compare? Will the slope be greater or smaller?
Solution.
described in detail following the image
Scatterplot of R2 versus R1 with the y equals x line and a horizontal dashed line at the mean second-round score of 74.56.
This line does not summarize the relationship well either. It’s a little too high for lower round 1 scores and too low for higher round 1 scores. We expect the regression line to have a larger slope.

9. Add the Regression Line.

Now add the regression line to the scatterplot.
Hint 1. R Instructions
abline(lm(round2~round1), col=3)
Hint 2. JMP Instructions
Click the red Bivariate Fit arrow and select Fit Line.
Where does the regression line fall compared to the two earlier lines?
Solution.
described in detail following the image
Scatterplot of R2 versus R1 with three lines: the steep y equals x line, the horizontal mean line at 74.56, and the red regression line falling between them.
The regression line falls β€œin between” the other two lines

10. Regression Equation and Slope.

Determine the regression equation. Is the slope less than one? Explain why this is to be expected whenever the two standard deviations are similar.
Hint.
Recall that the slope coefficient can be expressed as \(b = r(s_y)/(s_x)\text{.}\)
Solution.
The regression slope of .3533 is less than one, in fact very close to the value of \(r\text{.}\)

11. Regression to the Mean Interpretation.

Explain why your answer to Question 10 suggests that golfers with poor first round scores will tend to improve but golfers with good first round scores will tend to worsen.
Solution.
We expect poor first round scores to be below the mean but not by as much. We expect good (low) first round scores to be followed by second round scores that are above the mean but not by as much (by a fraction).
This phenomenon is sometimes called the regression effect or regression to the mean. Sir Francis Galton first discussed this effect in the late 1880s when he examined data on the heights of parents and children, calling it regression to mediocrity.
You have attempted of activities on this page.