...but the running game probably doesn't help at all.
I previously thought that the "defense wins championships" theory was conventional wisdom bunk. But after doing a new analysis, I think it might be true. It's the importance of the running game, however, that really surprised me.
In a recent post, I illustrated the distribution of offenses and defenses in terms of total efficiency (yards per play). The distribution for offensive efficiency was wider than for defensive efficiency. This indicated that "good" offenses were better than the equivalent "good" defense. In other words, the best offenses in the league tend to get more yards per play above average than the best defenses in the league give up below average.
"Having a good running game is not only unimportant, it actually seems counter- productive."
However, that analysis was for regular season games. Post season games comprise a smaller sample size, usually too small for very meaningful analysis. They're also biased in certain ways. For example, the home team is usually the better team, and it would therefore be hard to separate the advantage in team strength from home field advantage. But the biggest difference between the regular and post seasons is the level of competition.
As an indirect way to infer tendencies about post-season competition, I analyzed regular season games that featured only opponents that would go on to win at least 10 games. I think this criteria best reflects the level of competition usually found in the playoffs. Although 9-win or even 8-win teams occasionally make the playoffs, many do not. Plus, 9 wins is only 1 win above a .500 win percentage, and a 9-win team has never won a championship.
First, I looked at how important various team stats were in determining the winner of match ups between 10+ win teams. I looked at offensive running and passing efficiencies, turnover efficiencies, penalty rates, and home field advantage. The data is from the 2002-2006 seasons, and there were 114 such games between "good" teams. (The stats used here are year-long stats, not stats only within that particular game.)
Instead of an advanced regression analysis, I started by looking at how often a team with an advantage in each particular stat won. The table below lists various team efficiency stats along with the win percentage of the team superior in that stat. For example, the team with home field advantage won 59.6% of the match-ups between 10+ win teams. And the team with the better offensive pass efficiency won 52.6% of the match-ups. The winning percentage for all regular season games is included for comparison. Significant differences in winning percentages between good vs. good games and all games are noted.
| Stat | Good vs. Good
| All Reg Season |
| Home | 59.6 | 57.4
|
| O Run** | 45.6 | 55.0
|
| D Run | 48.2 | 50.0
|
| O Pass** | 52.6 | 63.8
|
| D Pass** | 51.8 | 59.8
|
| O Int Rate** | 50.9 | 59.5
|
| D Int Rate | 55.3 | 59.4
|
| O Fum Rate | 55.3 | 60.8
|
| D FFum Rate | 54.4 | 58.0
|
| Pen Rate* | 47.3 | 54.1
|
** = difference is significant at the p=0.05 level
* = difference is significant at the p=0.10 levelWhat immediately strikes me is that being good in the running game, both on offense and defense, appears to be no help in beating other good teams. Teams with the better offensive running efficiency won only 45.6% of the games, and teams with the better defensive running efficiency won only 48.2% of the games.
Teams with superior passing, fumbles, defensive interception rate, and penalties win slightly more than 50%-55% of the games. I'm surprised passing efficiencies don't appear to be more important. The stats that tend to be more random, such as fumbles and interceptions, appear to make the biggest difference. This result may be due to the fact that when good teams play each other stats like passing efficiency and offensive interception rates are very good for both teams, and the difference is in the more random stats.
"When teams very close in ability meet, the more important other factors such as randomness and home field advantage become."
Home field advantage also appears more important than is typical in the NFL. Home teams usually won 57.4% of all regular season games in the period studied. In the good team vs. good team match-ups, home field advantage appears slightly stronger. Again, the closer the teams are in ability, the more important other factors become.
But having a good running game is not only unimportant, it actually seems counter-productive. How can this be? (First, I should note this is not a regression tested for significance, but with 114 observations, and the fact that
both offensive and defensive running abilities appear unhelpful, the results are likely somewhat meaningful.) If true, my theory is that winning teams that count on the running game to win might overuse the run against better opponents. Leaning on the running game wouldn't help, and may actually hurt.
Running too frequently would do harm because the pass does have a
higher expected return per attempt (link requires registration), even accounting for the possibility of an interception. Every run attempt precludes a pass attempt, reducing ultimate effectiveness.
To get a better context of the results in the table above, I also calculated the winning percentage of teams with superior stats for other types of match-ups. I analyzed "bad vs. bad" match-ups which featured both opponents that ultimately earned 9 or less regular season wins. Also analyzed were "good vs. bad" match-ups which featured a 10+ win team against a 9- win team. (I realize 9 wins is not "bad," but it's a lot shorter than "other than good.")
The winning percentage of teams with the better stat are listed for each type of match-up in the table below.
| Stat | Good vs Good | Bad vs Bad | Good vs Bad |
| Home | 59.6 | 57.0 | 56.0 |
| O Run | 45.6 | 53.7 | 55.8 |
| D Run | 48.2 | 51.4 | 67.9 |
| O Pass | 52.6 | 63.6 | 65.4 |
| D Pass | 51.8 | 59.8 | 63.7 |
| O Int Rate | 50.9 | 59.5 | 53.8 |
| D Int Rate | 55.3 | 59.4 | 57.3 |
| O Fum Rate | 55.3 | 60.5 | 63.7 |
| D FFum Rate | 54.4 | 58.0 | 62.3 |
| Pen Rate | 47.3 | 53.8 | 71.9 |
The results for the other types of match-ups seem to make sense. Being superior in any of the stats does not appear to be unhelpful (as with running in the good vs. good match-up). The bigger the difference in team record, the larger we would expect the difference in each team stat. Accordingly, the winning percentages are higher for the bad vs. bad and good vs bad match-up types than the good vs. good match-up type.
I could go on and on with observations. Penalty rates appear critical in good vs bad match-ups, offensive passing efficiency appears most important in the bad vs. bad match-ups, etc. I'll leave it to others to draw their own inferences.
Ultimately, when teams very close in ability meet, the more important other factors such as randomness and home field advantage become. Playoff teams are by definition relatively similar in ability, so home field and randomness become critically important. Turnovers are the most random of the stats,
especially defensive turnover efficiency. Perhaps then it is
randomness that wins championships. And because defensive performance trends are more random than offensive trends, perhaps that's why we see defense as more important come January.