4 Comments

Summary:

The New York Times has a new online tool and Twitter feed that analyzes every fourth down in every game and gives its analysis in real time. Fans, commentators and even bosses have yet another means by which to second guess coaches’ decisions.

4thdownbot2
photo: New York Times

It’s no secret that, statistically speaking, National Football League head coaches should go for it on fourth down more often than they do. The odds have been calculated lots of times, and fans, sports radio hosts and columnists love to point to them when they think a coach made the wrong decision. But overly broad probabilities and Monday-morning quarterbacking are for amateurs thanks to a data-analysis tool from the New York Times.

The paper has created the Fourth Down Bot — a system that analyzes every fourth-down call from every NFL game against years of data involving the same down and distance, and then shares its verdict on each call online, in real time.

So that's what caused the Packers to get blown out.

So that’s what caused the Packers to get blown out.

As of the most-recent Monday Night Football game on Dec. 2, the Fourth Down Bot (whose feed is presumably manned by one of its co-creators, Brian Burke of Advanced NFL Statistics or New York Times Graphics Editor Kevin Quealy) took to Twitter and occasionally chimed in on calls there, as well.

What’s so cool about the bot’s verdicts is that they’re driven by a pretty intelligent model that’s based on expected points rather than just odds of conversion. Burke and Quealy break down the math in this post, but the gist is that the decision to go for it, punt or kick a field goal needs to take in a variety of factors, such as the opposing team’s field position if you fail and the likelihood they’ll score as a result the decision. Late in the game, the bot is set to base its decisions around the maximizing the chances of winning rather than just getting the most points.

Of course, they note, there are plenty of complicating factors that make the bot far from perfect in its assessment — weather conditions, relative strength of the teams and a dearth of data about the new NFL overtime format among them.

What’s so interesting about the bot’s mere existence (aside from the big hit it should be among stats-nerd fans) is the effect it, or another project like it, could have on how coaching is done in the NFL. Advances in technology already allow fans and commentators to see every questionable call ad nauseum and in high-definition mere seconds after they occur. Now, thanks to advances in computing, data processing and a medium like Twitter (or the Fourth Down Bot’s specific sites for each team), everyone is also able to access a fairly valid judgment of every potentially game-shifting fourth down. (To be fair, in the Packers-Vikings game above, the bot only disagreed with the Packers coach on 2 of 12 fourth-down attempts, and on 3 attempts it said “It’s complicated.”)

4thdownbot2

As we’ll discuss in great detail at our Structure Data conference in March, big data has forced corporate executives, from CEOs down to business managers, to rethink how they make decisions and build products. It has already had a major impact in the management ranks of professional sports teams, where advanced analytics play a big role in deciding who’s on the rosters.

Now, perhaps, it can finally crack the toughest eggs of all — NFL coaches and their gut feelings that usually tell them to do the prudent thing while millions of people are screaming “Go for it” at their TVs. With this level of scrutiny and a job requirement to win at all costs, maybe listening to the data a little bit isn’t such a bad idea.

  1. Paul Romer actually did research on this and turns out that if it’s close than 4th and 3 (or thereabouts) teams should be going for it instead of punting it almost every time (and it costs them half a win a year!)

    http://www.nytimes.com/2010/09/05/sports/football/05romer.html

    Share
    1. Donnie Berkholz Saturday, December 7, 2013

      That’s exactly what the graph on the left shows, and the creators cited Romer’s paper in their post.

      Share
  2. There is a High School that NEVER punt, ALWAYS goes for it on 4th down. PS: I believe they are multiple conference champions, and if I’m not mistaken have won several state titles. Any NFL Coach listening?

    Share
  3. Honestly, the computer says to “go for it” on 4th and 2 on your own 10 yard line! The bot clearly doesn’t have a multi-million dollar job to lose….

    Share

Comments have been disabled for this post