tag:blogger.com,1999:blog-38600807.post935337609077929113..comments2023-09-09T10:36:20.114-04:00Comments on Advanced Football Analytics (formerly Advanced NFL Stats): Tomlin's 4th Down Call vs. BaltimoreUnknownnoreply@blogger.comBlogger21125tag:blogger.com,1999:blog-38600807.post-12347994353339384922011-11-11T15:36:25.835-05:002011-11-11T15:36:25.835-05:00So wait, Bob: You mean Brian's model can't...So wait, Bob: You mean Brian's model can't perfectly analyse what would have happened under counterfactuals? That's it -- I'm leaving this worthless site for good!Smerdyakov with a Guitarnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-29727765248568258622011-11-10T15:19:55.275-05:002011-11-10T15:19:55.275-05:00Jonathan, how many 4 and 10s on the 30 yard line w...Jonathan, how many 4 and 10s on the 30 yard line with 2:30 left in the game up by 4 points does he have?<br /><br />the point i make is pretty simple and straightforward. <br /><br /><br />1) the probability ranges overlap<br /><br />2) "past performance does not indicate future results".<br /><br />3) bonus question . now that the team lost with a punt in that exact situation, how much does that change the probabilities when you recalculate? Punting would logically now have to be the poor choice to make, compared to a fg.bobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-17498293152793919502011-11-10T13:21:11.095-05:002011-11-10T13:21:11.095-05:00The pass incompletion was only marginally conseque...The pass incompletion was only marginally consequential. 2 min + 1 timeout is plenty of time in today's NFL to move 90+ yds. The most important thing was to get the conversion. That would have sealed the win for PIT. I think the pass gave them the best chance to do that.Brian Burkehttps://www.blogger.com/profile/12371470711365236987noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-54336018771201276242011-11-10T00:19:51.468-05:002011-11-10T00:19:51.468-05:00How damaging was the 3rd down play.
The incomplete...How damaging was the 3rd down play.<br />The incomplete pass stopped the clock.<br />A running play would have moved the clock to the 2min warning or more likely forced a timeout and improved the odds of a FG or 4th down attempt.Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-61183857913458410782011-11-09T20:50:26.682-05:002011-11-09T20:50:26.682-05:00Brian has a much larger data set than the hypothet...Brian has a much larger data set than the hypothetical 1000 coin flips you keep bringing up. He has 10 years of data from every NFL game. That's 2,560 entire games--not including playoffs.<br /><br />Besides...if you were told that a certain outcome had a 51% chance of happening, the best guess is that it's probably going to happen. If the true probability is 50.5%, that doesn't mean you're wrong. It means you're correct--you said it probably will happen, and lo, it's probably going to happen.Jonathannoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-39385401122035867212011-11-09T20:01:36.394-05:002011-11-09T20:01:36.394-05:00adam. regarding your "best guess", it ...adam. regarding your "best guess", it is extremely likely that it is incorrect.<br /><br />for instance, as you say, the "BEST GUESS" is that the coin has a 51% chance of landing heads. That is wrong.<br /><br />The next 1000 flips is extremely likely to be 510 heads. and it 75% chance of being less than 510 heads.<br /><br />and keep in mind, the NFL is vastly more complicated than a coin, it's underlying probability changes week to week, players change, coaches change, rules change, and the number of points you use to derive your best guess is far lower than 1000. <br /><br />I doubt there has ever been a case of big ben on 4th and 10 with 2:35 against baltimore in the past.<br /><br />and, even if there was, you would need several thousand to get some good estimates on the many varied outcomes.<br /><br />and even then, you'd probably come to the conclusion that going for it, fg, or punt were all similarly likely.bobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-6512942367228610852011-11-09T16:43:17.853-05:002011-11-09T16:43:17.853-05:00bob-
But regardless of the uncertainty, your BEST...bob-<br /><br />But regardless of the uncertainty, your BEST GUESS is that going for it is better. <br /><br />If you know that you don't know how a coin is weighted, and all you know is that 490 tails and 510 heads came up, your best guess should be that the coin has a 51% chance of landing heads.Adam Hnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-23252649415947955722011-11-09T13:11:55.319-05:002011-11-09T13:11:55.319-05:00also, fyi. in 1000 'ideal coin flips' the...also, fyi. in 1000 'ideal coin flips' the number of heads being greater or equal to 510 is 27.4%.<br /><br />>= 505 heads, almost 40% of the time.<br /><br />It is exceedingly unlikely to get exactly 500 heads, less than about 2% of the time.<br /><br />So, when looking at Big Ben and seeing he is 2 for 6, well i'd estimate his range as not 33% but rather 2 +- sqrt(6). <br /><br />So, his range of possiblity on making that 4th and 10 would be 0% to 70%, 90% of the time.<br /><br />for 3rd down numbers (and 10 yds) , he is 44 for 111, so about between 30% and 59% most of the time.bobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-73668290550402626642011-11-09T13:03:34.296-05:002011-11-09T13:03:34.296-05:00Ian, in that example yes I am assuming they are fa...Ian, in that example yes I am assuming they are fair.<br /><br />and in fact, they were both the same coin I merely changed the label! lol, a bit of a joke, there, but it illustrates the point. Even in the ideal world where we drew sample from a perfect and stationary (i.e. never changing) probability distribution, like a coin, we can never have prefect knowledge of what that underlying distribution is based soley on realizations. <br /><br />For the NFL, with different rules, different players, and so many chaotic outcomes (where a small change in circumstances leads to a huge difference in the outcome), then one has to keep that into account when looking at the numbers.<br /><br />I directly stated two cases, but was really thinking of all three cases (and should have stated that more clearly). There was 80%, 75%, and 74% chance of winning at that point. In terms of using this information for a gametime decision, they all basically have to be treated as indistinguishable especially in the context of what the pittsburgh steelers will do on this night against the baltimore ravens.<br /><br />The conclusion should be, when up 4 points with 2:30 left in the game, you are likely to win no matter what.<br /><br /><br />The point is not going for 4th down is a good idea, the point is anything you do in that situation is a good idea. going for 4th down is not 'terribly different' from simply taking a knee on 4th down.<br /><br />punting on 3rd down probably would not make much of a difference. nor would a FG on 3rd down. obviously, there are several insane plays that could get a coach fired that would not have significantly changed the win probability.<br /><br />That is the context of the question.<br /><br />and as I also pointed out, missing on 4th and 10 is the most likely outcome (ranging from 85% to 65 %), and would have been a disaster for the coach. <br /><br />either 1) a FG or FG miss, and the win, or 2) a succesful FG, but a loss, or 3) a punt and a win, would lead to a favorable outcome for the coach in terms of opinions on how well he did.bobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-41041908367740981882011-11-09T08:25:17.127-05:002011-11-09T08:25:17.127-05:00Bob - “Here is what you are doing, you are measuri...Bob - “Here is what you are doing, you are measuring a coin flip, and you find it is heads 48% of the time (480 out of 1000), then you take another coin and yo find it is heads 51% of the time (510 out of 1000). You then conclude that Tomlin is wrong if he calls heads for coin A, and he should have used coin A.”<br /><br />Bob, that only works if you assume the coins are both fair. Let’s say though that you know that one coin gives a head 48% of the time and the other gives a head 51% of the time. You toss the coins and get your result, A has 480 heads, B has 510 heads. The question is, what is the probability that coin B is the better choice given that I want to maximise my chances of calling a head? (97% in this case)<br /><br />Ultimately that’s what these analyses are about. We can never know the exact numbers, but we can see when the data is suggesting overwhelmingly that going for it is more likely a better idea than punting.Ian Simcoxhttps://www.blogger.com/profile/01518825067469269377noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-4919948743711309702011-11-09T07:15:37.376-05:002011-11-09T07:15:37.376-05:00Well, Tomlin presumably has a lot more information...Well, Tomlin presumably has a lot more information about his team than shown in these statistics, so it is foolish to say he made the right or the wrong decision, since the amount of information you have affects the stats.<br /><br />But I am curious about the difference in the WP from a failed FG and a failed 4th and go. Why a 5pp difference?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-16757028287249431192011-11-09T07:08:15.181-05:002011-11-09T07:08:15.181-05:00I think Tomlin was right to try to pin the Ravens ...I think Tomlin was right to try to pin the Ravens deep. Remember that the Ravens' offense had been very effective from the shotgun, and Flacco is always a threat to get one shot deep down the field, so having that extra forty-yard cushion -- and the Steelers' defense on the field! -- is a pretty solid bet.J.R.https://www.blogger.com/profile/13913599852443572486noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-38741624301740811592011-11-09T01:32:54.891-05:002011-11-09T01:32:54.891-05:00Bob makes a fair point, what is the margin of erro...Bob makes a fair point, what is the margin of error on your WP model? How big are your samples on these situations?Anonymousnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-87152295760191412082011-11-08T23:49:32.290-05:002011-11-08T23:49:32.290-05:00ok, the slightly different numbers, were presumabl...ok, the slightly different numbers, were presumably do to the difference before and after the PITT penalty that moved them back 5 yds to the 34.bobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-50719563578075885112011-11-08T23:42:17.490-05:002011-11-08T23:42:17.490-05:00er, and he should have used coin Ber, and he should have used coin Bbobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-71829309791979171562011-11-08T23:40:50.510-05:002011-11-08T23:40:50.510-05:00bob-You're a moron.
sorry for making a comm...bob-You're a moron. <br /><br /><br />sorry for making a comment. The point is right on however. You have concluded that Tomlin is wrong and he should have gone for it. There is no predictive power in this analysis.<br /><br />Here is what you are doing, you are measuring a coin flip, and you find it is heads 48% of the time (480 out of 1000), then you take another coin and yo find it is heads 51% of the time (510 out of 1000). You then conclude that Tomlin is wrong if he calls heads for coin A, and he should have used coin A.bobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-68869510257300144312011-11-08T23:29:45.480-05:002011-11-08T23:29:45.480-05:00These numbers seem to be off a bit.
"a FG at...These numbers seem to be off a bit.<br /><br />"a FG attempt (0.77 total WP) to a punt (0.75 total WP). "<br /><br /> Go4it Punt FG Att<br />WP Total: 0.80 0.75 0.74<br /><br /><br />and, my conclusion, is that all these numbers are the same, in terms of predictive power. <br /><br />The only difference is that going for it has a 15 to 30 % chance of making Tomlin look like he blew it, whereas a FG attempt has a >50% chance of tomlin looking like he made the right call, and the punt had a 75% chance of making tomlin look like he made the right call.bobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-61587546695434540502011-11-08T23:18:50.442-05:002011-11-08T23:18:50.442-05:00nice version:
bob-I'm sorry if I wasn't cl...nice version:<br />bob-I'm sorry if I wasn't clear when I wrote "either decision could be defensible depending on the particulars."<br /><br />other version:<br />bob-You're a moron. Try to read the article without skipping sentences next time. What do you not understand about the modifier "terrible"? .35 and .52 are 17 percentage points apart. The point is that the FG isn't the safe bet people think it is, and the 4th and 10 attempt isn't the long shot people think it is.Brian Burkehttps://www.blogger.com/profile/12371470711365236987noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-47547828454112665672011-11-08T23:07:08.384-05:002011-11-08T23:07:08.384-05:00seems odd that the same column that declares .77 a...seems odd that the same column that declares .77 and .75 to be an actionable difference and even to conclude the coach was wrong, yet declares .35 and .52 not terribly different.bobnoreply@blogger.comtag:blogger.com,1999:blog-38600807.post-45688182111975135522011-11-08T22:56:35.895-05:002011-11-08T22:56:35.895-05:00From your WP calculator, going for it on the 4th a...From your WP calculator, going for it on the 4th and 5 and failing has a WP of 0.74, only slightly worse than punting. Succeeding essentially puts the game away of course.Sam's Hideouthttps://www.blogger.com/profile/17861031623526621055noreply@blogger.comtag:blogger.com,1999:blog-38600807.post-44282686792645156522011-11-08T22:34:19.075-05:002011-11-08T22:34:19.075-05:00The real question is how the hell did Tomlin not c...The real question is how the hell did Tomlin not call time out? Do you have a number for how much that penalty cost them? I.e., how much of Tomlin's salary should be docked.Anonymousnoreply@blogger.com