Draft Recap Part 3: Overdrafts and Potential Busts

Now it’s time to go back to our TPR rankings and see which players represent the biggest potential “reaches” and “values”.  Today I’ll do the “reaches”.  A couple of notes before I start:

– The TPR system is only designed to analyze the first 2 rounds of the draft.  Therefore, today I will only be looking at players drafted in those two rounds.

– In general, I think we’ll be much more successful in identifying “busts” than we will be in identifying “values”.  If a player falls dramatically, my first assumption is that the league knows something that we and the media analysts do not.  It could be due to an injury risk or personality defect; neither of which we can measure.  The “busts” however, represent the reverse, where a single team picks someone well above their perceived value.  In this case, it’s likely that the team is being overconfident in its own assessment.

So who were the biggest round 1 and 2 reaches?

Below is a table illustrating the players that were most heavily “overdrafted”.  The column with red text represents the prospect draft pick minus their TPR ranking.  So if prospect X has a score here of -30, it means he was drafted 30 spots earlier than the TPR ratings suggested he should be.

Due to team differences in scheme and the relatively close ratings of a lot of prospects, we aren’t really concerned with small differences.  Large ones, however, should be very informative.Screen Shot 2013-05-01 at 10.30.06 AM

Overall, there was significantly MORE deviation than what I expected to see.  Before I break down the chart above, let me advance a theory about this draft:

It might be a lot worse than we think.

In the first round, 4 of the biggest “reaches” were for interior offensive linemen.  What might that tell us?  Well if the ENTIRE draft is weaker than we suspect (not just weak at the very top), then several teams might decide to make their picks purely based on risk.  If the risk/reward tradeoff for every player is skewed towards the risk side, then it would make perfect sense to “reach” for a relatively low-risk player like an OG or C.  By doing this, you will appear to have passed on the opportunity to select an “impact” player.  However, if there aren’t any (possible, though unlikely), coming out of the draft with a decent starter at a low impact position isn’t a bad outcome.  I hope this is not the case (and I don’t think it is), but it would explain a lot of the perplexing decisions made on day 1 and 2 of the draft.

Now back to the chart.  Here are my takeaways:

– In my opinion, the Bears had the worst draft (see the next two bullets).

– The biggest “reach” of the entire draft, based on TPR, was Jon Bostic, an ILB from Florida.  The Bears drafted him with the #50 pick, and I did not even have him in my top 137 players.  Since he’s a LB, the Bears will get the benefit of the doubt, but if you’re looking for a potential bust, he’s a very strong candidate (though in the second round it’s not as noticeable or meaningful).  He may turn into a good player, but at the very least, it appears as though the Bears should have waited a round (or two) to take him.

– Kyle Long was one of the aforementioned 1st round interior linemen “reaches”.  He was drafted #20 overall, despite a TPR ranking of just #94.  1st round Guards have a very low miss rate (Danny Watkins was a rare exception), so Long will likely have a productive career.  However, the Bears probably passed on several better prospects at more impactful positions.  This is an under-the-radar reach, since the player will probably contribute, but it represents terrible value nonetheless.

– That’s twice in the first two rounds that the Bears “got their guy” regardless of the actually value of each player.  Either the Bears know something nobody else does (or very few teams do at least), or they just screwed up.  Time will tell, but I know which side I’d bet on.

– Two RBs are near the top of the list, Christine Michael and Le’Veon Bell.  Both were taken in the 2nd round, so the bust potential is somewhat limited.  Running Backs, though, are terrible “value” picks near the top of the draft.  They’ve been proven to be, for the most part, interchangeable.  Neither of these guys (nor Bernard, also on the list), projects to be a LeSean McCoy-type impact RB.  If that’s the case, it would have been better to draft a higher rated prospect and search for a RB later.  In my success-odds table/database, second round RBs became starters just 21% of the time, well below the odds of prospects at several more impactful positions (for example, 50% of 2nd round CBs became starters).

– The Bills might have screwed up big-time with the EJ Manuel pick.  Not only was he a big “reach” by our rankings, he was also not even close to being the top QB on the board. I believe two things happened here:

1) The Bills had Manuel as “their guy”, which as you know, is a dangerous place to start from.

2) The Bills were likely bluffed into taking Manuel much higher than they needed to.  I know there have been rumors that several other teams (including the Eagles) also wanted Manuel, but given the way the rest of the draft went, it’s more likely that the Bills fell for the smokescreens.

The fact that the Bills have a less-then-sterling record when it comes to QBs only increases the inherent risk of this selection.  (Bad GM Theory)

– Everyone (including me) gave the Cowboys shit for drafting Travis Frederick early, but note that he is far from the biggest reach in these rankings.  Still, it looks like he was picked about a round too early.

– Matt Elam, picked by the Ravens, will be an interesting prospect to watch.  Since it was the Ravens and Ozzie Newsome that made the pick, everyone assumes it was a good one.  However, I’ve got it as a big reach.  I should note that Elam’s TPR ranking is lowered significantly by his NFP grade.  If I had to bet, I’d certainly pick Newsome and the Ravens over the NFP.  Regardless, given that they traded up to get him, the Ravens are representing to the world that they are extremely confident in Matt Elam being significantly better than the other safeties on the board (which they could have selected had they not traded up).

– The Eagles do make an appearance on this list, at the very bottom.  Zach Ertz was selected 15 spots higher than his TPR ranking.  As I explained on Monday, I’m not overly concerned by this, since 15 spots in the second round isn’t a MAJOR deviation.  However, it is entirely possible that Chip Kelly’s desire for a TE led the Eagles to make a poor “value” selection.  I’m betting on Chip here, and think Ertz will be a significant contributor.

For what it’s worth, here are the highest ranked guys (in TPR) that were NOT selected in the 1st two rounds:

Screen Shot 2013-05-01 at 11.14.06 AM

I’ll cover the “value” picks tomorrow, but it’s safe to say the guys listed here are potential “steals”.


8 thoughts on “Draft Recap Part 3: Overdrafts and Potential Busts

  1. The Ravens did not trade up for Elam. They won the Super Bowl, so 32 was their original pick. (You might be thinking of them trading up for Brown in the 2nd round.)

  2. More excellent analysis! Although I disagree with what I perceive as the fundamental pillar of your websites analysis; that no one can discern if any player will succeed, and that the draft, while being essentially a crap shoot, is a mere exercise in probability maximization, I think your analysis is still so spot on that it deserves serious consideration, even if, like me, you believe that specific player evaluation and scouting serves a much bigger role than you seem to grant it.

    I firmly believe, like most teams and their executives (which I admit, have an innate survival desire to espouse believe that their evaluations on specific players make a difference), that there is means, through scouting, to determine whether a player will succeed or not and good teams figure these metrics out better than poor teams. However, as a means to maximize value in a tiered draft system like the NFL draft, this analysis is extremely useful and well thought out. Great work!

    • Thanks!

      I do want to make something clear though. I DO NOT think scouting is worthless. In fact, I believe that scouts are VERY GOOD at their jobs. The fact that they are so good is exactly what makes the draft such a crapshoot.

      If scouts didn’t know anything, we wouldnt see most Pro Bowlers get selected in the first round. The historical success by round shows that the league, as a whole, is EXCELLENT at projecting talent (which is really difficult).

      HOWEVER, the question is not about Skill, it’s about RELATIVE skill. If all teams are very good at scouting, no team has an advantage, hence its a crapshoot.

      At the margins, I do think a few teams operate more intelligently than the rest, just that the effect of that “edge” is fairly small.

      Regardless, I don’t intend to convince everyone. I just want fans to think a bit more critically and realistically.

      On Wed, May 1, 2013 at 9:25 PM, Eagles Rewind

  3. Very interesting analysis. I am curious about whether your measures of “reaches” or “values” are true in previous drafts. You can use the real time data in previous drafts, compute the measures of “reaches” or “values” and see whether they correctly predict success or failure of picks (of course, the definition of success or failure must be adjusted by where they are taken).

    • I’ve done that analysis, with some good and bad results. Unfortunately, for prior years, I only have ESPN and NFL.com scouting ratings, so its not a complete apples-to-apples comparison.

      For example though, in 2010 I’ve got Tebow, Alualu, Terrell Troupe, Dexter McLuster, Nate Allen, and Rolando McClain all listed as “reaches”.

      However, Anthony Davis is also considered a “reach”.

      I probably should have included that in today’s post. That didn’t occur to me when I was writing it.

      On Wed, May 1, 2013 at 10:56 PM, Eagles Rewind

  4. There is no way of distinguishing, using your method, just how close these guys are, talent-wise.

    I mean you might have a situation where there are 20 guys ranked nearly the same, and the reaches aren’t as great as perceived when that happens, nor are the value picks that much more valuable.

    As far as the quarterbacks, I think there are several that have a decent chance to succeed but none of them seems like anything close to a sure thing.

    I also think the Cowboys first pick was influenced by a combination of great need and little salary cap flexibility. The Cowboys are in salary cap hell and look to be in that position for the next couple of years, at least. This prevents them from signing free agents that might fill holes for them.

    • Definitely a good point about the Cowboys, but if that is the case, it would still be a very poor decision in my opinion.

      I do have discrete numerical ratings on each player via the TPR system and the Consensus Ratings. So I can distinguish between guys that were closely rated and those that werent.

      I’m going to do a positional breakdown where I will show that.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s