Monday, January 20, 2020

Outs Above Average

Mike Petriello at mlb.com has a story about the new fielding metric called "Outs Above Average" or OAA. He links to a much more detailed background piece by Tom Tango on the MLB Tech blog. Both are long but are worth a look--there is a whole new world out there because of Statcast and we have to start learning about it. I should note that the articles are particular to the infield component of OAA, the outfield stuff is handled differently.

Since all batted balls are tracked (via radar) and the movements of all the players tracked as well (via stereo camera systems) the combination of the two technologies allows for the measurement of speed, direction, distance, and more on every play. Nowadays the "eye test" is not simply something a fan can do from his or her seat (at the game or in front of the TV) but an actual data record that can be revisited at MLB's clearinghouse site for Statcast data, Baseball Savant.

Fielding is a tough nut to crack and it is especially tough in this era because of infield shifts. Something like one-third of all pitches last season involved at least one shifted infielder! DRS and UZR have become part of the new saber-landscape but they will likely be supplanted by OAA simply because it is built on some of the things that the earlier stats relied on and is enhanced with real-game information. Not only that, it is a computer model which of course can be refined as new data come in and new problems with measurement and evaluation get solved (or at least improved upon).

The argument for OAA is that it is intuitive. We, as fans, naturally "compute the odds" as we watch a play unfold. We see the shortstop chase down a ball in the hole and think about the runner heading to first and "calculate" the probability that the throw will get there before him. When the runner is safe we wonder if perhaps the runner was faster than we expected, the fielder had a hitch in his throw, the ball was further into the outfield grass than we thought, etc. We've seen many many such plays and have a sense of what should work and when and thus we can be surprised by an unusually strong throw or quick feet by the fielder or dismayed by a failure to get what should have been an out.

OAA determines the likelihood of success for the fielder depending on how far he has to go to get the ball, how fast the ball was hit, and how quickly the runner gets down the line. Good fielders convert more "unlikely" chances and make the "routine" plays a higher percentage of the time. Like I said we do this in our heads anyway, without actual numbers but with a large history of observations. Would it surprise you that Javier Baez, Nolan Arenado, and Andrelton Simmons rate the best on this metric? Right now OAA can't include everything (like double plays, pitcher failing to cover a base, etc.) but it's a good start. I think we might have a real defensive stat emerging that we can rely on.

--M.C.


p.s. Do you want to know how Giants infielders were ranked in 2019? Go to the Statcast leaderboards and select Infield Outs Above Average from the pull-down menu and you'll find out. (Brandon Belt was 61st overall and 8th among first basemen, and Evan Longoria was 55th overall and 11th among third baseman, for example. Sadly, Brandon Crawford was 189th overall and 27th among shortstops. That seems to fit with what we watched. Every player has a specific profile that provides more granular information. Warning: major time sink!)

14 comments:

nomisnala said...

how does Brandon Crawford being 27th among shortstops fit with what we watched? I watch a lot of games, not just giants games, and it seems to me that 27th, assuming the 27th means that there are 26 that did better than he did, seems not to be consistent with the eye test. If one just watches the giants and saw the regression, than we know he is not as good as he once was, but if folks watch games across baseball, 27th seems unrealistic. Makes me think that there are flaws in the system.

M.C. O'Connor said...

Foot speed. Craw is one of the slowest men in baseball. I love the guy, and he's a wizard, but he's not fast anymore. Certainly the rankings could be suspect, but if you assume there are, say, 50 guys who play SS regularly in the bigs, then 25th would be the mean. Craw is, in my eye test, right at the level of "average" for the SS position. He used to be elite, at worst "above average," but I don't think so any more. Take a look at the breakdowns on Baseball Savant. 2019 was a real drop-off for him. Let's hope he's healthier and fitter in 2020 and that he has a good backup (Solano? Dubon?).

M.C. O'Connor said...

Giants pick up a Javier Lopez clone, LOOGY Jerry Blevins. He pitched for the Nats against the Giants in the 2014 LDS. Obviously there won't be LOOGYs anymore, so he has to get righties out, too! He's a good pitcher with a lot of experience (almost 500 IP over 13 seasons) and adds some southpaw depth. It's a minor-league deal with an invite to Spring Training.

M.C. O'Connor said...

I took at look at the outfielder ratings for OAA (Outs Above Average) on Baseball Savant. There are 92 listed, the cutoff is a minimum of one fielding attempt per team game played. (If you change the qualification to a minimum of 100 opportunities you get 135 players.)

Victor Robles, Kevin Keirmaier, and Lorenzo Cain are the top-rated. Guys near the bottom are Shin-soo Choo, Kyle Schwarber, and Ryan Braun. That seems right.

Steven Duggar (31st), Mike Yaz (34th), and Kevin Pillar (39th) are the Giants representatives. I would say all of those guys are capable, above-average fielders, and the numbers bear that out. Pillar was a human highlight film but that doesn't seem to help his overall rating. He had a much higher OAA in 2016, the first year of the system.

It's nice to have a guy who is exceptional, but it may be more important to have consistently solid play from multiple guys. Making the "routine" plays every time and avoiding big mistakes are very valuable skills. You don't have to rob guys of homers to be a positive contributor.

Speaking of Pillar, I've yet to see any action on him. You'd think he'd get a minor-league deal and/or NRI from somebody!

Free agents Nicholas Castellanos and Marcell Ozuna rate poorly (78th and 83rd), by the way.

M.C. O'Connor said...

Tyson Ross (RHP) is the latest NRI, along with left-handed hitting catcher Rob Brantly.

M.C. O'Connor said...

Giants claimed Luis Madero (RHP)from the Angels. They cut Jake Jewell (RHP) to make room. They got Jewell from the Angels, too. They cut Zack Cozart to make a spot for him. They got Cozart from the Angels.

Waiver claims from the Angels are like the red-shirts on Star Trek.

Welcome to the Giants, Luis Madero!


M.C. O'Connor said...

Felipe Alou's son (Moises' half-brother) Luis Rojas is now manager of the Mets.

Marcell Ozuna signs a one-year deal for $18M (ATL). He's likely a 3-WAR player. He has a QO attached, that may have slowed down his market. Weird that a talented guy like that drew so little interest--he'll be a FA next year at age 30 but with no QO.

Seems like Front Offices are not taking big risks on the mid-level free agents. Ozuna does not have Pillar's defensive skills, but he hits one hell of a lot better. I think if Pillar hit a bit above league average instead of a bit below he might have a job!

nomisnala said...

I want to say this about speed and quickness. Crawford never had much speed, but he has what I call off the bat fielding quickness. That is, his anticipation skills, give him a (foot up) on many because he has this ability. When he does not react quickly to a ball, it seems like an out take, which does happen occasionally. But his ability to get a good jump on a ball makes up for a lot of his slowness afoot. Would be nice to see separate ratings for hand speed, foot speed, and anticipatory quickness. I think Crawford has good hand speed and anticipatory quickness. He also has so called soft hands for making minor adjustments on ground balls. Of course I have not mentioned throwing velocity and accuracy.

M.C. O'Connor said...

I don't get to see other shortstops too much and it's hard to compare BCraw to those guys. But that's who he is up against. Arizona's SS Nick Ahmed, for instance, rates very high on defense in the OAA system. I'm just learning to fiddle with the Baseball Savant options, and I'm trying to compare BCraw with Ahmed. Mostly--so far--it is a range and positioning issue. Ahmed converts more plays to both his left and right side and the two SS are about the same playing straight up. BCraw, when playing up the middle or over on the 2B side, is not as effective converting chances as Ahmed. This I can't verify via the eye test because I don't see Ahmed play enough.

Overall the stat credits Ahmed with 16 OAA and BCraw with -4 OAA.

Other metrics agree. Last year Ahmed rated 2.6 dWAR (Baseball-Reference's defensive WAR stat) and BCraw 0.6, his lowest ever. Ahmed 1.9 UZR, BCraw -0.4 UZR. Ahmed 18 DRS, BCraw 0 DRS. It's not a pretty picture and the consistency across all the various ways to measure fielding is actually alarming. (I don't use those other stats for defense on this blog because I don't fully grasp them and I've had a hard time matching them with my "eye test." But the OAA thing is really making sense for me.)

BCraw was not himself last year and he's been in decline for a couple of seasons. I'm hoping improved fitness regimes and coaching will help him bounce back.


nomisnala said...

I think the eye test alone for me at this point in time Ahmed is by far the better fielder. For me, Crawford went from a top 5 or 6, guy, to a middle of the pack guy by last year. But certainly not a lower end of the pack guy.

M.C. O'Connor said...

Giants signed 33 year old Darin Ruf to a minor league deal. RH 1B/OF type with pop. Played in KBO last three seasons, before that he was with Philly.


M.C. O'Connor said...

Pat the Bat comes back: he will be the hitting coach at A-league San Jose. Burrell went to Bellarmine HS. Other Bellarmine alums are Kevin Frandsen and Eric Thames.

nomisnala said...

Wasn't Pat Burrell a fellow hurricane with Aubrey Huff? The current Aubrey Huff who has seemed to have gone off the deep end on several issues.

M.C. O'Connor said...

I'm hoping the Jesuits knocked a little logic into him while they had him in their grasp.