Forum Home

Master Index of Archived Threads


Pecota Projections

soupcan
Nov 13 2005 12:11 PM

From today's New York Times...

Based on this, Omar might want to think twice before throwing $40 mil over 4 years at our friend Mr. Wagner...


November 13, 2005
Keeping Score
Predicting Futures in Baseball, and the Downside of Damon
By ALAN SCHWARZ
INDIAN WELLS, Calif., Nov. 11 - Thad Levine was distracted. As Levine, the assistant general manager of the Texas Rangers, conversed one evening at last week's Major League Baseball general managers meetings, his eyes kept wandering to an enticing packet of paper sitting on a nearby coffee table: the 2006 Pecota Projections.

For the growing number of baseball executives bent toward statistical analysis, a certain anticipation builds every off-season for the release of what is known simply as Pecota, Baseball Prospectus's überforecast of every player's performance the next season. Most front offices have an employee who consults it - particularly during the free-agent season. "Signing someone to a three- or four-year deal is a risk-management business decision," Levine said, leafing through the pages. "This tool does a fantastic job of managing expectations for what the player will do for you."

What separates Pecota from the gaggle of projection systems that outsiders have developed over many decades is how it recognizes, even flaunts, the uncertainty of predicting a player's skills. Rather than generate one line of expected statistics, Pecota presents seven - some optimistic, some pessimistic - each with its own confidence level. The system greatly resembles the forecasting of hurricane paths: players can go in many directions, so preparing for just one is foolish.

Take Johnny Damon, the Red Sox center fielder considered one of this off-season's most attractive free agents. Pecota examines many factors beyond his raw statistical record - the effect of playing in hitter-friendly Fenway Park, Damon's age (32), power and speed, even his height and weight - and compares him with every major leaguer since 1949, identifying the trajectories others have taken and assessing the probability Damon will follow them.

The system forecasts Damon to have about a 25 percent chance of posting an on-base plus slugging percentage (OPS) of .829 next season, but also a 40 percent chance of declining to .761. This is because players like Damon have maintained their performance only for about one year before beginning a consistent, decided decline. In other words, buyer beware.

Pecota is less pessimistic toward shortstop Rafael Furcal, who at 28 has a better chance of maintaining his performance level. (Though the system suggests that middle infielders age more quickly than classic sluggers.) A relative sleeper could be found in outfielder Brian Giles, who despite being 35 has the kind of skills - excellent power, speed and a fine batting eye - that tend to age relatively slowly.

Pecota was developed four summers ago by Nate Silver, a 24-year-old Chicago financial consultant. "In some ways it was boredom," Silver said. "If I had a spreadsheet on my computer, it looked like I was busy." (Its official name, Player Empirical Comparison and Optimization Test Algorithm, joyfully boils down to the last name of Bill Pecota, a former major league utilityman.) The projections are anticipated enough among some executives that Silver has received e-mail messages saying, "Hey, are the Pecotas done yet?"

Though the system naturally cannot predict all player fluctuations, it succeeds more than most. Last winter, it identified Jonny Gomes, a relatively unknown Tampa Bay Devil Rays outfielder, as having an excellent chance at significant improvement. Gomes hit .282 with 21 home runs in just 101 games. It also foresaw even greater production from established players like Andruw Jones, Derrek Lee and Dontrelle Willis.

Pecota helps quantify the danger of long-term pitching investments, and points out which types of arms tend to project best. The strongest indicators of future performance are rates of strikeouts, walks and home runs, but also ground ball-to-fly ball ratio and even body type.

As for this year's free-agent pitching market, Silver sees a fine future for A. J. Burnett, an enigmatic 28-year-old right-hander. Burnett projects to have a 3.65 earned run average next season, but also has a 15 percent chance of blossoming into a Cy Young award candidate for several seasons. Of the two most intriguing relievers available, the veteran Billy Wagner and the less-known B. J. Ryan, Pecota chooses Ryan as the better long-term investment thanks to his age next season (30 to Wagner's 34) and several other peripheral factors.

Pecota's focus on looking several years ahead is what catches executives' eyes most at this time of year - and helps temper what is often unfounded optimism about players' chances of improving.

"Sometimes you have a guy with a track record, a guy in his early 30's, and when he declines we act like we're shocked," Levine said. "And we don't want to look at a 26-year-old who does X and think that in two years he's going to do two-times X. This helps us stay grounded."

No organization uses Pecota in a vacuum, instead incorporating it with other projection techniques like traditional scouting reports. But a decade after Bill Pecota retired, his name is growing more prominent each winter.

"Everyone in baseball is in the guessing business," the Mariners executive Dan Evans said. "This makes it a little bit less of a guess."

E-mail: keepingscore@nytimes.com



>

Edgy DC
Nov 13 2005 01:47 PM

Pecota chat from the other thread:

seawolf17
175) Walt Terrell SP, 1982-1984


Joined: 04 Jun 2005
Posts: 3532
Location: LI
Posted: Sun Nov 13, 2005 6:54 am Post subject:

--------------------------------------------------------------------------------

Silver's one of the Baseball Prospectus wunderkinds; he's a stathead. A lot of PECOTA is common sense, in a way -- like saying BJ Ryan is a smarter long-term investment than Billy Wagner -- but it quantifies things on a much more concrete level.
TheOldMole
286) Jim Lindeman OF, 1B, 1994


Joined: 04 Jun 2005
Posts: 2156
Posted: Sun Nov 13, 2005 9:36 am Post subject:

--------------------------------------------------------------------------------

What's Aaron Heilman's Pecota?
_________________

"It's men like you that make it difficult for people to understand one another."
--Superman, to the leader of the Mole Men

www.opus40.org
http://opusforty.blogspot.com/
Johnny Dickshot
316) Jack DiLauro RP, SP, 1969


Joined: 03 Jun 2005
Posts: 1859
Posted: Sun Nov 13, 2005 10:42 am Post subject:

--------------------------------------------------------------------------------

In the 2005 book, Pecota pegged Heilman

12% breakout
36% improve
27% collapse
And suggested it would take 2 injuries to get him a chance to play (which was more or less accurate).

"Projected" line:23 games (11 starts), 78.2 IP, 59-36 K-BB, 4.68 ERA, 4.5 VORP.

Actual: line: 53 games (7 starts), 108 IP, 106-37 K-BB, 3.17 ERA, 26.5 VORP.

PECOTA thought it was a longshot that Heilman could attain excellent K/IP and K/-BB figures.

Last edited by Johnny Dickshot on Sun Nov 13, 2005 12:26 pm; edited 1 time in total
Edgy DC
Site Admin


Joined: 05 Nov 2002
Posts: 4608
Location: DC
Posted: Sun Nov 13, 2005 12:07 pm Post subject:

--------------------------------------------------------------------------------

They need to factor in the contagiousness of Pedro's changeup.
_________________
K

Last edited by Edgy DC on Sun Nov 13, 2005 1:36 pm; edited 1 time in total
Johnny Dickshot
316) Jack DiLauro RP, SP, 1969


Joined: 03 Jun 2005
Posts: 1859
Posted: Sun Nov 13, 2005 12:27 pm Post subject:

--------------------------------------------------------------------------------

I screwed up the K-BB numbers above, and edited.

BTW, this discussion belongs more in soupy's thread than this one.</td.

Edgy DC
Nov 13 2005 01:54 PM

Sure was! The Way Back Machine has a lot of funky highlights for Bill "Wait 'Til You See This Guy" Pecota:

  • June 24, 1991: California's Dave Winfield goes 5-for-5 and hits for the cycle as the Angels defeat Kansas City, 9-4. In so doing, he becomes the oldest player in history (39) to accomplish the feat. He completes the cycle, the first of his career, in the 8th with a triple off infielder Bill Pecota, making his first pitching appearance. Winfield was the first batter faced by Pecota, who took over when Tom Gordon's hemorrhoids acted up.

  • September 2, 1991: Three months after an operation that replaced a vein in his arm with one from his leg, White Sox pitcher Roberto Hernandez holds the Royals hitless for six innings before Bill Pecota leads off the 7th with a double, the only hit Hernandez allows in Chicago's 5–1 win over KC. In the same game, Bo Jackson makes his miraculous return to the majors following a career-threatening football injury. He hits a sacrifice fly to drive in a run against his former team. Bo will end the year hitting .225 in 23 games, with three homers and 14 RBIs.

  • December 11, 1991: In a blockbuster trade, the Mets obtain two-time Cy Young winner Bret Saberhagen along with SS Bill Pecota from the Royals in exchange for Kevin McReynolds, Gregg Jefferies, and Keith Miller.

  • August 10, 1992: The Mets Vince Coleman will end the season with just 27 walks, but he picks up five today against the Pirates to tie the 20th century mark. Pittsburgh breaks a 1-1 tie against the host Mets, scoring three runs in the 16th inning to win, 4-2. Reliever Dennis Cook wins as the Bucs Andy Van Slyke and the Mets Bill Pecota homer. Franco pitches his second of four straight games, a season-high effort that puts him back on the disabled list.

  • September 26, 1992: The Mets lose to the Pirates, 19–2 as the Bucs collect 20 hits, including homers by Barry Bonds and Andy Van Slyke. Van Slyke adds a triple and Lloyd McClendon has a homer and 4 RBIs. IF Bill Pecota pinch hits and pitches the last inning for NY, becoming the first position player ever to hurl an inning for the Mets. He gives up one hit and one run.

soupcan
Nov 13 2005 03:26 PM

I'm sorry dudes.

Failed to realize there was another Pecota thread that pre-dated mine.

'Read more post less' is tough when you don't visit as often as you used to. I'll try to rectify that.

seawolf17
Nov 13 2005 03:38 PM

Soup...



You're fired.

Edgy DC
Nov 13 2005 04:36 PM

My "Sure was!" is in response to a now-deleted question posted by Coo. But she bait-and-switched me.

Not a nice weekend. First no riddle, now this.

cooby
Nov 13 2005 04:42 PM

Sorry, my question was "Didn't there used to be a Bill Pecota that played for the Mets". Then I read the article and saw he was mentioned and deleted it, not counting on "Old Eagle Eyes Edgy" to spot it so quickly.


What was the elephant doing on the highway?

KC
Nov 13 2005 05:05 PM


"Old Eagle Eyes Edgy"

Frayed Knot
Nov 13 2005 09:46 PM

soupcan wrote:
I'm sorry dudes. ... Failed to realize there was another Pecota thread that pre-dated mine.


Don't be sorry. Interesting topics having their own thread is a concept that should be embraced rather than lose it in a 10 page general purpose jumble.



]What's Aaron Heilman's Pecota?


I dunno. What's Bill Pecota's Heilman?

Actually, I suspect, but don't know, that PECOTA is a lot less accurate or meaningful when there's a scant amount of data involved (and almost all of it bad) as in Heilman's case coming into this past season.
Now I'm sure they take minor league and college stuff into consideration w/younger players but that just adds another dimension of unpredictability into the mix.

metirish
Nov 13 2005 10:24 PM

]Based on this, Omar might want to think twice before throwing $40 mil over 4 years at our friend Mr. Wagner...


No matter how this projects for Burnett I'd still rather Omar give Wagner the $40 million than give it Burnett,I'd rather have Wagner saving 40+ games for the Mets than Burnett winning 12 to 14 for that money..we have guys for that..

TheOldMole
Nov 14 2005 10:10 AM

]soupcan wrote:
I'm sorry dudes. ... Failed to realize there was another Pecota thread that pre-dated mine.


Don't be sorry. Interesting topics having their own thread is a concept that should be embraced rather than lose it in a 10 page general purpose jumble.


Nothing drives me nuts on CP faster than this boot camp insistence on never starting new threads.

cooby
Nov 14 2005 10:19 AM

There seems to be a small but growing group of us...

Edgy DC
Nov 14 2005 10:27 AM

I don't think there's an insistence so much as an inference that there is one. Please don't think there is.

Now, there are times when one should consider that multiple threads titled

"Mets after Manny"

"I Don't Want No Manny"

"New Rumors on Manny!"

are a bad idea. It interrupts the productive flow of conversation on a specific topic. It can also read as somewhat indifferent that a poster may be uninterested other posters' opinions but want to build a thread around their own. But, no, there's no such insistence. Yes, two parallel conversations on one topic are a bad idea, but, no, not all discussion about former Mets has to be in the Rico thread. I created that thread over a year ago to post updates that would generate very little conversation on their own --- Rico Brogna getting a football coaching gig, Doug Flynn hosting the Ms. Kentucky pageant.

But if you have a story that has it's own legs --- Gary Carter running for the Senate or Nolan Ryan killing a guy, or Bobby Valentine taking over the world, --- don't let anybody stop you from starting a fantastic thread.

Nymr83
Nov 14 2005 01:51 PM

]Nolan Ryan killing a guy


this goes in the Robin Ventura thread.

Edgy DC
Nov 14 2005 01:56 PM

It is pretty astounding to continuously see a photo of a 1969 Met beating up a 1999 Met in game action.

Heck, it's a 1966 Met beating up a 2001 Met in game action.

TheOldMole
Nov 14 2005 10:25 PM

Seriously...I do try to look for existent threads before starting a new one. But at the same time, it does seem like a gratuitous slap when someone says. That should have gone in the all purpose ultimate spinach thread.

Edgy DC
Nov 14 2005 10:48 PM

Nobody posts in the All-Purpose Ultimate Spinach Thread. It's like a gratuitous dissin'.

martin
Nov 15 2005 01:05 AM

i bought baseball prospectus last year and read it pretty thoroughly. one thing i remember was that they were not high on mike jacobs. loved beltran though. let me go grab it ...hang on...


ok here it is:

mike jacobs, (paraphrased):

even healthy, he is not a good prospect, bad 3-1 strikeout to walk ratio blah blah he cant sustain his average from 03.

i guess we will find out, unless konerko comes. i think the BP guys might be moneyball-influenced "OBP is everything" guys.

smg58
Nov 15 2005 09:53 AM

Poor Jake, all he ever does is hit.

While they seem to be cynical about every free agent (at least all the ones presented here), the Pecota projection for Konerko is alarming, and presumably has to do with a change in parks. We should keep that in mind before shooting the moon for him.

Edgy DC
Nov 15 2005 10:04 AM

More likely Beane was influenced by BP.