Refs - they're just like us!

Refs - they're just like us!

Refs - are they just like us?

Does working the referees…work?

  • "Part of the game-plan" (NYT, 2008)
  • "Playing the referees" (Deadspin, 2014)
  • "Did Coach-K work the refs?" (USA Today, 2015)

Example 1

Example 2

Example 3

Example 3

What's been done?

So what do we need?

  • Judgemental calls
  • In vicinity of coaches/players
  • Data
  • Comparison group

Jackpot!

What we did

  • Three data sources
    • Armchair Analysis, Football Outsiders, stadium pictures
    • Regular season games, 2010-2014
    • Accuracy issues with NFL's PSI readings coin toss data
  • Define exposure and outcome

    • \(Direction = \left\{Offensive\ Team, Defensive\ Team, Middle\right\}\)

    • Outcomes \(Y\)
      • \(Holding\) (\(OHR\))
      • \(Interference\) (\(OPI\), \(DPI\))
      • \(Aggressiveness\) (\(DAP\))

Goals

  • \(P(Y=1|Direction=Off) \stackrel{?}{=} P(Y=1|Direction=Def)\)

  • Consider varying effects

  • Visualize, account for uncertainty

Frequencies

  • Play Direction associated with defensive penalty calls
  • Play Direction not associated with score, down/distance, etc (not shown)

Flexible Model

  • Possible moderating variable: \(LOS = Line\ of \ scrimmage\)

  • Generalized additive model (GAM):

  • logit(P(Y=1)) = \(\beta_1*I(Direction = Off)\) + \(f_{Off}\)(LOS) +\(f_{Def}\)(LOS)
    • \(\beta_1\)
    • \(f_{Off}(LOS), f_{Def}(LOS)\)

Charts

Charts

Charts

Charts

Charts

What do we know?

  • More defensive judgment calls near offensive team bench
  • Slightly more offensive judgment calls near defensive team bench
  • Teams unaware?

Refs - they're just like us!

They succomb to (are bullied by?) coaches & players.

Final thoughts

  • Read paper at StatsbyLopez
  • Acknowledgements:

    1. JSM panel
    2. Statistics in Sports section
    3. Skidmore's Cody Couture

OPI

DPI - random slope model