Measuring Political Preferences

Published in 1996. American Journal of Political Science 40 (1): 261-294.

Lee Epstein
Carol Mershon

Theory: When analysts adopt surrogates of actors’ political preferences for purposes unanticipated by the inventors of those measures, they often stretch (but not explicitly assess) the range of reliability and validity.
Hypothesis: The consequences pushing measures beyond their intended purposes may significantly impact research findings, as well as the conclusions drawn from those findings.
Methods: “Methodological audit” of measures developed by Segal and Cover (1989) to represent the political preferences of justices on the U.S. Supreme Court.  Mainly regression analysis using the Segal/Cover scores and vote data drawn from the U.S. Supreme Court Judicial Database.
Results: Analysts would be well advised to weigh carefully whether adequate tests have been performed before adopting others’ preference measures for their own research. More specific conclusions are: 1) scholars should invoke the Segal/Cover scores in the set of circumstances indicated by their developers: aggregated individual-level decisions in civil liberties cases and 2) students of the judicial process who seek to explore phenomena other than aggregated individual-level voting in civil liberties cases ought give serious thought to devising new surrogates for judicial preferences.

Click here for the article (.pdf).