Arrow's_theorem

Arrow's impossibility theorem

Arrow's impossibility theorem

Add article description


Arrow's impossibility theorem is a key impossibility theorem in social choice theory, showing that no ranked voting rule[note 1] can produce a logically coherent ranking of more than two candidates. Specifically, no such rule can satisfy a key criterion of rational choice called independence of irrelevant alternatives: that a choice between and should not depend on the quality of a third, unrelated outcome .

The theorem is often cited in discussions of election science and voting theory, where is called a spoiler candidate. As a result, Arrow's theorem implies that a ranked voting system can never be completely independent of spoilers.

The practical consequences of the theorem are debatable, with Arrow himself noting "Most [ranked] systems are not going to work badly all of the time. All I proved is that all can work badly at times."[1][2] Spoiler effects are common in some ranked systems (like instant-runoff and plurality), but rare in majority-rule methods (see below).

While originally overlooked, a large class of methods, called rated methods, are not afflicted by Arrow's theorem or IIA failures.[2][3][4] Arrow himself came to support Score voting later in life, saying it "probably is best".[2]

History

Arrow's theorem is named after economist and Nobel laureate Kenneth Arrow, who demonstrated it in his doctoral thesis and popularized it in his 1951 book.[5]

Arrow's work is remembered as much for its pioneering methodology as its direct implications. Arrow's axiomatic approach provided a framework for proving facts about all conceivable voting mechanisms at once, contrasting with the earlier approach of investigating such rules one by one.[6]

Background

Arrow's theorem falls under the branch of welfare economics known as social choice theory, which deals with aggregating preferences and information to make fair and accurate decisions for society. The goal is to create a social ordering function—a procedure for determining which outcomes are better, according to society as a whole—that satisfies the properties of rational behavior.

Among the most important of these is independence of irrelevant alternatives, which says that when deciding between A and B, our opinions about C should not affect our decision. Arrow's theorem shows this is not possible without relying on further information, such as rated ballots (which are rejected by strict behaviorists and many philosophers).

Non-degenerate systems

As background, it is typically assumed that any non-degenerate (i.e. actually useful) voting system non-dictatorship:

  • Non-dictatorship—at least two voters can affect the outcome of the election. (The system does not just ignore every vote except one, or even ignore all of the votes and always elect the same candidate.)

Most proofs use additional assumptions to simplify deriving the result, though Robert Wilson proved these to be unnecessary.[7] Older proofs have taken as axioms:

  • Non-negative responseadding support for an outcome should not cause it to lose. While originally considered "obvious" for any practical system, this criterion is failed by instant-runoff voting. Arrow later gave another proof applying to systems with negative response.
  • Pareto efficiency—if every voter agrees one candidate is better than another, the system will agree as well. (A candidate with unanimous support should win.) This assumption replaces non-negative response in Arrow's second proof, extending it to include instant-runoff voting.
  • Majority rule—if most voters prefer to , then should defeat . This form was proven by the Marquis de Condorcet with his discovery of the voting paradox.
  • Universal domain—Some authors are explicit about the assumption that the social welfare function is a function over the domain of preferences (not just a partial function).
    • In other words, the system cannot simply "give up" and refuse to elect a candidate in some elections.

Independence of irrelevant alternatives (IIA)

The IIA condition is an important assumption governing rational choice. The axiom says that adding irrelevant—i.e. rejected—options should not affect the outcome of a decision. From a practical point of view, the assumption prevents electoral outcomes from behaving erratically in response to the arrival and departure of candidates.[8]

Arrow defines IIA slightly differently, by stating that the social preference between alternatives and should only depend on the individual preferences between and ; that is, it should not be able to go from to by changing preferences over some irrelevant alternative, e.g. whether . This is equivalent to the above statement about independence of spoiler candidates when using the standard construction of a placement function.

Theorem

Intuition

Arrow's requirement that the social preference only depend on individual preferences is extremely restrictive. May's theorem shows the only "fair" way to choose between two candidates based on ordinal preferences is majority voting. This means that assumptions only slightly stronger than Arrow's are already enough to lock us into the class of Condorcet methods. At this point, the existence of the voting paradox is enough to show the impossibility of rational behavior.

While the above argument is intuitive, it is not formal, and it requires additional assumptions not used by Arrow.

Formal statement

Let A be a set of outcomes, N a number of voters or decision criteria. We denote the set of all total orderings of A by L(A).

An ordinal (ranked) social welfare function is a function:

which aggregates voters' preferences into a single preference order on A.

An N-tuple (R1, …, RN) ∈ L(A)N of voters' preferences is called a preference profile. We assume two conditions:

Pareto efficiency
If alternative a is ranked strictly higher than b for all orderings R1 , …, RN, then a is ranked strictly higher than b by F(R1, R2, …, RN). This axiom is not needed to prove the result,[7] but is used in both proofs below.
Non-dictatorship
There is no individual i whose strict preferences always prevail. That is, there is no i ∈ {1, …, N} such that for all (R1, …, RN) ∈ L(A)N and all a and b, when a is ranked strictly higher than b by Ri then a is ranked strictly higher than b by F(R1, R2, …, RN).

Then, this rule must violate independence of irrelevant alternatives:

Independence of irrelevant alternatives
For two preference profiles (R1, …, RN) and (S1, …, SN) such that for all individuals i, alternatives a and b have the same order in Ri as in Si, alternatives a and b have the same order in F(R1, …, RN) as in F(S1, …, SN).

Formal proof

More information decisive over an ordered pair ...
More information Proof by pivotal voter ...

Interpretation and practical solutions

Arrow's theorem establishes that no ranked voting rule can always satisfy independence of irrelevant alternatives, but it says nothing about the frequency of spoilers. This led Arrow to remark that "Most systems are not going to work badly all of the time. All I proved is that all can work badly at times."[1][2]

Attempts at dealing with the effects of Arrow's theorem take one of two approaches: either accepting his rule and searching for the least spoiler-prone methods, or dropping his assumption of ranked voting to focus on studying rated voting rules.

Minimal IIA failures: Majority-rule methods

An example of a Condorcet cycle, where some candidate must be a spoiler.

The first set of methods economists have studied are the majority-rule methods, which limit spoilers to rare situations where majority rule is self-contradictory, and uniquely minimize the possibility of a spoiler effect among rated methods.[14] Arrow's theorem was preceded by the Marquis de Condorcet's discovery of cyclic social preferences, cases where majority votes are logically inconsistent. Condorcet believed voting rules should satisfy his majority rule principle, i.e. if most voters rank Alice ahead of Bob, Alice should defeat Bob in the election.

Unfortunately, as Condorcet proved, this rule can be self-contradictory (intransitive), because there can be a rock-paper-scissors cycle with three or more candidates defeating each other in a circle. Thus Condorcet proved a weaker form of Arrow's impossibility theorem long before Arrow himself, under the stronger assumption that a voting system in the two-candidate case will consist of a simple majority vote.

Condorcet methods avoid the spoiler effect in non-cyclic elections, where candidates can be chosen by majority rule. Political scientists have found such cycles to be empirically rare, suggesting they are of limited practical concern. Spatial voting models also suggest the paradox is infrequent[15] or even non-existent.[16]

Left-right spectrum

Duncan Black showed his own remarkable result, the median voter theorem. The theorem proves that if voters and candidates are arranged on a left-right spectrum, Arrow's conditions are compatible, and all of them will be met by any rule satisfying Condorcet's principle.

More formally, Black's theorem assumes preferences are single-peaked: a voter's happiness with a candidate goes up and then down as the candidate moves along some spectrum. For example, in a group of friends choosing a volume setting for music, each friend would likely have their own ideal volume; as volume gets progressively too loud or too quiet, they would be increasingly dissatisfied.

If the domain is restricted to profiles where every individual has a single-peaked preference with respect to the linear ordering, then social preferences are acyclic. In this situation, Condorcet methods satisfy a wide variety of highly-desirable properties.[16]

Unfortunately, the rule does not generalize from the political spectrum to the political compass, a result called the McKelvey-Schofield Chaos Theorem.[17] However, a well-defined median and Condorcet winner do exist if the distribution of voters on the ideological spectrum is rotationally symmetric.[18] In realistic cases, when voters' opinions are roughly bell-shaped distribution or can be accurately summarized by one or two dimensions, Condorcet cycles are rare.[15][19]

Generalized stability theorems

Campbell and Kelly (2000) proved that Condorcet methods are the most spoiler-resistant class of ranked voting systems: whenever it is possible for some ranked voting system to avoid a spoiler effect. In other words, replacing a ranked-voting method with its Condorcet variant (i.e. eliminate all candidates outside the Smith set, then run the method) will sometimes eliminate spoiler effects, but will never cause a new spoiler effect.[14]

In 1977, Ehud Kalai and Eitan Muller gave a full characterization of domain restrictions admitting a nondictatorial and rational social welfare function. These correspond to preferences for which there is a Condorcet winner.[20]

Holliday and Pacuit devise a voting system that provably minimizes the potential for spoiler effects, albeit at the cost of other criteria, and find that it is a Condorcet method, albeit at the cost of occasional monotonicity failures (at a much lower rate than seen in instant-runoff voting).[19]

No IIA failures: Rated voting

As shown above, the proof of Arrow's theorem relies crucially on the assumption of ranked voting, and is not applicable to rated voting systems. As a result, systems like score voting and graduated majority judgment pass independence of irrelevant alternatives.[1] These systems ask voters to rate candidates on a numerical scale (e.g. from 0–10), and then elect the candidate with the highest average (for score voting) or median (graduated majority judgment).

While Arrow's theorem does not apply to graded systems, Gibbard's theorem still does: no electoral system is fully strategy-free,[21] so the informal dictum that "no voting system is perfect" still has some mathematical basis.[22]

Interpersonal comparisons of utility

Arrow's framework assumed individual and social preferences are orderings or rankings, i.e. statements about which outcomes are better or worse than others. Taking inspiration from the strict behaviorism popular in psychology, some philosophers and economists rejected the idea of comparing internal human experiences of well-being.[23] Such philosophers rejected statements like "a person hit by a car experiences more pain than a person who stubbed their toe" as unfalsifiable and therefore meaningless.

Amartya Sen argued cardinal methods would fail independence of irrelevant alternatives if interpersonal comparison of utilities is impossible.[24] Arrow himself originally rejected cardinal utility as a meaningful tool for expressing social welfare, leading him focus his theorem on preference rankings.[23][25] However, he reversed his opinion later in life, admitting scoring methods could provide useful information allowing such systems to evade his theorem.[2]

Further support for this comes in the form of results like Harsanyi's utilitarian theorem[26] and other utility representation theorems like the VNM theorem, which show that rational behavior implies consistent cardinal utilities. John Harsanyi[26] and William Vickrey[27] independently derived results showing such preferences could be rigorously defined using individual preferences over the lottery of birth.[28][29] These results have led to the rise of implicit utilitarian voting approaches, which model ranked-choice procedures as approximations of rated systems.[30]

Non-Arrovian spoilers

Behavioral economists and cognitive scientists have shown individual decisions sometimes violate independence of irrelevant alternatives, with well-known examples such as decoy effects, where including useless options can slightly increase ratings of another product.[31] As a result, human psychology could create slight IIA violations in graded voting systems, even when the voting system itself does not cause a spoiler effect.

Strategic voting can also create pseudo-spoiler situations. If the method passes the majority criterion and the winner with honest voting is A, but with strategy is B, then eliminating every candidate but A and B would change the strategic outcome from B to A since majority rule is strategy-proof. Such cases are outside of the scope of Arrow's theorem.

Esoteric solutions

In addition to the above practical resolutions, there exist unusual (impractical) situations in which Arrow's conditions can be satisfied.

Non-neutral voting rules

When equal treatment of candidates is not a necessity, Condorcet's majority-rule criterion can be modified to require a supermajority. Such situations become more practical if there is a clear default (such as doing nothing, or allowing an incumbent to continue to hold office in a recall election). In this situation, setting a threshold for alternatives at —e.g. a 23 majority for 3 outcomes or 34 for 4—eliminates cycling, a result related to the Nakamura number of voting mechanisms.

Under some conditions, such as convex preferences with a quasiconcave probability distribution over ideal points, this requirement can be relaxed to require only 1 - 1e (roughly 64%) of the vote to prevent cycles.[32]

Uncountably infinite voters

Fishburn shows all of Arrow's conditions can be satisfied for uncountable sets of voters given the axiom of choice;[33] however, Kirman and Sondermann showed this requires disenfranchising almost all members of a society (eligible voters form a set of measure 0).[34]

Fractional social choice

Maximal lotteries satisfy a probabilistic version of Arrow's criteria in fractional social choice models, where candidates can be elected by lottery or engage in power-sharing agreements (e.g. where each holds office for a specified period of time).[35]

Common misconceptions

Arrow's theorem does not deal with strategic voting, which does not appear in his framework. The Arrovian framework of social welfare (and most of the field of mathematical voting theory) assumes all voter preferences are known and the only issue is in aggregating them. The study of strategic voting generally falls under game theory, which has produced results like Gibbard's theorem and the semi-honesty of cardinal votes in Poisson games.

Contrary to common misconception,[citation needed] Arrow's theorem deals with the limited class of ranked-choice voting systems, rather than voting systems as a whole. Arrow's theorem is also not limited to methods of paired comparison; as noted above, every rule not based on paired comparisons trivially fails IIA, as any such rule directly relies on preferences other than those involving both candidates.

See also


References

  1. McKenna, Phil (12 April 2008). "Vote of no confidence". New Scientist. 198 (2651): 30–33. doi:10.1016/S0262-4079(08)60914-8.
  2. Aaron, Hamlin (25 May 2015). "CES Podcast with Dr Arrow". Center for Election Science. CES. Archived from the original on 27 October 2018. Retrieved 9 March 2023. Now there's another possible way of thinking about it, which is not included in my theorem. But we have some idea how strongly people feel. In other words, you might do something like saying each voter does not just give a ranking. But says, this is good. And this is not good[...] So this gives more information than simply what I have asked for.
  3. "The Spoiler Effect". The Center for Election Science. 2015-05-20. Retrieved 2017-01-29.
  4. Poundstone, William. (2013). Gaming the vote : why elections aren't fair (and what we can do about it). Farrar, Straus and Giroux. pp. 168, 197, 234. ISBN 9781429957649. OCLC 872601019. IRV is subject to something called the "center squeeze." A popular moderate can receive relatively few first-place votes through no fault of her own but because of vote splitting from candidates to the right and left. ... Approval voting thus appears to solve the problem of vote splitting simply and elegantly. ... Range voting solves the problems of spoilers and vote splitting
  5. Suzumura, Kōtarō (2002). "Introduction". In Arrow, Kenneth J.; Sen, Amartya K.; Suzumura, Kōtarō (eds.). Handbook of social choice and welfare. Vol. 1. Amsterdam, Netherlands: Elsevier. p. 10. ISBN 978-0-444-82914-6.
  6. Wilson, Robert (December 1972). "Social choice theory without the Pareto Principle". Journal of Economic Theory. 5 (3): 478–486. doi:10.1016/0022-0531(72)90051-8. ISSN 0022-0531.
  7. Arrow, Kenneth Joseph Arrow (1963). Social Choice and Individual Values (PDF). Yale University Press. ISBN 978-0300013641. Archived (PDF) from the original on 2022-10-09.
  8. Sen, Amartya (2014-07-22). "Arrow and the Impossibility Theorem". The Arrow Impossibility Theorem. Columbia University Press. pp. 29–42. doi:10.7312/mask15328-003. ISBN 978-0-231-52686-9.
  9. Rubinstein, Ariel (2012). Lecture Notes in Microeconomic Theory: The Economic Agent (2nd ed.). Princeton University Press. Problem 9.5. ISBN 978-1-4008-4246-9. OL 29649010M.
  10. Barberá, Salvador (January 1980). "Pivotal voters: A new proof of arrow's theorem". Economics Letters. 6 (1): 13–16. doi:10.1016/0165-1765(80)90050-6. ISSN 0165-1765.
  11. Geanakoplos, John (2005). "Three Brief Proofs of Arrow's Impossibility Theorem" (PDF). Economic Theory. 26 (1): 211–215. CiteSeerX 10.1.1.193.6817. doi:10.1007/s00199-004-0556-7. JSTOR 25055941. S2CID 17101545. Archived (PDF) from the original on 2022-10-09.
  12. Yu, Ning Neil (2012). "A one-shot proof of Arrow's theorem". Economic Theory. 50 (2): 523–525. doi:10.1007/s00199-012-0693-3. JSTOR 41486021. S2CID 121998270.
  13. Indeed, many different social welfare functions can meet Arrow's conditions under such restrictions of the domain. It has been proven, however, that under any such restriction, if there exists any social welfare function that adheres to Arrow's criteria, then Condorcet method will adhere to Arrow's criteria. See Campbell, D. E.; Kelly, J. S. (2000). "A simple characterization of majority rule". Economic Theory. 15 (3): 689–700. doi:10.1007/s001990050318. JSTOR 25055296. S2CID 122290254.
  14. "Voter Satisfaction Efficiency (VSE) FAQ". Voter Satisfaction Efficiency Simulator. Retrieved 2024-03-24.
  15. Black, Duncan (1968). The theory of committees and elections. Cambridge, Eng.: University Press. ISBN 978-0-89838-189-4.
  16. McKelvey, Richard D. (1976). "Intransitivities in multidimensional voting models and some implications for agenda control". Journal of Economic Theory. 12 (3): 472–482. doi:10.1016/0022-0531(76)90040-5.
  17. See Valerio Dotti's thesis "Multidimensional Voting Models" (2016).
  18. Holliday, Wesley H.; Pacuit, Eric (2023-09-01). "Stable Voting". Constitutional Political Economy. 34 (3): 421–433. doi:10.1007/s10602-022-09383-9. ISSN 1572-9966.
  19. Cockrell, Jeff (2016-03-08). "What economists think about voting". Capital Ideas. Chicago Booth. Archived from the original on 2016-03-26. Retrieved 2016-09-05. Is there such a thing as a perfect voting system? The respondents were unanimous in their insistence that there is not.
  20. "Modern economic theory has insisted on the ordinal concept of utility; that is, only orderings can be observed, and therefore no measurement of utility independent of these orderings has any significance. In the field of consumer's demand theory the ordinalist position turned out to create no problems; cardinal utility had no explanatory power above and beyond ordinal. Leibniz' Principle of the identity of indiscernibles demanded then the excision of cardinal utility from our thought patterns." Arrow (1967), as quoted on p. 33 by Racnchetti, Fabio (2002), "Choice without utility? Some reflections on the loose foundations of standard consumer theory", in Bianchi, Marina (ed.), The Active Consumer: Novelty and Surprise in Consumer Choice, Routledge Frontiers of Political Economy, vol. 20, Routledge, pp. 21–45
  21. Sen, Amartya Kumar (2017). "8* Bargains and Social Welfare Functions". Collective Choice and Social Welfare. Cambridge (Massachusetts): Harvard University Press. pp. 185–186. ISBN 978-0-674-97160-8.
  22. Arrow, Kenneth Joseph Arrow (1963). "III. The Social Welfare Function". Social Choice and Individual Values (PDF). Yale University Press. pp. 31–33. ISBN 978-0300013641. Archived (PDF) from the original on 2022-10-09.
  23. Harsanyi, John C. (1955). "Cardinal Welfare, Individualistic Ethics, and Interpersonal Comparisons of Utility". Journal of Political Economy. 63 (4): 309–321. doi:10.1086/257678. JSTOR 1827128. S2CID 222434288.
  24. Vickery, William (1945). "Measuring Marginal Utility by Reactions to Risk". Econometrica. 13 (4): 319–333. doi:10.2307/1906925. JSTOR 1906925.
  25. Mongin, Philippe (October 2001). "The impartial observer theorem of social ethics". Economics & Philosophy. 17 (2): 147–179. doi:10.1017/S0266267101000219. ISSN 1474-0028.
  26. Feiwel, George, ed. (1987). Arrow and the Foundations of the Theory of Economic Policy. Springer. p. 92. ISBN 9781349073573. ...the fictitious notion of 'original position' [was] developed by Vickery (1945), Harsanyi (1955), and Rawls (1971).
  27. Procaccia, Ariel D.; Rosenschein, Jeffrey S. (2006). "The Distortion of Cardinal Preferences in Voting". Cooperative Information Agents X. Lecture Notes in Computer Science. Vol. 4149. pp. 317–331. CiteSeerX 10.1.1.113.2486. doi:10.1007/11839354_23. ISBN 978-3-540-38569-1.
  28. Huber, Joel; Payne, John W.; Puto, Christopher P. (2014). "Let's Be Honest About the Attraction Effect". Journal of Marketing Research. 51 (4): 520–525. doi:10.1509/jmr.14.0208. ISSN 0022-2437. S2CID 143974563.
  29. Caplin, Andrew; Nalebuff, Barry (1988). "On 64%-Majority Rule". Econometrica. 56 (4): 787–814. doi:10.2307/1912699. ISSN 0012-9682.
  30. Fishburn, Peter Clingerman (1970). "Arrow's impossibility theorem: concise proof and infinite voters". Journal of Economic Theory. 2 (1): 103–106. doi:10.1016/0022-0531(70)90015-3.
  31. See Chapter 6 of Taylor, Alan D. (2005). Social choice and the mathematics of manipulation. New York: Cambridge University Press. ISBN 978-0-521-00883-9 for a concise discussion of social choice for infinite societies.
  32. F. Brandl and F. Brandt. Arrovian Aggregation of Convex Preferences. Econometrica. 88(2), pages 799-844, 2020.

Further reading

  1. in social choice, ranked rules include Plurality and all other rules that only make use of voters' rank preferences. Rated rules are thus excluded.

Share this article:

This article uses material from the Wikipedia article Arrow's_theorem, and is written by contributors. Text is available under a CC BY-SA 4.0 International License; additional terms may apply. Images, videos and audio are available under their respective licenses.